2024-03-18T00:11:50.177 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-18T00:11:50.178 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517 --name pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} -- /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/orig.config.yaml 2024-03-18T00:11:50.222 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T00:11:50.410 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517 branch: wip-batrick-testing-20240314.183243 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7608517' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - mons down, quorum - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240314.183243 sha1: c382027d5c66ef4e0aa1131ea3e8080c658d3184 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: c382027d5c66ef4e0aa1131ea3e8080c658d3184 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu6T/EBrcVyipR51TLfO4ErsbDbbKfbVEKXYbfZlU5Pk+YMFCh0C7ySdXci9ItkftF2ds2Eu5VC8owGn+UZ4Gk= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZEDarbIirPXjOmWqMJTJsT+MIa9MekmOVoh8NtnrlGavsAX5nMBBZy+Fssv+EyKb0mWkytGFbDcoMeG1J1z4c= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-17_23:17:27 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-18T00:11:50.410 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa; will attempt to use it 2024-03-18T00:11:50.411 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks 2024-03-18T00:11:50.411 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-18T00:11:50.412 INFO:teuthology.task.internal:Checking packages... 2024-03-18T00:11:50.434 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-18T00:11:50.435 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T00:11:50.435 INFO:teuthology.packaging:ref: None 2024-03-18T00:11:50.435 INFO:teuthology.packaging:tag: None 2024-03-18T00:11:50.435 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-18T00:11:50.435 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T00:11:50.435 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-18T00:11:50.652 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162.g3d78f5ba 2024-03-18T00:11:50.654 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-18T00:11:50.660 INFO:teuthology.task.internal:no buildpackages task found 2024-03-18T00:11:50.661 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-18T00:11:50.668 INFO:teuthology.task.internal:Saving configuration 2024-03-18T00:11:50.685 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-18T00:11:50.691 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T00:11:50.716 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 00:06:54.588723', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu6T/EBrcVyipR51TLfO4ErsbDbbKfbVEKXYbfZlU5Pk+YMFCh0C7ySdXci9ItkftF2ds2Eu5VC8owGn+UZ4Gk='} 2024-03-18T00:11:50.741 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 00:06:54.586853', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZEDarbIirPXjOmWqMJTJsT+MIa9MekmOVoh8NtnrlGavsAX5nMBBZy+Fssv+EyKb0mWkytGFbDcoMeG1J1z4c='} 2024-03-18T00:11:50.741 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-18T00:11:50.747 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-18T00:11:50.747 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-18T00:11:50.747 INFO:teuthology.run_tasks:Running task console_log... 2024-03-18T00:11:50.814 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0811fb4160>, signals=[15]) 2024-03-18T00:11:50.815 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-18T00:11:50.821 INFO:teuthology.task.internal:Opening connections... 2024-03-18T00:11:50.821 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:11:50.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:11:50.912 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:11:50.913 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:11:50.998 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-18T00:11:51.004 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-03-18T00:11:51.021 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-03-18T00:11:51.022 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:11:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:11:51.080 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:11:51.081 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-03-18T00:11:51.112 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-03-18T00:11:51.129 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-03-18T00:11:51.129 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-03-18T00:11:51.190 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-03-18T00:11:51.190 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T00:11:51.191 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T00:11:51.192 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-03-18T00:11:51.212 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-18T00:11:51.242 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-18T00:11:51.264 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-18T00:11:51.265 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-03-18T00:11:51.269 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-03-18T00:11:51.286 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-18T00:11:51.408 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-18T00:11:51.409 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-03-18T00:11:51.412 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-03-18T00:11:51.495 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-18T00:11:51.557 INFO:teuthology.run_tasks:Running task kernel... 2024-03-18T00:11:51.578 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-18T00:11:51.579 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-18T00:11:51.579 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-18T00:11:51.579 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T00:11:51.580 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T00:11:51.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:11:51.597 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-03-18T00:11:51.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:11:51.598 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-03-18T00:11:51.654 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-361.el9.x86_64 2024-03-18T00:11:51.655 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-361.el9.x86_64 2024-03-18T00:11:51.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-03-18T00:11:51.661 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-361.el9.x86_64 2024-03-18T00:11:51.661 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-361.el9.x86_64 2024-03-18T00:11:51.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-03-18T00:11:53.800 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 14 MB/s | 6.7 MB 00:00 2024-03-18T00:11:53.809 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-18T00:11:55.234 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 6.4 MB/s | 2.0 MB 00:00 2024-03-18T00:11:55.410 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.0 MB 00:00 2024-03-18T00:11:57.424 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.0 MB 00:01 2024-03-18T00:12:19.246 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 930 kB/s | 19 MB 00:20 2024-03-18T00:12:24.630 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 3.3 MB/s | 6.1 MB 00:01 2024-03-18T00:12:26.447 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 16 kB 00:00 2024-03-18T00:12:27.340 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 27 MB/s | 21 MB 00:00 2024-03-18T00:12:31.213 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 232 kB/s | 8.0 MB 00:35 2024-03-18T00:12:32.173 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-18T00:12:33.400 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-03-18T00:12:34.313 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-18T00:12:34.313 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-18T00:12:34.433 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-03-18T00:12:34.438 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-03-18T00:12:34.438 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-03-18T00:12:34.438 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-03-18T00:12:34.439 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:12:34.440 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 100 M 2024-03-18T00:12:34.440 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 123 M 2024-03-18T00:12:34.440 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-03-18T00:12:37.490 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.1 MB 00:00 2024-03-18T00:12:38.916 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-03-18T00:12:39.959 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-03-18T00:12:45.018 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-03-18T00:12:47.199 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-18T00:12:47.199 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-18T00:12:47.298 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-03-18T00:12:47.306 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:12:47.306 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-03-18T00:12:47.306 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:12:47.306 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-03-18T00:12:47.306 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 100 M 2024-03-18T00:12:47.307 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 123 M 2024-03-18T00:12:47.308 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-03-18T00:12:56.010 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 711 kB/s | 6.0 MB 00:08 2024-03-18T00:13:00.578 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 235 kB/s | 6.0 MB 00:26 2024-03-18T00:13:08.909 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 1.8 MB/s | 39 MB 00:21 2024-03-18T00:13:16.517 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-core-5.14.0-427.el9.x86_64.rpm 732 kB/s | 21 MB 00:29 2024-03-18T00:13:39.081 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 794 kB/s | 33 MB 00:43 2024-03-18T00:13:39.082 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-03-18T00:13:39.082 INFO:teuthology.orchestra.run.smithi081.stdout:Total 1.9 MB/s | 100 MB 00:51 2024-03-18T00:13:39.959 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-03-18T00:13:40.322 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-03-18T00:13:40.322 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-03-18T00:13:41.940 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-03-18T00:13:41.941 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-03-18T00:13:44.643 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-03-18T00:13:45.285 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-18T00:13:45.416 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:13:48.182 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:13:48.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:13:53.114 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:13:53.238 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:13:58.025 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:14:02.075 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 244 kB/s | 21 MB 01:27 2024-03-18T00:14:27.125 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:14:27.126 INFO:teuthology.orchestra.run.smithi081.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-18T00:14:27.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:14:27.211 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:14:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:14:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-18T00:14:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:14:27.661 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:14:28.096 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:14:28.097 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-03-18T00:14:28.603 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T00:14:28.781 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.781 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T00:14:28.781 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-18T00:14:28.782 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T00:14:28.782 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T00:14:28.782 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-18T00:14:28.782 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T00:14:28.782 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T00:14:28.903 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T00:14:28.903 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T00:14:28.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-03-18T00:14:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-03-18T00:14:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-03-18T00:14:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-03-18T00:14:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 68.el9 2024-03-18T00:14:28.937 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8264254 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:14:28.938 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T00:14:28.939 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T00:14:28.939 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T00:14:28.939 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-03-18T00:14:28.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:14:28.939 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T00:14:28.939 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T00:14:28.940 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-427.el9.x86_64 2024-03-18T00:14:28.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T00:14:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-03-18T00:14:30.931 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-18T00:14:30.972 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-03-18T00:14:30.975 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-03-18T00:14:30.995 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.b02U7TRz4O 2024-03-18T00:14:30.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.b02U7TRz4O 2024-03-18T00:14:31.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.b02U7TRz4O 2024-03-18T00:14:31.204 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.b02U7TRz4O is 6KB 2024-03-18T00:14:31.252 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.b02U7TRz4O 2024-03-18T00:14:31.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T00:14:31.338 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-18T00:14:31.338 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-18T00:14:31.339 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-18T00:14:31.339 INFO:teuthology.orchestra.run.smithi081.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-18T00:14:31.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-18T00:14:31.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-03-18T00:15:01.489 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-18T00:15:01.490 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:15:01.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:19.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-18T00:15:28.840 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:15:28.841 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:31.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-18T00:15:35.448 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 221 kB/s | 33 MB 02:34 2024-03-18T00:15:36.207 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 221 kB/s | 39 MB 03:01 2024-03-18T00:15:36.207 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-03-18T00:15:36.207 INFO:teuthology.orchestra.run.smithi136.stdout:Total 561 kB/s | 100 MB 03:01 2024-03-18T00:15:37.090 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-03-18T00:15:37.496 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-03-18T00:15:37.497 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-03-18T00:15:38.820 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-03-18T00:15:38.820 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-03-18T00:15:41.755 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-03-18T00:15:42.398 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-18T00:15:42.544 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:15:43.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:15:43.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:15:45.358 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:15:45.555 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:15:50.283 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:15:50.490 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:15:55.252 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:16:02.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-03-18T00:16:17.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:16:17.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:16:17.689 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-03-18T00:16:18.099 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:16:18.099 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-427.el9.x86_64"... 2024-03-18T00:16:18.099 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-03-18T00:16:18.113 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-427.el9.x86_64 2024-03-18T00:16:18.113 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-18T00:16:18.114 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T00:16:18.114 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T00:16:19.115 DEBUG:teuthology.parallel:result is None 2024-03-18T00:16:24.285 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:16:24.285 INFO:teuthology.orchestra.run.smithi136.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-18T00:16:24.286 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:16:24.369 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:16:24.810 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:16:24.811 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-18T00:16:24.811 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T00:16:24.811 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:16:25.221 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-03-18T00:16:25.783 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T00:16:25.921 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T00:16:25.922 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T00:16:25.922 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-18T00:16:25.922 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T00:16:25.922 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T00:16:25.922 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-18T00:16:25.922 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T00:16:25.922 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T00:16:26.043 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T00:16:26.043 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T00:16:26.044 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-18T00:16:26.077 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T00:16:26.078 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-03-18T00:16:26.079 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:16:26.079 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T00:16:26.079 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T00:16:26.079 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-427.el9.x86_64 2024-03-18T00:16:26.080 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T00:16:26.700 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-03-18T00:16:28.026 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-18T00:16:28.057 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-03-18T00:16:28.059 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-03-18T00:16:28.074 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.dM6tXHy0yU 2024-03-18T00:16:28.074 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dM6tXHy0yU 2024-03-18T00:16:28.143 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.dM6tXHy0yU 2024-03-18T00:16:28.283 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.dM6tXHy0yU is 6KB 2024-03-18T00:16:28.332 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.dM6tXHy0yU 2024-03-18T00:16:28.346 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T00:16:28.411 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-18T00:16:28.412 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-18T00:16:28.412 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-18T00:16:28.412 INFO:teuthology.orchestra.run.smithi136.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-18T00:16:28.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-18T00:16:28.543 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-03-18T00:16:58.547 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-18T00:16:58.548 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:16:58.549 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:17:17.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-03-18T00:17:26.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:17:26.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:17:29.150 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-03-18T00:17:41.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:17:41.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:17:59.582 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-03-18T00:18:14.584 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:18:14.585 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:18:15.148 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-03-18T00:18:15.538 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:18:15.538 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-427.el9.x86_64"... 2024-03-18T00:18:15.538 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-03-18T00:18:15.552 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-427.el9.x86_64 2024-03-18T00:18:15.552 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-18T00:18:15.552 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T00:18:15.552 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T00:18:16.554 DEBUG:teuthology.parallel:result is None 2024-03-18T00:18:16.554 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-18T00:18:16.562 INFO:teuthology.task.internal:Creating test directory... 2024-03-18T00:18:16.562 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T00:18:16.565 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T00:18:16.592 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-18T00:18:16.599 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-18T00:18:16.607 INFO:teuthology.task.internal:Creating archive directory... 2024-03-18T00:18:16.607 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T00:18:16.625 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T00:18:16.670 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-18T00:18:16.678 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-18T00:18:16.678 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T00:18:16.690 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T00:18:16.808 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T00:18:16.814 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T00:18:16.843 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T00:18:16.878 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T00:18:16.880 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-18T00:18:16.887 INFO:teuthology.task.internal:Configuring sudo... 2024-03-18T00:18:16.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T00:18:16.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T00:18:16.939 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-18T00:18:16.948 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-18T00:18:16.949 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T00:18:16.962 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T00:18:16.990 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T00:18:17.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T00:18:17.105 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T00:18:17.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T00:18:17.231 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:18:17.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T00:18:17.299 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T00:18:17.339 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T00:18:17.388 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T00:18:17.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T00:18:17.513 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:18:17.514 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T00:18:17.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-03-18T00:18:17.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-03-18T00:18:17.640 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T00:18:17.736 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T00:18:17.986 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-18T00:18:17.995 INFO:teuthology.task.internal:Starting timer... 2024-03-18T00:18:17.995 INFO:teuthology.run_tasks:Running task pcp... 2024-03-18T00:18:18.006 INFO:teuthology.run_tasks:Running task selinux... 2024-03-18T00:18:18.016 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-18T00:18:18.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-03-18T00:18:18.086 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-03-18T00:18:18.087 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-03-18T00:18:18.304 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-03-18T00:18:18.306 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-18T00:18:18.306 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-03-18T00:18:18.330 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-03-18T00:18:18.330 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-03-18T00:18:18.354 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-03-18T00:18:18.354 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-03-18T00:18:18.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T00:18:18.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:18:18.399 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T00:18:18.427 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:18:18.427 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-18T00:18:18.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-03-18T00:18:18.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-03-18T00:18:18.506 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-18T00:18:18.515 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-18T00:18:18.521 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-18T00:18:18.649 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-18T00:18:18.666 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-18T00:18:18.667 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-18T00:22:30.802 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-03-18T00:22:30.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:22:30.805 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:22:30.895 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-03-18T00:22:30.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-03-18T00:22:30.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:22:30.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T00:22:31.059 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-03-18T00:22:31.132 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-03-18T00:22:31.133 INFO:teuthology.run_tasks:Running task clock... 2024-03-18T00:22:31.144 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-18T00:22:31.145 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T00:22:31.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T00:22:31.148 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T00:22:31.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T00:22:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T00:22:31.194 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T00:22:31.204 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T00:22:31.221 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T00:22:31.224 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-03-18T00:22:31.237 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-03-18T00:22:31.250 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-03-18T00:22:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T00:22:31.264 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-03-18T00:22:31.270 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T00:22:31.281 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T00:22:31.297 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T00:22:31.322 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-03-18T00:22:31.325 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T00:22:31.325 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-03-18T00:22:31.326 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.326 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.326 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.326 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.349 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.353 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T00:22:31.354 INFO:teuthology.run_tasks:Running task install... 2024-03-18T00:22:31.363 DEBUG:teuthology.task.install:project ceph 2024-03-18T00:22:31.363 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-18T00:22:31.363 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-18T00:22:31.363 INFO:teuthology.task.install:Using flavor: default 2024-03-18T00:22:31.368 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-18T00:22:31.369 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-18T00:22:31.369 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T00:22:31.369 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T00:22:31.371 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T00:22:31.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T00:22:31.509 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-18T00:22:31.509 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-18T00:22:31.582 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-18T00:22:31.582 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-18T00:22:31.632 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T00:22:31.632 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:22:31.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T00:22:31.659 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-18T00:22:31.660 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T00:22:31.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T00:22:31.760 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T00:22:31.760 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:22:31.760 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T00:22:31.789 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-18T00:22:31.789 DEBUG:teuthology.orchestra.run.smithi136:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T00:22:31.808 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T00:22:31.858 DEBUG:teuthology.orchestra.run.smithi136:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T00:22:31.875 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-03-18T00:22:31.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-03-18T00:22:31.938 DEBUG:teuthology.orchestra.run.smithi136:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T00:22:32.004 INFO:teuthology.orchestra.run.smithi136.stdout:check_obsoletes = 1 2024-03-18T00:22:32.006 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum clean all 2024-03-18T00:22:32.129 INFO:teuthology.orchestra.run.smithi081.stdout:74 files removed 2024-03-18T00:22:32.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-18T00:22:32.250 INFO:teuthology.orchestra.run.smithi136.stdout:74 files removed 2024-03-18T00:22:32.277 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-18T00:22:33.001 INFO:teuthology.orchestra.run.smithi136.stdout:ceph packages for x86_64 205 kB/s | 83 kB 00:00 2024-03-18T00:22:33.022 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 151 kB/s | 83 kB 00:00 2024-03-18T00:22:33.427 INFO:teuthology.orchestra.run.smithi136.stdout:ceph noarch packages 27 kB/s | 10 kB 00:00 2024-03-18T00:22:33.456 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 26 kB/s | 10 kB 00:00 2024-03-18T00:22:33.790 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 6.4 kB/s | 1.9 kB 00:00 2024-03-18T00:22:33.869 INFO:teuthology.orchestra.run.smithi136.stdout:ceph source packages 4.7 kB/s | 1.9 kB 00:00 2024-03-18T00:22:34.226 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - AppStream 17 MB/s | 6.7 MB 00:00 2024-03-18T00:22:34.415 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-18T00:22:35.610 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-03-18T00:22:35.805 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.0 MB 00:00 2024-03-18T00:22:36.617 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.0 MB 00:00 2024-03-18T00:22:36.671 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-03-18T00:22:38.452 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-03-18T00:22:42.311 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.1 MB 00:00 2024-03-18T00:22:43.712 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 59 kB/s | 16 kB 00:00 2024-03-18T00:22:45.025 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-18T00:22:49.931 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-03-18T00:22:51.011 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-03-18T00:22:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T00:22:52.484 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T00:22:52.497 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-18T00:22:52.497 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-18T00:22:52.498 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-18T00:22:52.499 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-18T00:22:52.501 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T00:22:52.504 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-18T00:22:52.505 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-18T00:22:52.585 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-03-18T00:22:52.614 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2024-03-18T00:22:52.614 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-03-18T00:22:52.614 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2024-03-18T00:22:52.615 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-18T00:22:52.616 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-18T00:22:52.617 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-18T00:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-18T00:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-18T00:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-18T00:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-18T00:22:52.618 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-18T00:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-18T00:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-18T00:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-18T00:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-18T00:22:52.619 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-18T00:22:52.620 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-18T00:22:52.620 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-18T00:22:52.620 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-18T00:22:52.620 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-18T00:22:52.620 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-18T00:22:52.621 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T00:22:52.622 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-18T00:22:52.623 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-18T00:22:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-18T00:22:52.625 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-18T00:22:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-18T00:22:52.627 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-18T00:22:52.628 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-18T00:22:52.629 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-18T00:22:52.630 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-18T00:22:52.631 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-18T00:22:52.632 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================================ 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:Install 150 Packages 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 24 Packages 2024-03-18T00:22:52.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:22:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 224 M 2024-03-18T00:22:52.634 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-03-18T00:22:53.348 INFO:teuthology.orchestra.run.smithi081.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 28 kB/s | 6.6 kB 00:00 2024-03-18T00:22:53.657 INFO:teuthology.orchestra.run.smithi081.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 2.8 MB/s | 890 kB 00:00 2024-03-18T00:22:53.757 INFO:teuthology.orchestra.run.smithi081.stdout:(3/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 8.4 MB/s | 5.4 MB 00:00 2024-03-18T00:22:53.783 INFO:teuthology.orchestra.run.smithi081.stdout:(4/174): ceph-immutable-object-cache-19.0.0-216 1.1 MB/s | 145 kB 00:00 2024-03-18T00:22:53.974 INFO:teuthology.orchestra.run.smithi081.stdout:(5/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 11 MB/s | 2.4 MB 00:00 2024-03-18T00:22:54.100 INFO:teuthology.orchestra.run.smithi081.stdout:(6/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-03-18T00:22:54.350 INFO:teuthology.orchestra.run.smithi081.stdout:(7/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 13 MB/s | 4.7 MB 00:00 2024-03-18T00:22:55.180 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 9.5 MB/s | 6.1 MB 00:00 2024-03-18T00:22:55.217 INFO:teuthology.orchestra.run.smithi081.stdout:(8/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el9 11 MB/s | 9.8 MB 00:00 2024-03-18T00:22:55.284 INFO:teuthology.orchestra.run.smithi081.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 378 kB/s | 25 kB 00:00 2024-03-18T00:22:55.609 INFO:teuthology.orchestra.run.smithi081.stdout:(10/174): ceph-common-19.0.0-2162.g3d78f5ba.el9 8.3 MB/s | 21 MB 00:02 2024-03-18T00:22:55.677 INFO:teuthology.orchestra.run.smithi081.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 3.3 MB/s | 221 kB 00:00 2024-03-18T00:22:55.752 INFO:teuthology.orchestra.run.smithi081.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 362 kB/s | 27 kB 00:00 2024-03-18T00:22:55.835 INFO:teuthology.orchestra.run.smithi081.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 380 kB/s | 32 kB 00:00 2024-03-18T00:22:55.986 INFO:teuthology.orchestra.run.smithi081.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 4.9 MB/s | 747 kB 00:00 2024-03-18T00:22:56.077 INFO:teuthology.orchestra.run.smithi081.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.7 MB/s | 163 kB 00:00 2024-03-18T00:22:56.161 INFO:teuthology.orchestra.run.smithi081.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.5 MB/s | 127 kB 00:00 2024-03-18T00:22:56.261 INFO:teuthology.orchestra.run.smithi081.stdout:(17/174): libradosstriper1-19.0.0-2162.g3d78f5b 4.9 MB/s | 501 kB 00:00 2024-03-18T00:22:56.720 INFO:teuthology.orchestra.run.smithi081.stdout:(18/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x8 6.4 MB/s | 17 MB 00:02 2024-03-18T00:22:56.728 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 16 kB 00:00 2024-03-18T00:22:56.854 INFO:teuthology.orchestra.run.smithi081.stdout:(19/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 8.7 MB/s | 5.1 MB 00:00 2024-03-18T00:22:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:(20/174): python3-ceph-argparse-19.0.0-2162.g3d 285 kB/s | 45 kB 00:00 2024-03-18T00:22:56.929 INFO:teuthology.orchestra.run.smithi081.stdout:(21/174): python3-ceph-common-19.0.0-2162.g3d78 1.7 MB/s | 131 kB 00:00 2024-03-18T00:22:56.963 INFO:teuthology.orchestra.run.smithi081.stdout:(22/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 1.9 MB/s | 162 kB 00:00 2024-03-18T00:22:57.013 INFO:teuthology.orchestra.run.smithi081.stdout:(23/174): python3-rados-19.0.0-2162.g3d78f5ba.e 3.7 MB/s | 320 kB 00:00 2024-03-18T00:22:57.055 INFO:teuthology.orchestra.run.smithi081.stdout:(24/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 3.2 MB/s | 298 kB 00:00 2024-03-18T00:22:57.097 INFO:teuthology.orchestra.run.smithi081.stdout:(25/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.2 MB/s | 99 kB 00:00 2024-03-18T00:22:57.130 INFO:teuthology.orchestra.run.smithi081.stdout:(26/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-18T00:22:57.247 INFO:teuthology.orchestra.run.smithi081.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 1.4 MB/s | 170 kB 00:00 2024-03-18T00:22:57.356 INFO:teuthology.orchestra.run.smithi081.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2162.g 313 kB/s | 34 kB 00:00 2024-03-18T00:22:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:(29/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 9.2 MB/s | 3.1 MB 00:00 2024-03-18T00:22:57.456 INFO:teuthology.orchestra.run.smithi081.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 1.4 MB/s | 139 kB 00:00 2024-03-18T00:22:57.624 INFO:teuthology.orchestra.run.smithi081.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 9.4 MB/s | 1.8 MB 00:00 2024-03-18T00:22:57.707 INFO:teuthology.orchestra.run.smithi081.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 2.9 MB/s | 248 kB 00:00 2024-03-18T00:22:57.783 INFO:teuthology.orchestra.run.smithi081.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 657 kB/s | 49 kB 00:00 2024-03-18T00:22:57.858 INFO:teuthology.orchestra.run.smithi081.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 220 kB/s | 16 kB 00:00 2024-03-18T00:22:58.325 INFO:teuthology.orchestra.run.smithi081.stdout:(35/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 16 MB/s | 48 MB 00:03 2024-03-18T00:22:58.350 INFO:teuthology.orchestra.run.smithi081.stdout:(36/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 536 kB/s | 264 kB 00:00 2024-03-18T00:22:58.401 INFO:teuthology.orchestra.run.smithi081.stdout:(37/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 9.7 MB/s | 748 kB 00:00 2024-03-18T00:22:58.417 INFO:teuthology.orchestra.run.smithi081.stdout:(38/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 273 kB/s | 18 kB 00:00 2024-03-18T00:22:58.446 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-03-18T00:22:58.576 INFO:teuthology.orchestra.run.smithi081.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2024-03-18T00:22:58.618 INFO:teuthology.orchestra.run.smithi081.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 4.5 MB/s | 920 kB 00:00 2024-03-18T00:22:58.643 INFO:teuthology.orchestra.run.smithi081.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-18T00:22:58.668 INFO:teuthology.orchestra.run.smithi081.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-18T00:22:58.694 INFO:teuthology.orchestra.run.smithi081.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 634 kB/s | 32 kB 00:00 2024-03-18T00:22:58.778 INFO:teuthology.orchestra.run.smithi081.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-03-18T00:22:58.803 INFO:teuthology.orchestra.run.smithi081.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 160 kB/s | 17 kB 00:00 2024-03-18T00:22:58.828 INFO:teuthology.orchestra.run.smithi081.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 201 kB/s | 10 kB 00:00 2024-03-18T00:22:58.853 INFO:teuthology.orchestra.run.smithi081.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 159 kB 00:00 2024-03-18T00:22:58.879 INFO:teuthology.orchestra.run.smithi081.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 885 kB/s | 44 kB 00:00 2024-03-18T00:22:58.904 INFO:teuthology.orchestra.run.smithi081.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-18T00:22:58.929 INFO:teuthology.orchestra.run.smithi081.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2024-03-18T00:22:58.955 INFO:teuthology.orchestra.run.smithi081.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 937 kB/s | 46 kB 00:00 2024-03-18T00:22:58.980 INFO:teuthology.orchestra.run.smithi081.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.5 MB/s | 282 kB 00:00 2024-03-18T00:22:59.005 INFO:teuthology.orchestra.run.smithi081.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2024-03-18T00:22:59.030 INFO:teuthology.orchestra.run.smithi081.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2024-03-18T00:22:59.056 INFO:teuthology.orchestra.run.smithi081.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 687 kB/s | 34 kB 00:00 2024-03-18T00:22:59.148 INFO:teuthology.orchestra.run.smithi081.stdout:(56/174): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2024-03-18T00:22:59.224 INFO:teuthology.orchestra.run.smithi081.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 25 MB/s | 4.7 MB 00:00 2024-03-18T00:22:59.265 INFO:teuthology.orchestra.run.smithi081.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 7.4 MB/s | 1.5 MB 00:00 2024-03-18T00:22:59.290 INFO:teuthology.orchestra.run.smithi081.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 5.7 MB/s | 811 kB 00:00 2024-03-18T00:22:59.315 INFO:teuthology.orchestra.run.smithi081.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2024-03-18T00:22:59.374 INFO:teuthology.orchestra.run.smithi081.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-03-18T00:22:59.474 INFO:teuthology.orchestra.run.smithi081.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 31 MB/s | 5.7 MB 00:00 2024-03-18T00:22:59.499 INFO:teuthology.orchestra.run.smithi081.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 425 kB/s | 78 kB 00:00 2024-03-18T00:22:59.583 INFO:teuthology.orchestra.run.smithi081.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 28 MB/s | 5.8 MB 00:00 2024-03-18T00:22:59.609 INFO:teuthology.orchestra.run.smithi081.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 185 kB/s | 24 kB 00:00 2024-03-18T00:22:59.634 INFO:teuthology.orchestra.run.smithi081.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 137 kB/s | 18 kB 00:00 2024-03-18T00:22:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-18T00:22:59.684 INFO:teuthology.orchestra.run.smithi081.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 635 kB/s | 32 kB 00:00 2024-03-18T00:22:59.760 INFO:teuthology.orchestra.run.smithi081.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 38 MB/s | 4.8 MB 00:00 2024-03-18T00:22:59.785 INFO:teuthology.orchestra.run.smithi081.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.7 MB/s | 217 kB 00:00 2024-03-18T00:22:59.810 INFO:teuthology.orchestra.run.smithi081.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 174 kB 00:00 2024-03-18T00:22:59.835 INFO:teuthology.orchestra.run.smithi081.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 920 kB/s | 69 kB 00:00 2024-03-18T00:22:59.861 INFO:teuthology.orchestra.run.smithi081.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 822 kB/s | 41 kB 00:00 2024-03-18T00:22:59.886 INFO:teuthology.orchestra.run.smithi081.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-18T00:22:59.914 INFO:teuthology.orchestra.run.smithi081.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2024-03-18T00:22:59.936 INFO:teuthology.orchestra.run.smithi081.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 951 kB/s | 47 kB 00:00 2024-03-18T00:22:59.962 INFO:teuthology.orchestra.run.smithi081.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-18T00:22:59.987 INFO:teuthology.orchestra.run.smithi081.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 567 kB/s | 43 kB 00:00 2024-03-18T00:23:00.112 INFO:teuthology.orchestra.run.smithi081.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 316 kB/s | 39 kB 00:00 2024-03-18T00:23:00.137 INFO:teuthology.orchestra.run.smithi081.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 278 kB/s | 41 kB 00:00 2024-03-18T00:23:00.304 INFO:teuthology.orchestra.run.smithi081.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2024-03-18T00:23:00.329 INFO:teuthology.orchestra.run.smithi081.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2024-03-18T00:23:00.355 INFO:teuthology.orchestra.run.smithi081.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 262 kB/s | 56 kB 00:00 2024-03-18T00:23:00.381 INFO:teuthology.orchestra.run.smithi081.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 63 kB 00:00 2024-03-18T00:23:00.397 INFO:teuthology.orchestra.run.smithi081.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 660 kB/s | 44 kB 00:00 2024-03-18T00:23:00.422 INFO:teuthology.orchestra.run.smithi081.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-03-18T00:23:00.448 INFO:teuthology.orchestra.run.smithi081.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-18T00:23:00.481 INFO:teuthology.orchestra.run.smithi081.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-18T00:23:00.498 INFO:teuthology.orchestra.run.smithi081.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2024-03-18T00:23:00.523 INFO:teuthology.orchestra.run.smithi081.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 2.9 MB/s | 124 kB 00:00 2024-03-18T00:23:00.548 INFO:teuthology.orchestra.run.smithi081.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-18T00:23:00.699 INFO:teuthology.orchestra.run.smithi081.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 936 kB/s | 187 kB 00:00 2024-03-18T00:23:00.724 INFO:teuthology.orchestra.run.smithi081.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-18T00:23:00.782 INFO:teuthology.orchestra.run.smithi081.stdout:(94/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-03-18T00:23:00.841 INFO:teuthology.orchestra.run.smithi081.stdout:(95/174): python3-requests-2.25.1-8.el9.noarch. 879 kB/s | 125 kB 00:00 2024-03-18T00:23:00.866 INFO:teuthology.orchestra.run.smithi081.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 181 kB/s | 21 kB 00:00 2024-03-18T00:23:00.891 INFO:teuthology.orchestra.run.smithi081.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 236 kB/s | 25 kB 00:00 2024-03-18T00:23:00.992 INFO:teuthology.orchestra.run.smithi081.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-03-18T00:23:01.017 INFO:teuthology.orchestra.run.smithi081.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-03-18T00:23:01.042 INFO:teuthology.orchestra.run.smithi081.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 4.2 MB/s | 216 kB 00:00 2024-03-18T00:23:01.068 INFO:teuthology.orchestra.run.smithi081.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 692 kB/s | 35 kB 00:00 2024-03-18T00:23:01.093 INFO:teuthology.orchestra.run.smithi081.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-18T00:23:01.118 INFO:teuthology.orchestra.run.smithi081.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-18T00:23:01.202 INFO:teuthology.orchestra.run.smithi081.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 12 MB/s | 4.1 MB 00:00 2024-03-18T00:23:01.269 INFO:teuthology.orchestra.run.smithi081.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 127 kB/s | 22 kB 00:00 2024-03-18T00:23:01.402 INFO:teuthology.orchestra.run.smithi081.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.0 MB/s | 863 kB 00:00 2024-03-18T00:23:01.653 INFO:teuthology.orchestra.run.smithi081.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-03-18T00:23:01.703 INFO:teuthology.orchestra.run.smithi081.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-03-18T00:23:01.728 INFO:teuthology.orchestra.run.smithi081.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 709 kB/s | 309 kB 00:00 2024-03-18T00:23:01.778 INFO:teuthology.orchestra.run.smithi081.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-03-18T00:23:01.804 INFO:teuthology.orchestra.run.smithi081.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 645 kB/s | 49 kB 00:00 2024-03-18T00:23:01.854 INFO:teuthology.orchestra.run.smithi081.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 893 kB/s | 67 kB 00:00 2024-03-18T00:23:01.896 INFO:teuthology.orchestra.run.smithi081.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-18T00:23:02.004 INFO:teuthology.orchestra.run.smithi081.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 5.5 MB/s | 838 kB 00:00 2024-03-18T00:23:02.030 INFO:teuthology.orchestra.run.smithi081.stdout:(115/174): python3-asyncssh-2.13.2-4.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-03-18T00:23:02.080 INFO:teuthology.orchestra.run.smithi081.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 578 kB/s | 43 kB 00:00 2024-03-18T00:23:02.105 INFO:teuthology.orchestra.run.smithi081.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 427 kB/s | 32 kB 00:00 2024-03-18T00:23:02.181 INFO:teuthology.orchestra.run.smithi081.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 8.4 MB/s | 4.4 MB 00:00 2024-03-18T00:23:02.206 INFO:teuthology.orchestra.run.smithi081.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 119 kB/s | 15 kB 00:00 2024-03-18T00:23:02.232 INFO:teuthology.orchestra.run.smithi081.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-03-18T00:23:02.265 INFO:teuthology.orchestra.run.smithi081.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-03-18T00:23:02.290 INFO:teuthology.orchestra.run.smithi081.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-03-18T00:23:02.315 INFO:teuthology.orchestra.run.smithi081.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-03-18T00:23:02.366 INFO:teuthology.orchestra.run.smithi081.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.0 MB/s | 203 kB 00:00 2024-03-18T00:23:02.383 INFO:teuthology.orchestra.run.smithi081.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-03-18T00:23:02.433 INFO:teuthology.orchestra.run.smithi081.stdout:(126/174): python3-grpcio-1.46.7-10.el9.x86_64. 14 MB/s | 2.0 MB 00:00 2024-03-18T00:23:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:(127/174): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-03-18T00:23:02.484 INFO:teuthology.orchestra.run.smithi081.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-03-18T00:23:02.500 INFO:teuthology.orchestra.run.smithi081.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 343 kB/s | 23 kB 00:00 2024-03-18T00:23:02.526 INFO:teuthology.orchestra.run.smithi081.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 288 kB/s | 19 kB 00:00 2024-03-18T00:23:02.551 INFO:teuthology.orchestra.run.smithi081.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 293 kB/s | 20 kB 00:00 2024-03-18T00:23:02.602 INFO:teuthology.orchestra.run.smithi081.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-03-18T00:23:02.627 INFO:teuthology.orchestra.run.smithi081.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 460 kB/s | 46 kB 00:00 2024-03-18T00:23:02.652 INFO:teuthology.orchestra.run.smithi081.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 784 kB/s | 79 kB 00:00 2024-03-18T00:23:02.677 INFO:teuthology.orchestra.run.smithi081.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 766 kB/s | 58 kB 00:00 2024-03-18T00:23:02.711 INFO:teuthology.orchestra.run.smithi081.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-03-18T00:23:02.736 INFO:teuthology.orchestra.run.smithi081.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 195 kB/s | 16 kB 00:00 2024-03-18T00:23:02.762 INFO:teuthology.orchestra.run.smithi081.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-03-18T00:23:02.790 INFO:teuthology.orchestra.run.smithi081.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 357 kB/s | 28 kB 00:00 2024-03-18T00:23:02.812 INFO:teuthology.orchestra.run.smithi081.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-03-18T00:23:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-18T00:23:02.863 INFO:teuthology.orchestra.run.smithi081.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 818 kB/s | 59 kB 00:00 2024-03-18T00:23:02.888 INFO:teuthology.orchestra.run.smithi081.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 472 kB/s | 36 kB 00:00 2024-03-18T00:23:02.913 INFO:teuthology.orchestra.run.smithi081.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-03-18T00:23:02.947 INFO:teuthology.orchestra.run.smithi081.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-18T00:23:02.973 INFO:teuthology.orchestra.run.smithi081.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-03-18T00:23:02.997 INFO:teuthology.orchestra.run.smithi081.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-18T00:23:03.022 INFO:teuthology.orchestra.run.smithi081.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-03-18T00:23:03.048 INFO:teuthology.orchestra.run.smithi081.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2024-03-18T00:23:03.123 INFO:teuthology.orchestra.run.smithi081.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-03-18T00:23:03.165 INFO:teuthology.orchestra.run.smithi081.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2024-03-18T00:23:03.338 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-03-18T00:23:03.365 INFO:teuthology.orchestra.run.smithi081.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 11 MB/s | 2.3 MB 00:00 2024-03-18T00:23:03.499 INFO:teuthology.orchestra.run.smithi081.stdout:(153/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 7.0 MB/s | 3.1 MB 00:00 2024-03-18T00:23:03.582 INFO:teuthology.orchestra.run.smithi081.stdout:(154/174): NetworkManager-libnm-1.46.0-1.el9.x8 8.4 MB/s | 1.8 MB 00:00 2024-03-18T00:23:03.633 INFO:teuthology.orchestra.run.smithi081.stdout:(155/174): NetworkManager-team-1.46.0-1.el9.x86 318 kB/s | 42 kB 00:00 2024-03-18T00:23:03.716 INFO:teuthology.orchestra.run.smithi081.stdout:(156/174): NetworkManager-tui-1.46.0-1.el9.x86_ 1.8 MB/s | 248 kB 00:00 2024-03-18T00:23:03.733 INFO:teuthology.orchestra.run.smithi081.stdout:(157/174): acl-2.3.1-4.el9.x86_64.rpm 720 kB/s | 71 kB 00:00 2024-03-18T00:23:03.817 INFO:teuthology.orchestra.run.smithi081.stdout:(158/174): librados2-19.0.0-2162.g3d78f5ba.el9. 4.3 MB/s | 3.4 MB 00:00 2024-03-18T00:23:03.859 INFO:teuthology.orchestra.run.smithi081.stdout:(159/174): elfutils-debuginfod-client-0.190-2.e 256 kB/s | 36 kB 00:00 2024-03-18T00:23:03.943 INFO:teuthology.orchestra.run.smithi081.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.0 MB/s | 192 kB 00:00 2024-03-18T00:23:03.994 INFO:teuthology.orchestra.run.smithi081.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 210 kB/s | 23 kB 00:00 2024-03-18T00:23:04.018 INFO:teuthology.orchestra.run.smithi081.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 1.4 MB/s | 256 kB 00:00 2024-03-18T00:23:04.102 INFO:teuthology.orchestra.run.smithi081.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 687 kB/s | 108 kB 00:00 2024-03-18T00:23:04.161 INFO:teuthology.orchestra.run.smithi081.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 932 kB/s | 155 kB 00:00 2024-03-18T00:23:04.186 INFO:teuthology.orchestra.run.smithi081.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 945 kB/s | 136 kB 00:00 2024-03-18T00:23:04.228 INFO:teuthology.orchestra.run.smithi081.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 512 kB/s | 64 kB 00:00 2024-03-18T00:23:04.270 INFO:teuthology.orchestra.run.smithi081.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 265 kB/s | 29 kB 00:00 2024-03-18T00:23:04.420 INFO:teuthology.orchestra.run.smithi081.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 5.8 MB/s | 1.2 MB 00:00 2024-03-18T00:23:04.529 INFO:teuthology.orchestra.run.smithi081.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 7.8 MB/s | 2.2 MB 00:00 2024-03-18T00:23:04.571 INFO:teuthology.orchestra.run.smithi081.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 8.3 MB/s | 2.3 MB 00:00 2024-03-18T00:23:04.679 INFO:teuthology.orchestra.run.smithi081.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 1.8 MB/s | 465 kB 00:00 2024-03-18T00:23:04.696 INFO:teuthology.orchestra.run.smithi081.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 186 kB/s | 31 kB 00:00 2024-03-18T00:23:04.738 INFO:teuthology.orchestra.run.smithi081.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 74 kB 00:00 2024-03-18T00:23:04.796 INFO:teuthology.orchestra.run.smithi081.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.3 MB/s | 1.1 MB 00:00 2024-03-18T00:23:04.802 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-03-18T00:23:04.802 INFO:teuthology.orchestra.run.smithi081.stdout:Total 18 MB/s | 224 MB 00:12 2024-03-18T00:23:05.277 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-03-18T00:23:05.589 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-03-18T00:23:05.590 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-03-18T00:23:05.843 INFO:teuthology.orchestra.run.smithi136.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T00:23:05.843 INFO:teuthology.orchestra.run.smithi136.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T00:23:05.858 INFO:teuthology.orchestra.run.smithi136.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-18T00:23:05.859 INFO:teuthology.orchestra.run.smithi136.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-18T00:23:05.860 INFO:teuthology.orchestra.run.smithi136.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-18T00:23:05.861 INFO:teuthology.orchestra.run.smithi136.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-18T00:23:05.863 INFO:teuthology.orchestra.run.smithi136.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T00:23:05.866 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-18T00:23:05.867 INFO:teuthology.orchestra.run.smithi136.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-18T00:23:05.946 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-03-18T00:23:05.961 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-03-18T00:23:05.961 INFO:teuthology.orchestra.run.smithi136.stdout: Package Arch Version Repository Size 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-18T00:23:05.962 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-18T00:23:05.963 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-18T00:23:05.964 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrading: 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-18T00:23:05.965 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-18T00:23:05.966 INFO:teuthology.orchestra.run.smithi136.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-03-18T00:23:05.967 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-18T00:23:05.968 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-18T00:23:05.969 INFO:teuthology.orchestra.run.smithi136.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-18T00:23:05.970 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-18T00:23:05.971 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-18T00:23:05.972 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-18T00:23:05.973 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-18T00:23:05.974 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-18T00:23:05.975 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-18T00:23:05.976 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-18T00:23:05.977 INFO:teuthology.orchestra.run.smithi136.stdout:Installing weak dependencies: 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout:============================================================================================ 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout:Install 150 Packages 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout:Upgrade 24 Packages 2024-03-18T00:23:05.978 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:05.979 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 224 M 2024-03-18T00:23:05.979 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-03-18T00:23:06.539 INFO:teuthology.orchestra.run.smithi136.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-03-18T00:23:07.247 INFO:teuthology.orchestra.run.smithi136.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.2 MB/s | 890 kB 00:00 2024-03-18T00:23:07.389 INFO:teuthology.orchestra.run.smithi136.stdout:(3/174): ceph-immutable-object-cache-19.0.0-216 1.0 MB/s | 145 kB 00:00 2024-03-18T00:23:07.606 INFO:teuthology.orchestra.run.smithi136.stdout:(4/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-03-18T00:23:07.640 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-03-18T00:23:07.640 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-03-18T00:23:07.939 INFO:teuthology.orchestra.run.smithi136.stdout:(5/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 4.5 MB/s | 1.5 MB 00:00 2024-03-18T00:23:08.464 INFO:teuthology.orchestra.run.smithi136.stdout:(6/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-03-18T00:23:08.873 INFO:teuthology.orchestra.run.smithi136.stdout:(7/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 5.0 MB/s | 4.7 MB 00:00 2024-03-18T00:23:10.333 INFO:teuthology.orchestra.run.smithi136.stdout:(8/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el9 6.7 MB/s | 9.8 MB 00:01 2024-03-18T00:23:10.373 INFO:teuthology.orchestra.run.smithi136.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 635 kB/s | 25 kB 00:00 2024-03-18T00:23:10.815 INFO:teuthology.orchestra.run.smithi136.stdout:(10/174): ceph-common-19.0.0-2162.g3d78f5ba.el9 4.6 MB/s | 21 MB 00:04 2024-03-18T00:23:10.923 INFO:teuthology.orchestra.run.smithi136.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 2.0 MB/s | 221 kB 00:00 2024-03-18T00:23:10.982 INFO:teuthology.orchestra.run.smithi136.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 465 kB/s | 27 kB 00:00 2024-03-18T00:23:11.032 INFO:teuthology.orchestra.run.smithi136.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 634 kB/s | 32 kB 00:00 2024-03-18T00:23:11.183 INFO:teuthology.orchestra.run.smithi136.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 4.9 MB/s | 747 kB 00:00 2024-03-18T00:23:11.258 INFO:teuthology.orchestra.run.smithi136.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 2.1 MB/s | 163 kB 00:00 2024-03-18T00:23:11.325 INFO:teuthology.orchestra.run.smithi136.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.9 MB/s | 127 kB 00:00 2024-03-18T00:23:11.558 INFO:teuthology.orchestra.run.smithi136.stdout:(17/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x8 5.4 MB/s | 17 MB 00:03 2024-03-18T00:23:11.583 INFO:teuthology.orchestra.run.smithi136.stdout:(18/174): libradosstriper1-19.0.0-2162.g3d78f5b 1.9 MB/s | 501 kB 00:00 2024-03-18T00:23:11.650 INFO:teuthology.orchestra.run.smithi136.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 678 kB/s | 45 kB 00:00 2024-03-18T00:23:11.726 INFO:teuthology.orchestra.run.smithi136.stdout:(20/174): python3-ceph-common-19.0.0-2162.g3d78 1.7 MB/s | 131 kB 00:00 2024-03-18T00:23:11.826 INFO:teuthology.orchestra.run.smithi136.stdout:(21/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 1.6 MB/s | 162 kB 00:00 2024-03-18T00:23:11.902 INFO:teuthology.orchestra.run.smithi136.stdout:(22/174): python3-rados-19.0.0-2162.g3d78f5ba.e 4.2 MB/s | 320 kB 00:00 2024-03-18T00:23:11.985 INFO:teuthology.orchestra.run.smithi136.stdout:(23/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 3.5 MB/s | 298 kB 00:00 2024-03-18T00:23:12.061 INFO:teuthology.orchestra.run.smithi136.stdout:(24/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.3 MB/s | 99 kB 00:00 2024-03-18T00:23:12.127 INFO:teuthology.orchestra.run.smithi136.stdout:(25/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.3 MB/s | 85 kB 00:00 2024-03-18T00:23:12.345 INFO:teuthology.orchestra.run.smithi136.stdout:(26/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 6.5 MB/s | 5.1 MB 00:00 2024-03-18T00:23:12.411 INFO:teuthology.orchestra.run.smithi136.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-18T00:23:12.470 INFO:teuthology.orchestra.run.smithi136.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2162.g 582 kB/s | 34 kB 00:00 2024-03-18T00:23:12.545 INFO:teuthology.orchestra.run.smithi136.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 1.8 MB/s | 139 kB 00:00 2024-03-18T00:23:12.604 INFO:teuthology.orchestra.run.smithi136.stdout:(30/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 6.5 MB/s | 3.1 MB 00:00 2024-03-18T00:23:12.862 INFO:teuthology.orchestra.run.smithi136.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 5.7 MB/s | 1.8 MB 00:00 2024-03-18T00:23:12.937 INFO:teuthology.orchestra.run.smithi136.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 3.2 MB/s | 248 kB 00:00 2024-03-18T00:23:12.996 INFO:teuthology.orchestra.run.smithi136.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 847 kB/s | 49 kB 00:00 2024-03-18T00:23:13.046 INFO:teuthology.orchestra.run.smithi136.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 329 kB/s | 16 kB 00:00 2024-03-18T00:23:13.130 INFO:teuthology.orchestra.run.smithi136.stdout:(35/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 3.1 MB/s | 264 kB 00:00 2024-03-18T00:23:13.297 INFO:teuthology.orchestra.run.smithi136.stdout:(36/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 4.4 MB/s | 748 kB 00:00 2024-03-18T00:23:13.347 INFO:teuthology.orchestra.run.smithi136.stdout:(37/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 366 kB/s | 18 kB 00:00 2024-03-18T00:23:13.489 INFO:teuthology.orchestra.run.smithi136.stdout:(38/174): automake-1.16.2-8.el9.noarch.rpm 4.6 MB/s | 662 kB 00:00 2024-03-18T00:23:13.572 INFO:teuthology.orchestra.run.smithi136.stdout:(39/174): ceph-mgr-diskprediction-local-19.0.0- 7.7 MB/s | 7.4 MB 00:00 2024-03-18T00:23:13.614 INFO:teuthology.orchestra.run.smithi136.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 7.2 MB/s | 920 kB 00:00 2024-03-18T00:23:13.640 INFO:teuthology.orchestra.run.smithi136.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.6 MB/s | 106 kB 00:00 2024-03-18T00:23:13.665 INFO:teuthology.orchestra.run.smithi136.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 6.0 MB/s | 307 kB 00:00 2024-03-18T00:23:13.682 INFO:teuthology.orchestra.run.smithi136.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 765 kB/s | 32 kB 00:00 2024-03-18T00:23:13.757 INFO:teuthology.orchestra.run.smithi136.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 32 MB/s | 3.0 MB 00:00 2024-03-18T00:23:13.774 INFO:teuthology.orchestra.run.smithi136.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 188 kB/s | 17 kB 00:00 2024-03-18T00:23:13.791 INFO:teuthology.orchestra.run.smithi136.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 301 kB/s | 10 kB 00:00 2024-03-18T00:23:13.816 INFO:teuthology.orchestra.run.smithi136.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2024-03-18T00:23:13.833 INFO:teuthology.orchestra.run.smithi136.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2024-03-18T00:23:13.867 INFO:teuthology.orchestra.run.smithi136.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2024-03-18T00:23:13.892 INFO:teuthology.orchestra.run.smithi136.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 578 kB 00:00 2024-03-18T00:23:13.909 INFO:teuthology.orchestra.run.smithi136.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.1 MB/s | 46 kB 00:00 2024-03-18T00:23:13.952 INFO:teuthology.orchestra.run.smithi136.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.7 MB/s | 282 kB 00:00 2024-03-18T00:23:13.976 INFO:teuthology.orchestra.run.smithi136.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.7 MB/s | 187 kB 00:00 2024-03-18T00:23:14.002 INFO:teuthology.orchestra.run.smithi136.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.3 MB/s | 217 kB 00:00 2024-03-18T00:23:14.027 INFO:teuthology.orchestra.run.smithi136.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 684 kB/s | 34 kB 00:00 2024-03-18T00:23:14.127 INFO:teuthology.orchestra.run.smithi136.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-03-18T00:23:14.169 INFO:teuthology.orchestra.run.smithi136.stdout:(57/174): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-03-18T00:23:14.203 INFO:teuthology.orchestra.run.smithi136.stdout:(58/174): postgresql-contrib-13.11-1.el9.x86_64 11 MB/s | 811 kB 00:00 2024-03-18T00:23:14.228 INFO:teuthology.orchestra.run.smithi136.stdout:(59/174): postgresql-private-libs-13.11-1.el9.x 2.3 MB/s | 134 kB 00:00 2024-03-18T00:23:14.362 INFO:teuthology.orchestra.run.smithi136.stdout:(60/174): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2024-03-18T00:23:14.395 INFO:teuthology.orchestra.run.smithi136.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 6.1 MB/s | 1.0 MB 00:00 2024-03-18T00:23:14.422 INFO:teuthology.orchestra.run.smithi136.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 78 kB 00:00 2024-03-18T00:23:14.546 INFO:teuthology.orchestra.run.smithi136.stdout:(63/174): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 5.8 MB 00:00 2024-03-18T00:23:14.571 INFO:teuthology.orchestra.run.smithi136.stdout:(64/174): python3-jsonpatch-1.21-16.el9.noarch. 165 kB/s | 24 kB 00:00 2024-03-18T00:23:14.596 INFO:teuthology.orchestra.run.smithi136.stdout:(65/174): python3-jsonpointer-2.0-4.el9.noarch. 363 kB/s | 18 kB 00:00 2024-03-18T00:23:14.622 INFO:teuthology.orchestra.run.smithi136.stdout:(66/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.8 MB/s | 144 kB 00:00 2024-03-18T00:23:14.639 INFO:teuthology.orchestra.run.smithi136.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 755 kB/s | 32 kB 00:00 2024-03-18T00:23:14.756 INFO:teuthology.orchestra.run.smithi136.stdout:(68/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-18T00:23:14.781 INFO:teuthology.orchestra.run.smithi136.stdout:(69/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2024-03-18T00:23:14.793 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-03-18T00:23:14.797 INFO:teuthology.orchestra.run.smithi136.stdout:(70/174): python3-oauthlib-3.1.1-5.el9.noarch.r 4.1 MB/s | 174 kB 00:00 2024-03-18T00:23:14.823 INFO:teuthology.orchestra.run.smithi136.stdout:(71/174): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 69 kB 00:00 2024-03-18T00:23:14.840 INFO:teuthology.orchestra.run.smithi136.stdout:(72/174): python3-prettytable-0.7.2-27.el9.noar 986 kB/s | 41 kB 00:00 2024-03-18T00:23:14.865 INFO:teuthology.orchestra.run.smithi136.stdout:(73/174): python3-protobuf-3.14.0-13.el9.noarch 5.6 MB/s | 238 kB 00:00 2024-03-18T00:23:14.882 INFO:teuthology.orchestra.run.smithi136.stdout:(74/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 132 kB 00:00 2024-03-18T00:23:14.902 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-18T00:23:14.907 INFO:teuthology.orchestra.run.smithi136.stdout:(75/174): python3-pyasn1-modules-0.4.8-6.el9.no 5.0 MB/s | 211 kB 00:00 2024-03-18T00:23:14.933 INFO:teuthology.orchestra.run.smithi136.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 944 kB/s | 47 kB 00:00 2024-03-18T00:23:14.936 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-18T00:23:14.958 INFO:teuthology.orchestra.run.smithi136.stdout:(77/174): python3-requests-oauthlib-1.3.0-12.el 852 kB/s | 43 kB 00:00 2024-03-18T00:23:14.965 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T00:23:14.975 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T00:23:15.024 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-18T00:23:15.087 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-18T00:23:15.120 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-18T00:23:15.146 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-18T00:23:15.199 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-18T00:23:15.392 INFO:teuthology.orchestra.run.smithi136.stdout:(78/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 9.5 MB/s | 48 MB 00:05 2024-03-18T00:23:15.450 INFO:teuthology.orchestra.run.smithi136.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 79 kB/s | 39 kB 00:00 2024-03-18T00:23:15.528 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-18T00:23:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:23:15.684 INFO:teuthology.orchestra.run.smithi136.stdout:(80/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-03-18T00:23:15.701 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:23:15.709 INFO:teuthology.orchestra.run.smithi136.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 130 kB/s | 41 kB 00:00 2024-03-18T00:23:15.731 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:23:15.734 INFO:teuthology.orchestra.run.smithi136.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-03-18T00:23:15.768 INFO:teuthology.orchestra.run.smithi136.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 679 kB/s | 56 kB 00:00 2024-03-18T00:23:15.793 INFO:teuthology.orchestra.run.smithi136.stdout:(84/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 750 kB/s | 44 kB 00:00 2024-03-18T00:23:15.818 INFO:teuthology.orchestra.run.smithi136.stdout:(85/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 745 kB/s | 63 kB 00:00 2024-03-18T00:23:15.823 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:23:15.843 INFO:teuthology.orchestra.run.smithi136.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-03-18T00:23:15.857 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T00:23:15.869 INFO:teuthology.orchestra.run.smithi136.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-18T00:23:15.894 INFO:teuthology.orchestra.run.smithi136.stdout:(88/174): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2024-03-18T00:23:15.912 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-18T00:23:15.936 INFO:teuthology.orchestra.run.smithi136.stdout:(89/174): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2024-03-18T00:23:15.961 INFO:teuthology.orchestra.run.smithi136.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 124 kB 00:00 2024-03-18T00:23:15.986 INFO:teuthology.orchestra.run.smithi136.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.0 MB/s | 187 kB 00:00 2024-03-18T00:23:16.053 INFO:teuthology.orchestra.run.smithi136.stdout:(92/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.9 MB/s | 195 kB 00:00 2024-03-18T00:23:16.079 INFO:teuthology.orchestra.run.smithi136.stdout:(93/174): jq-1.6-16.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-03-18T00:23:16.097 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-18T00:23:16.120 INFO:teuthology.orchestra.run.smithi136.stdout:(94/174): libgfortran-11.4.1-3.el9.x86_64.rpm 4.9 MB/s | 803 kB 00:00 2024-03-18T00:23:16.150 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-18T00:23:16.162 INFO:teuthology.orchestra.run.smithi136.stdout:(95/174): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-03-18T00:23:16.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:23:16.179 INFO:teuthology.orchestra.run.smithi136.stdout:(96/174): elfutils-libelf-devel-0.190-2.el9.x86 214 kB/s | 21 kB 00:00 2024-03-18T00:23:16.213 INFO:teuthology.orchestra.run.smithi136.stdout:(97/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 276 kB/s | 25 kB 00:00 2024-03-18T00:23:16.273 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:23:16.280 INFO:teuthology.orchestra.run.smithi136.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-18T00:23:16.296 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T00:23:16.330 INFO:teuthology.orchestra.run.smithi136.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.1 MB/s | 248 kB 00:00 2024-03-18T00:23:16.355 INFO:teuthology.orchestra.run.smithi136.stdout:(100/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.8 MB/s | 216 kB 00:00 2024-03-18T00:23:16.361 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T00:23:16.372 INFO:teuthology.orchestra.run.smithi136.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 835 kB/s | 35 kB 00:00 2024-03-18T00:23:16.389 INFO:teuthology.orchestra.run.smithi136.stdout:(102/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2024-03-18T00:23:16.391 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-18T00:23:16.415 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T00:23:16.422 INFO:teuthology.orchestra.run.smithi136.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.8 MB/s | 94 kB 00:00 2024-03-18T00:23:16.430 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T00:23:16.565 INFO:teuthology.orchestra.run.smithi136.stdout:(104/174): openssl-devel-3.0.7-27.el9.x86_64.rp 10 MB/s | 4.1 MB 00:00 2024-03-18T00:23:16.590 INFO:teuthology.orchestra.run.smithi136.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-03-18T00:23:16.632 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T00:23:16.663 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T00:23:16.697 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-18T00:23:16.782 INFO:teuthology.orchestra.run.smithi136.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.4 MB/s | 863 kB 00:00 2024-03-18T00:23:16.807 INFO:teuthology.orchestra.run.smithi136.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-03-18T00:23:16.832 INFO:teuthology.orchestra.run.smithi136.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.0 MB/s | 548 kB 00:00 2024-03-18T00:23:16.852 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-18T00:23:16.891 INFO:teuthology.orchestra.run.smithi136.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 446 kB/s | 26 kB 00:00 2024-03-18T00:23:16.916 INFO:teuthology.orchestra.run.smithi136.stdout:(110/174): grpc-data-1.46.7-10.el9.noarch.rpm 145 kB/s | 19 kB 00:00 2024-03-18T00:23:16.949 INFO:teuthology.orchestra.run.smithi136.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 830 kB/s | 49 kB 00:00 2024-03-18T00:23:16.992 INFO:teuthology.orchestra.run.smithi136.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 895 kB/s | 67 kB 00:00 2024-03-18T00:23:16.999 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T00:23:17.017 INFO:teuthology.orchestra.run.smithi136.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-03-18T00:23:17.059 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T00:23:17.117 INFO:teuthology.orchestra.run.smithi136.stdout:(114/174): python3-asyncssh-2.13.2-4.el9.noarch 5.4 MB/s | 548 kB 00:00 2024-03-18T00:23:17.176 INFO:teuthology.orchestra.run.smithi136.stdout:(115/174): libarrow-9.0.0-10.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-03-18T00:23:17.184 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:17.209 INFO:teuthology.orchestra.run.smithi136.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 471 kB/s | 43 kB 00:00 2024-03-18T00:23:17.235 INFO:teuthology.orchestra.run.smithi136.stdout:(117/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-03-18T00:23:17.260 INFO:teuthology.orchestra.run.smithi136.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 383 kB/s | 32 kB 00:00 2024-03-18T00:23:17.269 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:17.285 INFO:teuthology.orchestra.run.smithi136.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-03-18T00:23:17.310 INFO:teuthology.orchestra.run.smithi136.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-03-18T00:23:17.336 INFO:teuthology.orchestra.run.smithi136.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-03-18T00:23:17.369 INFO:teuthology.orchestra.run.smithi136.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-03-18T00:23:17.394 INFO:teuthology.orchestra.run.smithi136.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-03-18T00:23:17.420 INFO:teuthology.orchestra.run.smithi136.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-18T00:23:17.453 INFO:teuthology.orchestra.run.smithi136.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.4 MB/s | 144 kB 00:00 2024-03-18T00:23:17.478 INFO:teuthology.orchestra.run.smithi136.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-03-18T00:23:17.499 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:17.512 INFO:teuthology.orchestra.run.smithi136.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 302 kB/s | 18 kB 00:00 2024-03-18T00:23:17.571 INFO:teuthology.orchestra.run.smithi136.stdout:(128/174): python3-grpcio-1.46.7-10.el9.x86_64. 10 MB/s | 2.0 MB 00:00 2024-03-18T00:23:17.596 INFO:teuthology.orchestra.run.smithi136.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 197 kB/s | 23 kB 00:00 2024-03-18T00:23:17.621 INFO:teuthology.orchestra.run.smithi136.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2024-03-18T00:23:17.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-18T00:23:17.655 INFO:teuthology.orchestra.run.smithi136.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 338 kB/s | 20 kB 00:00 2024-03-18T00:23:17.680 INFO:teuthology.orchestra.run.smithi136.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 793 kB/s | 46 kB 00:00 2024-03-18T00:23:17.722 INFO:teuthology.orchestra.run.smithi136.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 8.1 MB/s | 1.0 MB 00:00 2024-03-18T00:23:17.726 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-18T00:23:17.747 INFO:teuthology.orchestra.run.smithi136.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 862 kB/s | 58 kB 00:00 2024-03-18T00:23:17.766 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-18T00:23:17.772 INFO:teuthology.orchestra.run.smithi136.stdout:(135/174): python3-more-itertools-8.12.0-2.el9. 671 kB/s | 79 kB 00:00 2024-03-18T00:23:17.795 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-18T00:23:17.798 INFO:teuthology.orchestra.run.smithi136.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-18T00:23:17.823 INFO:teuthology.orchestra.run.smithi136.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-03-18T00:23:17.838 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-18T00:23:17.848 INFO:teuthology.orchestra.run.smithi136.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-18T00:23:17.873 INFO:teuthology.orchestra.run.smithi136.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-03-18T00:23:17.899 INFO:teuthology.orchestra.run.smithi136.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 408 kB/s | 31 kB 00:00 2024-03-18T00:23:17.911 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-18T00:23:17.924 INFO:teuthology.orchestra.run.smithi136.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-18T00:23:17.949 INFO:teuthology.orchestra.run.smithi136.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 783 kB/s | 59 kB 00:00 2024-03-18T00:23:17.966 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-18T00:23:17.974 INFO:teuthology.orchestra.run.smithi136.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-03-18T00:23:18.000 INFO:teuthology.orchestra.run.smithi136.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 676 kB/s | 51 kB 00:00 2024-03-18T00:23:18.004 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-18T00:23:18.025 INFO:teuthology.orchestra.run.smithi136.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-18T00:23:18.050 INFO:teuthology.orchestra.run.smithi136.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-03-18T00:23:18.068 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-18T00:23:18.075 INFO:teuthology.orchestra.run.smithi136.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-03-18T00:23:18.103 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-18T00:23:18.109 INFO:teuthology.orchestra.run.smithi136.stdout:(148/174): python3-werkzeug-2.0.3-3.el9.1.noarc 3.8 MB/s | 427 kB 00:00 2024-03-18T00:23:18.143 INFO:teuthology.orchestra.run.smithi136.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-03-18T00:23:18.147 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-18T00:23:18.189 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-18T00:23:18.216 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-18T00:23:18.218 INFO:teuthology.orchestra.run.smithi136.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-18T00:23:18.268 INFO:teuthology.orchestra.run.smithi136.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-03-18T00:23:18.284 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-18T00:23:18.320 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-18T00:23:18.374 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-18T00:23:18.401 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-18T00:23:18.470 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-18T00:23:18.516 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-18T00:23:18.552 INFO:teuthology.orchestra.run.smithi136.stdout:(152/174): NetworkManager-1.46.0-1.el9.x86_64.r 8.1 MB/s | 2.3 MB 00:00 2024-03-18T00:23:18.588 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-18T00:23:18.694 INFO:teuthology.orchestra.run.smithi136.stdout:(153/174): NetworkManager-libnm-1.46.0-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-03-18T00:23:18.720 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-18T00:23:18.752 INFO:teuthology.orchestra.run.smithi136.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 730 kB/s | 42 kB 00:00 2024-03-18T00:23:18.776 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-18T00:23:18.836 INFO:teuthology.orchestra.run.smithi136.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 2.9 MB/s | 248 kB 00:00 2024-03-18T00:23:18.894 INFO:teuthology.orchestra.run.smithi136.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 71 kB 00:00 2024-03-18T00:23:18.945 INFO:teuthology.orchestra.run.smithi136.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 729 kB/s | 36 kB 00:00 2024-03-18T00:23:19.012 INFO:teuthology.orchestra.run.smithi136.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.8 MB/s | 192 kB 00:00 2024-03-18T00:23:19.095 INFO:teuthology.orchestra.run.smithi136.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 3.0 MB/s | 256 kB 00:00 2024-03-18T00:23:19.146 INFO:teuthology.orchestra.run.smithi136.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-03-18T00:23:19.212 INFO:teuthology.orchestra.run.smithi136.stdout:(161/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-03-18T00:23:19.254 INFO:teuthology.orchestra.run.smithi136.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.0 MB/s | 108 kB 00:00 2024-03-18T00:23:19.287 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-18T00:23:19.313 INFO:teuthology.orchestra.run.smithi136.stdout:(163/174): librados2-19.0.0-2162.g3d78f5ba.el9. 2.8 MB/s | 3.4 MB 00:01 2024-03-18T00:23:19.338 INFO:teuthology.orchestra.run.smithi136.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 155 kB 00:00 2024-03-18T00:23:19.363 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-18T00:23:19.380 INFO:teuthology.orchestra.run.smithi136.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.1 MB/s | 136 kB 00:00 2024-03-18T00:23:19.405 INFO:teuthology.orchestra.run.smithi136.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 695 kB/s | 64 kB 00:00 2024-03-18T00:23:19.430 INFO:teuthology.orchestra.run.smithi136.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 312 kB/s | 29 kB 00:00 2024-03-18T00:23:19.454 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-18T00:23:19.501 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T00:23:19.509 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T00:23:19.539 INFO:teuthology.orchestra.run.smithi136.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 7.6 MB/s | 1.2 MB 00:00 2024-03-18T00:23:19.542 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-18T00:23:19.589 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-18T00:23:19.623 INFO:teuthology.orchestra.run.smithi136.stdout:(169/174): util-linux-2.37.4-18.el9.x86_64.rpm 12 MB/s | 2.3 MB 00:00 2024-03-18T00:23:19.627 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-18T00:23:19.658 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-18T00:23:19.664 INFO:teuthology.orchestra.run.smithi136.stdout:(170/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.2 MB/s | 2.2 MB 00:00 2024-03-18T00:23:19.706 INFO:teuthology.orchestra.run.smithi136.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 2.7 MB/s | 465 kB 00:00 2024-03-18T00:23:19.731 INFO:teuthology.orchestra.run.smithi136.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 287 kB/s | 31 kB 00:00 2024-03-18T00:23:19.790 INFO:teuthology.orchestra.run.smithi136.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 894 kB/s | 74 kB 00:00 2024-03-18T00:23:19.832 INFO:teuthology.orchestra.run.smithi136.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-03-18T00:23:19.836 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-03-18T00:23:19.836 INFO:teuthology.orchestra.run.smithi136.stdout:Total 16 MB/s | 224 MB 00:13 2024-03-18T00:23:19.920 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-18T00:23:20.093 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-18T00:23:20.184 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-18T00:23:20.299 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-03-18T00:23:20.413 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-18T00:23:20.610 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-03-18T00:23:20.610 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-03-18T00:23:20.772 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-18T00:23:20.815 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-18T00:23:20.871 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-18T00:23:20.942 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-18T00:23:20.974 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-18T00:23:21.010 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-18T00:23:21.056 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-18T00:23:21.093 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-18T00:23:21.136 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-18T00:23:21.178 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-18T00:23:21.311 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-18T00:23:21.359 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-18T00:23:21.389 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-18T00:23:21.430 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-18T00:23:21.524 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-18T00:23:21.556 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-18T00:23:21.596 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-18T00:23:21.622 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-18T00:23:21.646 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-18T00:23:21.726 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-18T00:23:21.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-18T00:23:21.954 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-18T00:23:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-18T00:23:22.045 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-18T00:23:22.101 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-18T00:23:22.283 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-18T00:23:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-18T00:23:22.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-18T00:23:22.507 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-18T00:23:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-18T00:23:22.570 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-18T00:23:22.598 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-18T00:23:22.632 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-18T00:23:22.659 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-03-18T00:23:22.659 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-03-18T00:23:22.671 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-18T00:23:22.703 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-18T00:23:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-18T00:23:22.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-18T00:23:22.844 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-18T00:23:22.877 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-18T00:23:22.918 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-18T00:23:22.953 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-18T00:23:23.041 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-18T00:23:23.139 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-18T00:23:23.192 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-18T00:23:23.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-18T00:23:23.270 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-18T00:23:23.367 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-18T00:23:23.416 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-18T00:23:24.166 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-18T00:23:24.215 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-18T00:23:24.249 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-18T00:23:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-18T00:23:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-18T00:23:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-18T00:23:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-18T00:23:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-18T00:23:24.718 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-18T00:23:25.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-18T00:23:25.479 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-18T00:23:26.686 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-18T00:23:26.757 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-18T00:23:26.788 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-18T00:23:26.819 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-18T00:23:26.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-18T00:23:27.162 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-18T00:23:27.193 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T00:23:27.284 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T00:23:27.315 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-18T00:23:27.354 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-18T00:23:27.919 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-18T00:23:27.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T00:23:28.009 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T00:23:28.023 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-18T00:23:29.753 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-03-18T00:23:29.844 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-18T00:23:29.879 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-18T00:23:29.925 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T00:23:29.934 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T00:23:29.974 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-18T00:23:30.029 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-18T00:23:30.070 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-18T00:23:30.104 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-18T00:23:30.162 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-18T00:23:30.281 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:30.311 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:30.494 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-18T00:23:30.554 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:23:30.666 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:23:30.688 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:23:30.772 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:23:30.818 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T00:23:30.861 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:30.869 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-18T00:23:30.898 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T00:23:30.996 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T00:23:30.997 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-18T00:23:30.997 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-18T00:23:30.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:31.033 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T00:23:31.056 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-18T00:23:31.099 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-18T00:23:31.135 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:23:31.240 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:23:31.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T00:23:31.343 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T00:23:31.390 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-18T00:23:31.413 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T00:23:31.429 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T00:23:31.577 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T00:23:31.602 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T00:23:31.634 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-18T00:23:31.831 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-18T00:23:31.962 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T00:23:32.006 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T00:23:32.115 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:32.174 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:32.391 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T00:23:32.498 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-18T00:23:32.591 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-18T00:23:32.629 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-18T00:23:32.668 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-18T00:23:32.733 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-18T00:23:32.807 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-18T00:23:32.861 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-18T00:23:32.899 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-18T00:23:32.964 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-18T00:23:32.999 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-18T00:23:33.042 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-18T00:23:33.076 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-18T00:23:33.103 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-18T00:23:33.172 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-18T00:23:33.208 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-18T00:23:33.256 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-18T00:23:33.288 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-18T00:23:33.358 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-18T00:23:33.403 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-18T00:23:33.478 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-18T00:23:33.610 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-18T00:23:33.682 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-18T00:23:34.211 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-18T00:23:34.284 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-18T00:23:34.363 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-18T00:23:34.421 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T00:23:34.429 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T00:23:34.468 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-18T00:23:34.519 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-18T00:23:34.953 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-18T00:23:34.953 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-18T00:23:34.953 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-18T00:23:35.036 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-18T00:23:35.123 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-18T00:23:35.167 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-18T00:23:35.587 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-18T00:23:35.646 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-18T00:23:35.702 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-18T00:23:35.776 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-18T00:23:35.829 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-18T00:23:35.866 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-18T00:23:35.913 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-18T00:23:35.949 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-18T00:23:35.992 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-18T00:23:36.034 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-18T00:23:36.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-18T00:23:36.223 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-18T00:23:36.253 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-18T00:23:36.294 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-18T00:23:36.389 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-18T00:23:36.428 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-18T00:23:36.469 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-18T00:23:36.502 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-18T00:23:36.527 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-18T00:23:36.607 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-18T00:23:36.736 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-18T00:23:36.836 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-18T00:23:36.877 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-18T00:23:36.935 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-18T00:23:36.991 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-18T00:23:37.175 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-18T00:23:37.224 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-18T00:23:37.351 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-18T00:23:37.397 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-18T00:23:37.428 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-18T00:23:37.460 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-18T00:23:37.488 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-18T00:23:37.530 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-18T00:23:37.570 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-18T00:23:37.601 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-18T00:23:37.631 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-18T00:23:37.699 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-18T00:23:37.742 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-18T00:23:37.775 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-18T00:23:37.817 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-18T00:23:37.851 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-18T00:23:37.940 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-18T00:23:38.022 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-18T00:23:38.074 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-18T00:23:38.106 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-18T00:23:38.152 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-18T00:23:38.241 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-18T00:23:38.298 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-18T00:23:39.028 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-18T00:23:39.071 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-18T00:23:39.105 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-18T00:23:39.153 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-18T00:23:39.247 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-18T00:23:39.278 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-18T00:23:39.456 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-18T00:23:39.501 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-18T00:23:39.587 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-18T00:23:40.232 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-18T00:23:40.349 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-18T00:23:41.586 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-18T00:23:41.678 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-18T00:23:41.709 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-18T00:23:41.740 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-18T00:23:41.768 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-18T00:23:42.086 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-18T00:23:42.114 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T00:23:42.204 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T00:23:42.235 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-18T00:23:42.272 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-18T00:23:42.742 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-18T00:23:42.926 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T00:23:42.997 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T00:23:43.028 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-03-18T00:23:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T00:23:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T00:23:43.371 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:43.372 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-18T00:23:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:44.858 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T00:23:44.884 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T00:23:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-18T00:23:44.884 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T00:23:44.885 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T00:23:44.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:45.109 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T00:23:45.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:45.172 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:45.207 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:45.568 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T00:23:45.591 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:45.678 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-18T00:23:45.751 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T00:23:45.794 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T00:23:45.873 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T00:23:45.873 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-18T00:23:45.873 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-18T00:23:45.873 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:45.912 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T00:23:46.080 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T00:23:46.110 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T00:23:46.142 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-18T00:23:46.201 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-18T00:23:46.233 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T00:23:46.468 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T00:23:46.492 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T00:23:47.455 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T00:23:47.476 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T00:23:47.575 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T00:23:47.755 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-18T00:23:47.787 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T00:23:47.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T00:23:47.874 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T00:23:47.927 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-18T00:23:48.799 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-18T00:23:48.831 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T00:23:48.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:48.899 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T00:23:48.921 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T00:23:48.921 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:48.921 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-18T00:23:48.921 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:48.957 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T00:23:48.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:49.283 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T00:23:49.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:23:53.771 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T00:23:53.822 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-18T00:23:53.851 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-18T00:23:53.878 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-18T00:23:54.058 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-18T00:23:54.171 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-18T00:23:54.218 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-18T00:23:54.272 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-18T00:23:54.327 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-18T00:23:54.379 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-18T00:23:54.411 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-18T00:23:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-18T00:23:54.473 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-18T00:23:54.552 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-18T00:23:54.631 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-18T00:23:54.665 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-18T00:23:55.241 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:23:55.280 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:23:55.299 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:23:56.107 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-18T00:23:56.192 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-18T00:23:56.233 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-18T00:23:56.328 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-18T00:23:56.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-18T00:23:56.387 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-18T00:23:56.412 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-18T00:23:56.439 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-18T00:23:56.439 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T00:23:56.518 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T00:23:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-18T00:23:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T00:23:56.641 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T00:23:56.667 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-18T00:23:56.700 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-18T00:23:56.726 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-18T00:23:56.751 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-18T00:23:56.794 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-18T00:23:56.832 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-18T00:23:56.864 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-18T00:23:56.889 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-18T00:23:56.915 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-18T00:23:56.940 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-18T00:23:56.974 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-18T00:23:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:23:56.980 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:23:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:23:57.160 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T00:23:57.243 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T00:23:57.267 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-18T00:23:57.293 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-18T00:23:57.325 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-18T00:23:57.352 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-18T00:23:57.418 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /sys 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /proc 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /mnt 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /var/tmp 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /home 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /root 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout:skipping the directory /tmp 2024-03-18T00:23:57.893 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:58.068 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T00:23:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T00:23:58.083 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:58.083 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-18T00:23:58.083 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:59.581 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T00:23:59.606 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T00:23:59.607 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:59.607 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-18T00:23:59.607 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T00:23:59.607 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T00:23:59.607 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:23:59.841 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T00:23:59.863 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:00.308 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T00:24:00.330 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T00:24:00.330 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:00.330 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-18T00:24:00.330 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T00:24:00.331 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T00:24:00.331 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:00.426 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-18T00:24:00.828 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T00:24:00.858 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T00:24:00.890 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-18T00:24:00.950 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-18T00:24:00.972 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T00:24:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T00:24:01.240 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T00:24:02.208 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T00:24:02.232 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T00:24:02.332 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-18T00:24:02.391 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-18T00:24:02.392 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-18T00:24:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-18T00:24:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-18T00:24:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-18T00:24:02.393 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-18T00:24:02.408 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-18T00:24:02.408 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-18T00:24:02.408 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-18T00:24:02.408 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-18T00:24:02.408 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-18T00:24:02.409 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-18T00:24:02.410 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-18T00:24:02.411 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-18T00:24:02.412 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-18T00:24:02.413 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-18T00:24:02.414 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-18T00:24:02.415 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-18T00:24:02.416 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-18T00:24:02.417 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-18T00:24:02.418 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-18T00:24:02.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-18T00:24:02.420 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-18T00:24:02.488 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-18T00:24:02.526 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T00:24:02.549 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T00:24:02.549 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:02.549 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-18T00:24:02.549 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T00:24:02.550 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T00:24:02.550 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:02.585 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T00:24:02.596 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T00:24:02.637 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-18T00:24:03.512 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-18T00:24:03.546 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T00:24:03.568 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T00:24:03.568 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:03.569 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-18T00:24:03.569 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T00:24:03.569 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T00:24:03.569 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:03.613 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T00:24:03.635 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T00:24:03.635 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:03.635 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-18T00:24:03.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:03.681 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T00:24:03.703 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:04.015 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T00:24:04.037 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T00:24:04.037 INFO:teuthology.orchestra.run.smithi136.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T00:24:04.037 INFO:teuthology.orchestra.run.smithi136.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-18T00:24:04.037 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T00:24:04.038 INFO:teuthology.orchestra.run.smithi136.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T00:24:04.038 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: acl-2.3.1-4.el9.x86_64 2024-03-18T00:24:05.425 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.426 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.427 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.428 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-18T00:24:05.429 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: jq-1.6-16.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-18T00:24:05.430 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-18T00:24:05.431 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.11-1.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-18T00:24:05.432 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-18T00:24:05.433 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-18T00:24:05.434 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-18T00:24:05.435 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-18T00:24:05.436 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-18T00:24:05.437 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:05.438 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-3.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:05.439 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-03-18T00:24:05.934 DEBUG:teuthology.parallel:result is None 2024-03-18T00:24:08.527 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T00:24:08.581 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-18T00:24:08.616 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-18T00:24:08.643 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-18T00:24:08.826 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-18T00:24:08.953 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-18T00:24:09.019 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-18T00:24:09.081 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-18T00:24:09.143 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-18T00:24:09.187 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-18T00:24:09.220 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-18T00:24:09.260 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-18T00:24:09.307 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-18T00:24:09.382 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-18T00:24:09.451 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-18T00:24:09.489 INFO:teuthology.orchestra.run.smithi136.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-18T00:24:10.086 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:24:10.129 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:24:10.149 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T00:24:10.961 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-18T00:24:11.050 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-18T00:24:11.091 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-18T00:24:11.180 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-18T00:24:11.220 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-18T00:24:11.246 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-18T00:24:11.271 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-18T00:24:11.297 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-18T00:24:11.298 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T00:24:11.385 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T00:24:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-18T00:24:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T00:24:11.508 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T00:24:11.534 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-18T00:24:11.568 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-18T00:24:11.593 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-18T00:24:11.618 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-18T00:24:11.659 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-18T00:24:11.708 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-18T00:24:11.748 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-18T00:24:11.773 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-18T00:24:11.799 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-18T00:24:11.832 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-18T00:24:11.858 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-18T00:24:11.864 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:24:11.864 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:24:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T00:24:12.078 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T00:24:12.170 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T00:24:12.194 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-18T00:24:12.219 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-18T00:24:12.252 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-18T00:24:12.278 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-18T00:24:12.345 INFO:teuthology.orchestra.run.smithi136.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T00:24:17.320 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T00:24:17.321 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-18T00:24:17.322 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-18T00:24:17.337 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-18T00:24:17.338 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-18T00:24:17.339 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-18T00:24:17.340 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-18T00:24:17.341 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-18T00:24:17.342 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-18T00:24:17.343 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-18T00:24:17.344 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-18T00:24:17.345 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-18T00:24:17.346 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-18T00:24:17.347 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-18T00:24:17.348 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-18T00:24:17.349 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-18T00:24:20.491 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout:Upgraded: 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: acl-2.3.1-4.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-18T00:24:20.492 INFO:teuthology.orchestra.run.smithi136.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-18T00:24:20.493 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: automake-1.16.2-8.el9.noarch 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: bison-3.7.4-5.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.494 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.495 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: flex-2.6.4-9.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: jq-1.6-16.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-18T00:24:20.496 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-18T00:24:20.497 INFO:teuthology.orchestra.run.smithi136.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: lua-5.4.4-4.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-13.11-1.el9.x86_64 2024-03-18T00:24:20.498 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.499 INFO:teuthology.orchestra.run.smithi136.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-18T00:24:20.500 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-18T00:24:20.501 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-ply-3.11-14.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.502 INFO:teuthology.orchestra.run.smithi136.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-18T00:24:20.503 INFO:teuthology.orchestra.run.smithi136.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: re2-1:20211101-3.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-18T00:24:20.504 INFO:teuthology.orchestra.run.smithi136.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-18T00:24:20.505 INFO:teuthology.orchestra.run.smithi136.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-18T00:24:20.505 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:20.505 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-03-18T00:24:21.021 DEBUG:teuthology.parallel:result is None 2024-03-18T00:24:21.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T00:24:21.163 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T00:24:21.188 INFO:teuthology.orchestra.run.smithi081.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-18T00:24:21.189 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-18T00:24:21.189 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-18T00:24:21.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T00:24:21.330 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T00:24:21.354 INFO:teuthology.orchestra.run.smithi136.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-18T00:24:21.354 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-18T00:24:21.354 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-18T00:24:21.356 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-18T00:24:21.356 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:21.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T00:24:21.391 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:21.391 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T00:24:21.424 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-18T00:24:21.425 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:21.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T00:24:21.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T00:24:21.529 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:21.530 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T00:24:21.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T00:24:21.625 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-18T00:24:21.625 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:21.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T00:24:21.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T00:24:21.723 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:21.723 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T00:24:21.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T00:24:21.818 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-18T00:24:21.818 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:21.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T00:24:21.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T00:24:21.913 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:21.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T00:24:21.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T00:24:22.007 INFO:teuthology.run_tasks:Running task ceph... 2024-03-18T00:24:22.095 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-18T00:24:22.096 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-03-18T00:24:22.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /var/log/ceph 2024-03-18T00:24:22.125 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-18T00:24:22.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T00:24:22.167 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T00:24:22.193 INFO:tasks.ceph:Creating extra log directories... 2024-03-18T00:24:22.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T00:24:22.233 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T00:24:22.268 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-18T00:24:22.268 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-18T00:24:22.268 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-18T00:24:22.269 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:22.269 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T00:24:22.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:22.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:22.457 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:22.458 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T00:24:22.473 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:22.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:22.625 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-18T00:24:22.625 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-18T00:24:22.625 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517', 'branch': 'wip-batrick-testing-20240314.183243', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7608517', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240314.183243'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240314.183243', 'sha1': 'c382027d5c66ef4e0aa1131ea3e8080c658d3184'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4770, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'sleep_before_teardown': 0, 'subset': '498/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240314.183243', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': 'c382027d5c66ef4e0aa1131ea3e8080c658d3184', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu6T/EBrcVyipR51TLfO4ErsbDbbKfbVEKXYbfZlU5Pk+YMFCh0C7ySdXci9ItkftF2ds2Eu5VC8owGn+UZ4Gk=', 'smithi136.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZEDarbIirPXjOmWqMJTJsT+MIa9MekmOVoh8NtnrlGavsAX5nMBBZy+Fssv+EyKb0mWkytGFbDcoMeG1J1z4c='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-17_23:17:27', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-18T00:24:22.626 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T00:24:22.628 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T00:24:22.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T00:24:22.683 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T00:24:22.742 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:22.742 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T00:24:22.763 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T00:24:22.763 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-03-18T00:24:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T00:24:22.817 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:22.817 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-03-18 00:23:57.789711878 +0000 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-03-18 00:22:08.139503251 +0000 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-03-18 00:22:08.139503251 +0000 2024-03-18T00:24:22.818 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-03-18 00:22:08.139503251 +0000 2024-03-18T00:24:22.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T00:24:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-03-18T00:24:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-03-18T00:24:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000207861 s, 2.5 MB/s 2024-03-18T00:24:22.884 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T00:24:22.939 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-03-18 00:23:57.790711859 +0000 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-03-18 00:22:08.479496955 +0000 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-03-18 00:22:08.479496955 +0000 2024-03-18T00:24:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-03-18 00:22:08.479496955 +0000 2024-03-18T00:24:22.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T00:24:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-03-18T00:24:23.060 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-03-18T00:24:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000180431 s, 2.8 MB/s 2024-03-18T00:24:23.062 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T00:24:23.117 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-03-18 00:23:57.790711859 +0000 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-03-18 00:22:08.828490489 +0000 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-03-18 00:22:08.828490489 +0000 2024-03-18T00:24:23.172 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-03-18 00:22:08.828490489 +0000 2024-03-18T00:24:23.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T00:24:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-03-18T00:24:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-03-18T00:24:23.237 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000189167 s, 2.7 MB/s 2024-03-18T00:24:23.238 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T00:24:23.294 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:23.349 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-03-18 00:23:57.790711859 +0000 2024-03-18T00:24:23.350 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-03-18 00:22:09.163484282 +0000 2024-03-18T00:24:23.350 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-03-18 00:22:09.163484282 +0000 2024-03-18T00:24:23.350 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-03-18 00:22:09.163484282 +0000 2024-03-18T00:24:23.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T00:24:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-03-18T00:24:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-03-18T00:24:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000242482 s, 2.1 MB/s 2024-03-18T00:24:23.416 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T00:24:23.472 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:23.472 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:23.472 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T00:24:23.488 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T00:24:23.488 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-03-18 00:24:12.679346213 +0000 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-03-18 00:22:08.132076346 +0000 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-03-18 00:22:08.132076346 +0000 2024-03-18T00:24:23.544 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-03-18 00:22:08.132076346 +0000 2024-03-18T00:24:23.545 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T00:24:23.611 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-03-18T00:24:23.611 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-03-18T00:24:23.611 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000217188 s, 2.4 MB/s 2024-03-18T00:24:23.612 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T00:24:23.669 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-03-18 00:24:12.679346213 +0000 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-03-18 00:22:08.462069164 +0000 2024-03-18T00:24:23.724 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-03-18 00:22:08.462069164 +0000 2024-03-18T00:24:23.725 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-03-18 00:22:08.462069164 +0000 2024-03-18T00:24:23.725 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T00:24:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-03-18T00:24:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-03-18T00:24:23.790 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000189629 s, 2.7 MB/s 2024-03-18T00:24:23.791 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T00:24:23.847 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-03-18 00:24:12.680346191 +0000 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-03-18 00:22:08.816061459 +0000 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-03-18 00:22:08.816061459 +0000 2024-03-18T00:24:23.902 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-03-18 00:22:08.816061459 +0000 2024-03-18T00:24:23.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T00:24:23.968 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-03-18T00:24:23.968 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-03-18T00:24:23.968 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000220594 s, 2.3 MB/s 2024-03-18T00:24:23.969 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T00:24:24.025 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-03-18T00:24:24.080 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-03-18 00:24:12.680346191 +0000 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-03-18 00:22:09.161053950 +0000 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-03-18 00:22:09.161053950 +0000 2024-03-18T00:24:24.081 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-03-18 00:22:09.161053950 +0000 2024-03-18T00:24:24.081 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T00:24:24.146 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-03-18T00:24:24.146 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-03-18T00:24:24.146 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.00019975 s, 2.6 MB/s 2024-03-18T00:24:24.147 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T00:24:24.202 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:24.202 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T00:24:24.202 INFO:tasks.ceph:Generating config... 2024-03-18T00:24:24.203 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-18T00:24:24.204 INFO:tasks.ceph:[client] debug client = 20 2024-03-18T00:24:24.204 INFO:tasks.ceph:[client] debug ms = 1 2024-03-18T00:24:24.204 INFO:tasks.ceph:[client] pid file = 2024-03-18T00:24:24.204 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-18T00:24:24.204 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-18T00:24:24.204 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-18T00:24:24.204 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-18T00:24:24.205 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-18T00:24:24.205 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-18T00:24:24.206 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-18T00:24:24.206 INFO:tasks.ceph:Setting up mon.a... 2024-03-18T00:24:24.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-18T00:24:24.258 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-03-18T00:24:24.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-18T00:24:24.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T00:24:24.332 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.136'), ('mon.c', '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]')] 2024-03-18T00:24:24.333 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-18T00:24:24.333 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:24.333 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T00:24:24.387 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.136 --addv c '[v2:172.21.15.136:3301,v1:172.21.15.136:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid a215fc89-10fc-4af5-b2ff-78f3e4709ee3 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:fsid a215fc89-10fc-4af5-b2ff-78f3e4709ee3 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-03-18T00:24:24.472958+0000 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-03-18T00:24:24.472958+0000 2024-03-18T00:24:24.472 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-03-18T00:24:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-03-18T00:24:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-03-18T00:24:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-03-18T00:24:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] mon.c 2024-03-18T00:24:24.473 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-18T00:24:24.474 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T00:24:24.529 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID a215fc89-10fc-4af5-b2ff-78f3e4709ee3... 2024-03-18T00:24:24.530 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T00:24:24.571 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-03-18T00:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-03-18T00:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.621 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on skipped message = False 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = a215fc89-10fc-4af5-b2ff-78f3e4709ee3 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.622 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-03-18T00:24:24.626 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-03-18T00:24:24.627 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T00:24:24.628 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.629 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T00:24:24.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: mon op complaint time = 120 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-03-18T00:24:24.631 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 600 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-03-18T00:24:24.632 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:[mds] 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds = 20 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: debug mds balancer = 20 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug frag = True 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: mds debug scatterstat = True 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: mds op complaint time = 180 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: mds verify scatter = True 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: osd op complaint time = 180 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: rados mon op timeout = 900 2024-03-18T00:24:24.633 INFO:teuthology.orchestra.run.smithi081.stdout: rados osd op timeout = 900 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout:[global] 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: chdir = "" 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: auth supported = cephx 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: filestore xattr use omap = true 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: mon clock drift allowed = 1.000 2024-03-18T00:24:24.634 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: osd crush chooseleaf type = 0 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: auth debug = true 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on old message = true 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on bug = true 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: mon pg warn max object skew = 0 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T00:24:24.635 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default size = 2 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow primary affinity = true 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd allow pg remap = true 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on legacy crush tunables = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on crush straw calc version zero = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on no sortbitwise = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on osd down out interval zero = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon warn on too few osds = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: mon_allow_pool_size_one = true 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T00:24:24.636 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: osd default data pool replay window = 5 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: mon allow pool delete = true 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: mon cluster log file level = debug 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: debug asserts on shutdown = true 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: mon health detail to clog = false 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: mon host = "172.21.15.81,172.21.15.136,[v2:172.21.15.136:3301,v1:172.21.15.136:6790]" 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: ms die on skipped message = False 2024-03-18T00:24:24.637 INFO:teuthology.orchestra.run.smithi136.stdout: fsid = a215fc89-10fc-4af5-b2ff-78f3e4709ee3 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout:[osd] 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd journal size = 100 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub load threshold = 5.0 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd scrub max interval = 600 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd mclock profile = high_recovery_ops 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd recover clone overlap = true 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: osd recovery max chunk = 1048576 2024-03-18T00:24:24.638 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug shutdown = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug op order = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug verify stray on activate = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug trim objects = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd open classes on start = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug pg log writeout = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd deep scrub update digest min age = 30 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: osd map max advance = 10 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: journal zero on create = true 2024-03-18T00:24:24.639 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: filestore ondisk finisher threads = 3 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: filestore apply finisher threads = 3 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bdev debug aio = true 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: osd debug misdirected ops = true 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bdev async discard = True 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bdev enable discard = True 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore allocator = bitmap 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore block size = 96636764160 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: bluestore fsck on mount = True 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluefs = 1/20 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: debug bluestore = 1/20 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-03-18T00:24:24.640 INFO:teuthology.orchestra.run.smithi136.stdout: debug osd = 20 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug rocksdb = 4/10 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd full ratio = 0.9 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd nearfull ratio = 0.8 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: osd failsafe full ratio = 0.95 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: osd objectstore = bluestore 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr] 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug mgr = 20 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-03-18T00:24:24.641 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mgr/telemetry/nag = false 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout:[mon] 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: debug mon = 20 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: debug paxos = 20 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: debug auth = 20 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon data avail warn = 5 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon mgr mkfs grace = 240 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min pgs per osd = 4 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd reporter subtree level = osd 2024-03-18T00:24:24.642 INFO:teuthology.orchestra.run.smithi136.stdout: mon osd prime pg temp = true 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon reweight min bytes per osd = 10 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: # 1m isn't quite enough 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon_down_mkfs_grace = 2m 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon_warn_on_filestore_osds = false 2024-03-18T00:24:24.643 INFO:teuthology.orchestra.run.smithi136.stdout: mon op complaint time = 120 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout:[client] 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: rgw cache enabled = true 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable ops log = true 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: rgw enable usage log = true 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: client mount timeout = 600 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: debug client = 20 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: pid file = "" 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-03-18T00:24:24.644 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.a] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.b] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mon.c] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout:[mds] 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds = 20 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: debug mds balancer = 20 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: debug ms = 1 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug frag = True 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds debug scatterstat = True 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds op complaint time = 180 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: mds verify scatter = True 2024-03-18T00:24:24.645 INFO:teuthology.orchestra.run.smithi136.stdout: osd op complaint time = 180 2024-03-18T00:24:24.646 INFO:teuthology.orchestra.run.smithi136.stdout: rados mon op timeout = 900 2024-03-18T00:24:24.646 INFO:teuthology.orchestra.run.smithi136.stdout: rados osd op timeout = 900 2024-03-18T00:24:24.647 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-18T00:24:24.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-18T00:24:24.743 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-18T00:24:24.743 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:24.743 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-18T00:24:24.757 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:24.757 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-18T00:24:24.812 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:24:24.812 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:24.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T00:24:24.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T00:24:24.891 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:24.891 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:24.946 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:24:24.946 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:24.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T00:24:24.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T00:24:24.986 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:24.986 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:25.041 INFO:tasks.ceph:Setting up mon nodes... 2024-03-18T00:24:25.042 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-18T00:24:25.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T00:24:25.097 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T00:24:25.100 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T00:24:25.174 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T00:24:25.176 INFO:tasks.ceph:Setting up mds nodes... 2024-03-18T00:24:25.176 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T00:24:25.231 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T00:24:25.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-18T00:24:25.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T00:24:25.354 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T00:24:25.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-18T00:24:25.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T00:24:25.438 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T00:24:25.441 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-18T00:24:25.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-18T00:24:25.562 INFO:teuthology.orchestra.run.smithi136.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-18T00:24:25.565 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-18T00:24:25.591 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-18T00:24:25.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-18T00:24:25.633 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-18T00:24:25.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-18T00:24:25.730 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-18T00:24:25.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-18T00:24:25.787 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-18T00:24:25.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-18T00:24:25.884 INFO:teuthology.orchestra.run.smithi136.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-18T00:24:25.899 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-18T00:24:25.899 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi136.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T00:24:25.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-18T00:24:25.926 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:25.926 INFO:tasks.ceph:role: osd.0 2024-03-18T00:24:25.926 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:24:25.926 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:26.000 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:26.497 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-03-18T00:24:26.498 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-03-18T00:24:26.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-18T00:24:26.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-18T00:24:26.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-18T00:24:26.710 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:26.710 INFO:tasks.ceph:role: osd.1 2024-03-18T00:24:26.711 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:24:26.711 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T00:24:26.785 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:26.785 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:26.785 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:26.785 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:26.786 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:27.242 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-03-18T00:24:27.244 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-03-18T00:24:27.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-18T00:24:27.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-18T00:24:27.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-18T00:24:27.465 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:27.466 INFO:tasks.ceph:role: osd.2 2024-03-18T00:24:27.466 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:24:27.466 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:27.541 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:28.026 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-03-18T00:24:28.028 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-03-18T00:24:28.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-18T00:24:28.127 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-18T00:24:28.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-18T00:24:28.228 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:28.228 INFO:tasks.ceph:role: osd.3 2024-03-18T00:24:28.228 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:24:28.229 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:28.304 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:28.305 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:28.305 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:28.305 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:28.826 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-03-18T00:24:28.828 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-03-18T00:24:28.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-18T00:24:28.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-18T00:24:29.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.102+0000 7fc1fc41a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-18T00:24:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.102+0000 7fc1fc41a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-18T00:24:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.102+0000 7fc1fc41a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T00:24:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.102+0000 7fc1fc41a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T00:24:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.102+0000 7fc1fc41a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T00:24:29.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:29.106+0000 7fc1fc41a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-18T00:24:31.964 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-18T00:24:31.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:32.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.085+0000 7fea937ac640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-18T00:24:32.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.085+0000 7fea937ac640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-18T00:24:32.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.085+0000 7fea937ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T00:24:32.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.085+0000 7fea937ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T00:24:32.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.085+0000 7fea937ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T00:24:32.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:32.086+0000 7fea937ac640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-18T00:24:34.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-18T00:24:34.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.076+0000 7f26244d9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.076+0000 7f26244d9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.076+0000 7f26244d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.076+0000 7f26244d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.076+0000 7f26244d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T00:24:35.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:35.077+0000 7f26244d9640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-18T00:24:37.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-18T00:24:37.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.061+0000 7ff6a1abd640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-18T00:24:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.061+0000 7ff6a1abd640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-18T00:24:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.061+0000 7ff6a1abd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T00:24:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.061+0000 7ff6a1abd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T00:24:38.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.061+0000 7ff6a1abd640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T00:24:38.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:38.062+0000 7ff6a1abd640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-18T00:24:40.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-18T00:24:40.946 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-18T00:24:40.981 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:40.981 INFO:tasks.ceph:role: osd.4 2024-03-18T00:24:40.982 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:24:40.982 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:41.056 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:41.057 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:41.057 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:41.057 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:41.057 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:41.583 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-03-18T00:24:41.586 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-03-18T00:24:41.587 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-18T00:24:41.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-18T00:24:41.733 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-18T00:24:41.802 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:41.802 INFO:tasks.ceph:role: osd.5 2024-03-18T00:24:41.802 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:24:41.802 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:41.876 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:41.877 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:41.877 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:41.877 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:41.877 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:42.381 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-03-18T00:24:42.383 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-03-18T00:24:42.384 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-18T00:24:42.497 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-18T00:24:42.529 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-18T00:24:42.596 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:42.597 INFO:tasks.ceph:role: osd.6 2024-03-18T00:24:42.597 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:24:42.597 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T00:24:42.673 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:42.674 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:43.195 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-03-18T00:24:43.197 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-03-18T00:24:43.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-18T00:24:43.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-18T00:24:43.329 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-18T00:24:43.396 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T00:24:43.396 INFO:tasks.ceph:role: osd.7 2024-03-18T00:24:43.396 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:24:43.396 DEBUG:teuthology.orchestra.run.smithi136:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T00:24:43.471 INFO:teuthology.orchestra.run.smithi136.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout: = sunit=0 swidth=0 blks 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T00:24:43.472 INFO:teuthology.orchestra.run.smithi136.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T00:24:44.002 INFO:teuthology.orchestra.run.smithi136.stdout:Discarding blocks...Done. 2024-03-18T00:24:44.004 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi136.front.sepia.ceph.com -o noatime 2024-03-18T00:24:44.004 DEBUG:teuthology.orchestra.run.smithi136:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-18T00:24:44.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-18T00:24:44.156 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:44.249 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.249+0000 7f28786b5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-18T00:24:44.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.250+0000 7f28786b5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-18T00:24:44.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.250+0000 7f28786b5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T00:24:44.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.250+0000 7f28786b5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T00:24:44.250 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.250+0000 7f28786b5640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T00:24:44.251 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:44.251+0000 7f28786b5640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-18T00:24:47.102 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-18T00:24:47.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:47.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.225+0000 7ff354a14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-18T00:24:47.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.225+0000 7ff354a14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-18T00:24:47.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.225+0000 7ff354a14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T00:24:47.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.226+0000 7ff354a14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T00:24:47.226 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.226+0000 7ff354a14640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T00:24:47.227 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:47.226+0000 7ff354a14640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-18T00:24:50.077 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-18T00:24:50.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:50.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.199+0000 7f694a214640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-18T00:24:50.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.199+0000 7f694a214640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-18T00:24:50.201 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.199+0000 7f694a214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T00:24:50.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.199+0000 7f694a214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T00:24:50.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.199+0000 7f694a214640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T00:24:50.202 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:50.200+0000 7f694a214640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-18T00:24:52.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:52.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:24:53.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-18T00:24:53.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:53.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.165+0000 7f3598a11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-18T00:24:53.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.166+0000 7f3598a11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-18T00:24:53.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.166+0000 7f3598a11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T00:24:53.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.166+0000 7f3598a11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T00:24:53.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.166+0000 7f3598a11640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T00:24:53.167 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:53.166+0000 7f3598a11640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-18T00:24:56.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-18T00:24:56.044 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-18T00:24:56.044 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-18T00:24:56.076 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-18T00:24:56.147 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-18T00:24:56.217 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-18T00:24:56.287 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-18T00:24:56.356 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-18T00:24:56.424 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.424 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-18T00:24:56.491 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-18T00:24:56.524 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.524 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-18T00:24:56.595 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-18T00:24:56.664 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.665 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-18T00:24:56.733 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.734 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-18T00:24:56.802 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-18T00:24:56.871 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:56.871 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-18T00:24:56.941 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.941 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-18T00:24:56.958 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:56.958 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-18T00:24:57.028 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:57.028 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-18T00:24:57.047 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:57.047 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-18T00:24:57.117 INFO:tasks.ceph:Adding keys to all mons... 2024-03-18T00:24:57.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T00:24:57.121 DEBUG:teuthology.orchestra.run.smithi136:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T00:24:57.178 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlGafgBRAAhpYkpiwVcfe1oBvHW1uc9Q== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdloynRDRAAqLxRAXBUMAW5TjYGgkjcfA== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdl1i4vFRAAzSWGBfKLCnaSK89+vzSXRw== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC9ifdloKAoBhAAyOja6ZL9gq0z8wSAiEY+qw== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDAifdljE4pBRAA2v+olmiayJCNMruzkzHghg== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDDifdlxpSMBBAAqIhs7b+IaXfPLvy5guC+jw== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDGifdlJje6AxAASJU2GEWEbdzEFQHjo0mPEQ== 2024-03-18T00:24:57.179 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlP7xsChAAMWYH5I4EWAloZJsh53nnhA== 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlzmczGhAA+7JkoCDchSUXpZ8zf+//pA== 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdl5YOYIRAATnNgmO1K3Vxvoc2XaUJ+XA== 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDMifdlvNjwDhAALXfqsCAu9Q2wscXRxZ3mkA== 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDPifdl5XmBDRAA+OqH1WgZtKNl02zoYTRVeA== 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-03-18T00:24:57.180 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDSifdlCfDxCxAArTjbWef5RMeUlq7wAqqWXA== 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDVifdlF3jvCRAAL/Eh84IA8W/88yx8+wGCFA== 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlMETNJRAA/du1tDc2rDvVDvLyJhOxSg== 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlUXeUKxAAh1o1XgyoxUmv09aXdrjISw== 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlbpT4LhAAeAgZ6k9UW+JEHmBzG03Rzg== 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-03-18T00:24:57.181 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlx6S/NBAAxQog1h4YvdSn0X1qDuVvjw== 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.y] 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlGafgBRAAhpYkpiwVcfe1oBvHW1uc9Q== 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.a] 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdloynRDRAAqLxRAXBUMAW5TjYGgkjcfA== 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.c] 2024-03-18T00:24:57.200 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdl1i4vFRAAzSWGBfKLCnaSK89+vzSXRw== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.0] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC9ifdloKAoBhAAyOja6ZL9gq0z8wSAiEY+qw== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.1] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDAifdljE4pBRAA2v+olmiayJCNMruzkzHghg== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.2] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDDifdlxpSMBBAAqIhs7b+IaXfPLvy5guC+jw== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.3] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDGifdlJje6AxAASJU2GEWEbdzEFQHjo0mPEQ== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[mgr.x] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlP7xsChAAMWYH5I4EWAloZJsh53nnhA== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.b] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlzmczGhAA+7JkoCDchSUXpZ8zf+//pA== 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout:[mds.d] 2024-03-18T00:24:57.201 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdl5YOYIRAATnNgmO1K3Vxvoc2XaUJ+XA== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.4] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDMifdlvNjwDhAALXfqsCAu9Q2wscXRxZ3mkA== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.5] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDPifdl5XmBDRAA+OqH1WgZtKNl02zoYTRVeA== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.6] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDSifdlCfDxCxAArTjbWef5RMeUlq7wAqqWXA== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[osd.7] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQDVifdlF3jvCRAAL/Eh84IA8W/88yx8+wGCFA== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[client.0] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlMETNJRAA/du1tDc2rDvVDvLyJhOxSg== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[client.2] 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlUXeUKxAAh1o1XgyoxUmv09aXdrjISw== 2024-03-18T00:24:57.202 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-03-18T00:24:57.203 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlbpT4LhAAeAgZ6k9UW+JEHmBzG03Rzg== 2024-03-18T00:24:57.203 INFO:teuthology.orchestra.run.smithi136.stdout:[client.3] 2024-03-18T00:24:57.203 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQC5ifdlx6S/NBAAxQog1h4YvdSn0X1qDuVvjw== 2024-03-18T00:24:57.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T00:24:57.242 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T00:24:57.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.376 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.548 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.608 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.661 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T00:24:57.666 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T00:24:57.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.721 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.781 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T00:24:57.837 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.841 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:57.955 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:58.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:58.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T00:24:58.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.189 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.249 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T00:24:58.305 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-18T00:24:58.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-18T00:24:58.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T00:24:58.429 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-18T00:24:58.456 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-18T00:24:58.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T00:24:58.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-18T00:24:58.607 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-18T00:24:58.673 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T00:24:58.770 DEBUG:teuthology.orchestra.run.smithi136:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-18T00:24:58.796 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:58.799 DEBUG:teuthology.orchestra.run.smithi136:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T00:24:58.851 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-18T00:24:58.852 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-18T00:24:58.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-18T00:24:58.854 INFO:tasks.ceph.mon.a:Started 2024-03-18T00:24:58.854 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-18T00:24:58.855 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-18T00:24:58.894 INFO:tasks.ceph.mon.b:Started 2024-03-18T00:24:58.894 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-18T00:24:58.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-18T00:24:58.896 INFO:tasks.ceph.mon.c:Started 2024-03-18T00:24:58.896 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-18T00:24:58.897 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-18T00:24:58.897 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-18T00:24:58.899 INFO:tasks.ceph.mgr.y:Started 2024-03-18T00:24:58.899 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-18T00:24:58.899 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-18T00:24:58.901 INFO:tasks.ceph.mgr.x:Started 2024-03-18T00:24:58.901 INFO:tasks.ceph:Setting crush tunables to default 2024-03-18T00:24:58.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-03-18T00:24:59.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.000+0000 7faa4be52640 1 Processor -- start 2024-03-18T00:24:59.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.000+0000 7faa4be52640 1 -- start start 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4be52640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa4415b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4be52640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4be52640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa4406d3c0 con 0x7faa440c4a90 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4be52640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7faa44158d80 con 0x7faa4406ee70 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4be52640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7faa440c4e70 con 0x7faa441589a0 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4a3ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4a3ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33722/0 (socket says 172.21.15.81:33722) 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.001+0000 7faa4a3ef640 1 -- 172.21.15.81:0/4099032861 learned_addr learned my addr 172.21.15.81:0/4099032861 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa4a3ef640 1 -- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 msgr2=0x7faa440cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa4a3ef640 1 -- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 msgr2=0x7faa440cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa4a3ef640 1 --2- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa4415b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa4a3ef640 1 --2- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T00:24:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa49bee640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 msgr2=0x7faa4415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T00:24:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa49bee640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 msgr2=0x7faa4415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T00:24:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa4415b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T00:24:59.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.002+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa4415b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576990020 0 0) 0x7faa4406d3c0 con 0x7faa440c4a90 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa30003520 con 0x7faa440c4a90 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3588895874 0 0) 0x7faa30003520 con 0x7faa440c4a90 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 msgr2=0x7faa4415b390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa4415b390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 msgr2=0x7faa440cb180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 --2- 172.21.15.81:0/4099032861 >> v2:172.21.15.81:3300/0 conn(0x7faa4406ee70 0x7faa440cb180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa440c50c0 con 0x7faa440c4a90 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7faa34001670 con 0x7faa440c4a90 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 >> v1:172.21.15.136:6789/0 conn(0x7faa440c4a90 legacy=0x7faa4406e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa300039b0 0x7faa30003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa30004d40 0x7faa300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa44158d80 con 0x7faa300039b0 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa440c4e70 con 0x7faa30004d40 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7faa3000baf0 con 0x7faa441589a0 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.183+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa300039b0 0x7faa30003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa493ed640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa4a3ef640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa30004d40 0x7faa300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa49bee640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 msgr2=0x7faa30004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa441589a0 0x7faa30004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa49bee640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa30004d40 msgr2=0x7faa300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:24:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa30004d40 0x7faa300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa49bee640 1 -- 172.21.15.81:0/4099032861 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa30003520 con 0x7faa300039b0 2024-03-18T00:24:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.184+0000 7faa4a3ef640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa30004d40 0x7faa300051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:24:59.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.185+0000 7faa49bee640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa300039b0 0x7faa30003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa4000dbf0 tx=0x7faa30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83add98d86969e04 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.185+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40034070 con 0x7faa300039b0 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.185+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa4002ec30 con 0x7faa300039b0 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.185+0000 7faa48bec640 1 -- 172.21.15.81:0/4099032861 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa4000d7f0 con 0x7faa300039b0 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 -- 172.21.15.81:0/4099032861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa300039b0 msgr2=0x7faa30003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 --2- 172.21.15.81:0/4099032861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa300039b0 0x7faa30003dd0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7faa4000dbf0 tx=0x7faa30005830 comp rx=0 tx=0).stop 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4a3ef640 1 -- 172.21.15.81:0/4099032861 reap_dead start 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 -- 172.21.15.81:0/4099032861 shutdown_connections 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 -- 172.21.15.81:0/4099032861 >> 172.21.15.81:0/4099032861 conn(0x7faa440cfbf0 msgr2=0x7faa440cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:24:59.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 -- 172.21.15.81:0/4099032861 shutdown_connections 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.186+0000 7faa4be52640 1 -- 172.21.15.81:0/4099032861 wait complete. 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.187+0000 7faa4be52640 1 Processor -- start 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.187+0000 7faa4be52640 1 -- start start 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 0x7faa4414e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa44071240 0x7faa440716c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa440c5960 con 0x7faa4414f2f0 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7faa440c5680 con 0x7faa44071240 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4be52640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7faa440c5c40 con 0x7faa300039b0 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa493ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa49bee640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 0x7faa4414e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa4a3ef640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa44071240 0x7faa440716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa49bee640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 0x7faa4414e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:43278/0 (socket says 172.21.15.81:43278) 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa493ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33752/0 (socket says 172.21.15.81:33752) 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.188+0000 7faa49bee640 1 -- 172.21.15.81:0/766904823 learned_addr learned my addr 172.21.15.81:0/766904823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 -- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 msgr2=0x7faa4414e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 0x7faa4414e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 -- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa44071240 msgr2=0x7faa440716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa44071240 0x7faa440716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 -- 172.21.15.81:0/766904823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa44072070 con 0x7faa4414f2f0 2024-03-18T00:24:59.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa493ed640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e7b0 tx=0x7faa3400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa340050d0 con 0x7faa4414f2f0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa34018070 con 0x7faa4414f2f0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3400c6c0 con 0x7faa4414f2f0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa44072350 con 0x7faa4414f2f0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.189+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa44159640 con 0x7faa4414f2f0 2024-03-18T00:24:59.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.190+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa4404f540 con 0x7faa4414f2f0 2024-03-18T00:24:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.191+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7faa3400c860 con 0x7faa4414f2f0 2024-03-18T00:24:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.191+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7faa34003c30 con 0x7faa4414f2f0 2024-03-18T00:24:59.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.193+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7faa3400cce0 con 0x7faa4414f2f0 2024-03-18T00:24:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.259+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7faa44159810 con 0x7faa4414f2f0 2024-03-18T00:24:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa3a7fc640 1 -- 172.21.15.81:0/766904823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7faa340035f0 con 0x7faa4414f2f0 2024-03-18T00:24:59.261 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 msgr2=0x7faa4414f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7faa3400e7b0 tx=0x7faa3400ec70 comp rx=0 tx=0).stop 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 shutdown_connections 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7faa44071240 0x7faa440716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa4414f2f0 0x7faa4414f770 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 --2- 172.21.15.81:0/766904823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7faa300039b0 0x7faa4414e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 >> 172.21.15.81:0/766904823 conn(0x7faa440cfbf0 msgr2=0x7faa440afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:24:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 shutdown_connections 2024-03-18T00:24:59.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:24:59.261+0000 7faa4be52640 1 -- 172.21.15.81:0/766904823 wait complete. 2024-03-18T00:24:59.272 INFO:tasks.ceph:check_enable_crimson: False 2024-03-18T00:24:59.273 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-18T00:24:59.273 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:59.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-18T00:24:59.299 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:59.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-18T00:24:59.366 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:59.366 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-18T00:24:59.433 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:24:59.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-18T00:24:59.500 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:59.500 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-18T00:24:59.527 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:59.528 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-18T00:24:59.596 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:59.596 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-18T00:24:59.661 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:24:59.661+0000 7fc983030040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T00:24:59.663 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:24:59.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-18T00:24:59.703 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:24:59.703+0000 7fc3804da040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T00:24:59.717 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:24:59.717+0000 7fc983030040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T00:24:59.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new f75e6efa-51fa-499c-8e82-9d6f8d7dc6da 0 2024-03-18T00:24:59.756 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:24:59.756+0000 7fc3804da040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T00:24:59.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.870+0000 7f742baf8640 1 Processor -- start 2024-03-18T00:24:59.870 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.870+0000 7f742baf8640 1 -- start start 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742baf8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742baf8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742baf8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74240b0560 con 0x7f74240b5b80 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742baf8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f742406bae0 con 0x7f742406b1c0 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742baf8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f742415e830 con 0x7f74240b6030 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f7429894640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50158/0 (socket says 172.21.15.136:50158) 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f7429894640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33130/0 (socket says 172.21.15.136:33130) 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f7429093640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f74240b5b80 0x7f7424072870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54496/0 (socket says 172.21.15.136:54496) 2024-03-18T00:24:59.872 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 -- 172.21.15.136:0/3122514024 learned_addr learned my addr 172.21.15.136:0/3122514024 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:24:59.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 -- 172.21.15.136:0/3122514024 >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 msgr2=0x7f742406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:24:59.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 --2- 172.21.15.136:0/3122514024 >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 -- 172.21.15.136:0/3122514024 >> v1:172.21.15.136:6789/0 conn(0x7f74240b5b80 legacy=0x7f7424072870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f742a095640 1 -- 172.21.15.136:0/3122514024 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240b07d0 con 0x7f74240b6030 2024-03-18T00:24:59.873 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.871+0000 7f7429894640 1 --2- 172.21.15.136:0/3122514024 >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:24:59.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.872+0000 7f742a095640 1 --2- 172.21.15.136:0/3122514024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f741c009e50 tx=0x7f741c02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8774496da93298a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:24:59.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.872+0000 7f7428892640 1 -- 172.21.15.136:0/3122514024 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c02cb00 con 0x7f74240b6030 2024-03-18T00:24:59.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.872+0000 7f7428892640 1 -- 172.21.15.136:0/3122514024 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f741c02cca0 con 0x7f74240b6030 2024-03-18T00:24:59.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.872+0000 7f7428892640 1 -- 172.21.15.136:0/3122514024 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f741c034610 con 0x7f74240b6030 2024-03-18T00:24:59.874 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 -- 172.21.15.136:0/3122514024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 msgr2=0x7f7424072f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 --2- 172.21.15.136:0/3122514024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f741c009e50 tx=0x7f741c02bf60 comp rx=0 tx=0).stop 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 -- 172.21.15.136:0/3122514024 shutdown_connections 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 --2- 172.21.15.136:0/3122514024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b6030 0x7f7424072f80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 --2- 172.21.15.136:0/3122514024 >> v2:172.21.15.136:3300/0 conn(0x7f742406b1c0 0x7f742406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 -- 172.21.15.136:0/3122514024 >> 172.21.15.136:0/3122514024 conn(0x7f74240d0510 msgr2=0x7f74240d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 -- 172.21.15.136:0/3122514024 shutdown_connections 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.873+0000 7f742baf8640 1 -- 172.21.15.136:0/3122514024 wait complete. 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.874+0000 7f742baf8640 1 Processor -- start 2024-03-18T00:24:59.875 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.874+0000 7f742baf8640 1 -- start start 2024-03-18T00:24:59.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 0x7f7424157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.877 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74240b6030 0x7f74240c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f74240b1070 con 0x7f742406b1c0 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f74240b0d90 con 0x7f74240b6030 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f74240670d0 con 0x7f74240b5b80 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742a095640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74240b6030 0x7f74240c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50172/0 (socket says 172.21.15.136:50172) 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 -- 172.21.15.136:0/1876455020 learned_addr learned my addr 172.21.15.136:0/1876455020 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429894640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 0x7f7424157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 -- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74240b6030 msgr2=0x7f74240c9d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74240b6030 0x7f74240c9d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 -- 172.21.15.136:0/1876455020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 msgr2=0x7f7424157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 0x7f7424157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.878 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 -- 172.21.15.136:0/1876455020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74240ca290 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429894640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 0x7f7424157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f7429093640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f741400c3c0 tx=0x7f741400c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74140074e0 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7414007680 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74240c41c0 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.875+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414004a00 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.876+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f74240c4780 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.876+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f741401a020 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.876+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f741401c5f0 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.877+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742404f540 con 0x7f74240b5b80 2024-03-18T00:24:59.879 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.879+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7414021070 con 0x7f74240b5b80 2024-03-18T00:24:59.950 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.950+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f75e6efa-51fa-499c-8e82-9d6f8d7dc6da", "id": 0} v 0) -- 0x7f74240b5680 con 0x7f74240b5b80 2024-03-18T00:24:59.954 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.953+0000 7f741a7fc640 1 -- 172.21.15.136:0/1876455020 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f75e6efa-51fa-499c-8e82-9d6f8d7dc6da", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f741401c910 con 0x7f74240b5b80 2024-03-18T00:24:59.954 INFO:teuthology.orchestra.run.smithi136.stdout:0 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 msgr2=0x7f74241f3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f741400c3c0 tx=0x7f741400c880 comp rx=0 tx=0).stop 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 shutdown_connections 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f74240b6030 0x7f74240c9d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f74240b5b80 0x7f74241f3740 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 --2- 172.21.15.136:0/1876455020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f742406b1c0 0x7f7424157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 >> 172.21.15.136:0/1876455020 conn(0x7f74240d0510 msgr2=0x7f74240add40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 shutdown_connections 2024-03-18T00:24:59.955 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:24:59.954+0000 7f742baf8640 1 -- 172.21.15.136:0/1876455020 wait complete. 2024-03-18T00:24:59.965 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 67848bf7-60fb-49ac-80b5-268b08e9dfed 1 2024-03-18T00:25:00.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.065+0000 7f8657b77640 1 Processor -- start 2024-03-18T00:25:00.066 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.065+0000 7f8657b77640 1 -- start start 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8657b77640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f865006c4d0 0x7f865006b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8657b77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f86500cff30 0x7f865015f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8657b77640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86500737b0 con 0x7f865006c0f0 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8657b77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8650073280 con 0x7f86500cff30 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8657b77640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f86500d1030 con 0x7f865006c4d0 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655112640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f865006c4d0 0x7f865006b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.068 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655913640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f865006c0f0 0x7f86500b1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54506/0 (socket says 172.21.15.136:54506) 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655913640 1 -- 172.21.15.136:0/3900701663 learned_addr learned my addr 172.21.15.136:0/3900701663 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8656114640 1 --2- 172.21.15.136:0/3900701663 >> v2:172.21.15.81:3300/0 conn(0x7f86500cff30 0x7f865015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655112640 1 -- 172.21.15.136:0/3900701663 >> v2:172.21.15.81:3300/0 conn(0x7f86500cff30 msgr2=0x7f865015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655112640 1 --2- 172.21.15.136:0/3900701663 >> v2:172.21.15.81:3300/0 conn(0x7f86500cff30 0x7f865015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655112640 1 -- 172.21.15.136:0/3900701663 >> v1:172.21.15.136:6789/0 conn(0x7f865006c0f0 legacy=0x7f86500b1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8655112640 1 -- 172.21.15.136:0/3900701663 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650067540 con 0x7f865006c4d0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.067+0000 7f8654911640 1 -- 172.21.15.136:0/3900701663 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20265649 0 0) 0x7f86500737b0 con 0x7f865006c0f0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.068+0000 7f8655112640 1 --2- 172.21.15.136:0/3900701663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c4d0 0x7f865006b3c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f865006fcc0 tx=0x7f864c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12d9a102d04fb7c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.068+0000 7f8654911640 1 -- 172.21.15.136:0/3900701663 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c035020 con 0x7f865006c4d0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.068+0000 7f8654911640 1 -- 172.21.15.136:0/3900701663 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864c031830 con 0x7f865006c4d0 2024-03-18T00:25:00.069 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.068+0000 7f8654911640 1 -- 172.21.15.136:0/3900701663 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f864c031c00 con 0x7f865006c4d0 2024-03-18T00:25:00.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 -- 172.21.15.136:0/3900701663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c4d0 msgr2=0x7f865006b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 --2- 172.21.15.136:0/3900701663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c4d0 0x7f865006b3c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f865006fcc0 tx=0x7f864c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 -- 172.21.15.136:0/3900701663 shutdown_connections 2024-03-18T00:25:00.070 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 --2- 172.21.15.136:0/3900701663 >> v2:172.21.15.81:3300/0 conn(0x7f86500cff30 0x7f865015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 --2- 172.21.15.136:0/3900701663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c4d0 0x7f865006b3c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 -- 172.21.15.136:0/3900701663 >> 172.21.15.136:0/3900701663 conn(0x7f86500d0510 msgr2=0x7f86500d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 -- 172.21.15.136:0/3900701663 shutdown_connections 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.069+0000 7f8657b77640 1 -- 172.21.15.136:0/3900701663 wait complete. 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.071+0000 7f8657b77640 1 Processor -- start 2024-03-18T00:25:00.071 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.071+0000 7f8657b77640 1 -- start start 2024-03-18T00:25:00.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865006c4d0 0x7f86500c40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 0x7f8650159570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8650067020 con 0x7f865006c4d0 2024-03-18T00:25:00.074 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f86500734d0 con 0x7f865006c0f0 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8657b77640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f86500b1c60 con 0x7f86500cff30 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8655913640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 0x7f8650159570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8655913640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33172/0 (socket says 172.21.15.136:33172) 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8655913640 1 -- 172.21.15.136:0/3368499190 learned_addr learned my addr 172.21.15.136:0/3368499190 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8655112640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865006c4d0 0x7f86500c40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 -- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 msgr2=0x7f86501f4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 -- 172.21.15.136:0/3368499190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865006c4d0 msgr2=0x7f86500c40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865006c4d0 0x7f86500c40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8656114640 1 -- 172.21.15.136:0/3368499190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8650158510 con 0x7f86500cff30 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.072+0000 7f8655913640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f8656114640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 0x7f8650159570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f864800ebd0 tx=0x7f864800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.075 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8648018020 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f864800cd20 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86501587b0 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86480146c0 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8650158d70 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8648005d10 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.073+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f8648013790 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.074+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8650073710 con 0x7f86500cff30 2024-03-18T00:25:00.076 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.076+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f8650073710 con 0x7f86500cff30 2024-03-18T00:25:00.166 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.166+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67848bf7-60fb-49ac-80b5-268b08e9dfed", "id": 1} v 0) -- 0x7f865004f540 con 0x7f86500cff30 2024-03-18T00:25:00.171 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.171+0000 7f86467fc640 1 -- 172.21.15.136:0/3368499190 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67848bf7-60fb-49ac-80b5-268b08e9dfed", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f8648022030 con 0x7f86500cff30 2024-03-18T00:25:00.171 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-03-18T00:25:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.171+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 msgr2=0x7f8650159570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.171+0000 7f8657b77640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 0x7f8650159570 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f864800ebd0 tx=0x7f864800c490 comp rx=0 tx=0).stop 2024-03-18T00:25:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 shutdown_connections 2024-03-18T00:25:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f86500cff30 0x7f8650159570 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f865006c4d0 0x7f86500c40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 --2- 172.21.15.136:0/3368499190 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f865006c0f0 0x7f86501f4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 >> 172.21.15.136:0/3368499190 conn(0x7f86500d0510 msgr2=0x7f86500cb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 shutdown_connections 2024-03-18T00:25:00.173 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.172+0000 7f8657b77640 1 -- 172.21.15.136:0/3368499190 wait complete. 2024-03-18T00:25:00.183 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new c3d419eb-c604-4be5-9cdd-c767d1be2f01 2 2024-03-18T00:25:00.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.283+0000 7f0cb436f640 1 Processor -- start 2024-03-18T00:25:00.283 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.283+0000 7f0cb436f640 1 -- start start 2024-03-18T00:25:00.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb436f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb436f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.285 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb436f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cac071ee0 con 0x7f0cac06b700 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb436f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0cac072af0 con 0x7f0cac0b0150 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb436f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac0721c0 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb210b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50202/0 (socket says 172.21.15.136:50202) 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 -- 172.21.15.136:0/621325231 learned_addr learned my addr 172.21.15.136:0/621325231 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb210b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33180/0 (socket says 172.21.15.136:33180) 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 -- 172.21.15.136:0/621325231 >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 msgr2=0x7f0cac0ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 --2- 172.21.15.136:0/621325231 >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 -- 172.21.15.136:0/621325231 >> v1:172.21.15.81:6789/0 conn(0x7f0cac06b700 legacy=0x7f0cac06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb190a640 1 -- 172.21.15.136:0/621325231 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac0724a0 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.286 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.284+0000 7f0cb210b640 1 --2- 172.21.15.136:0/621325231 >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:00.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.285+0000 7f0cb190a640 1 --2- 172.21.15.136:0/621325231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009870 tx=0x7f0c9c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ecd59455c37d19 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.285+0000 7f0cb1109640 1 -- 172.21.15.136:0/621325231 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c035020 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.285+0000 7f0cb1109640 1 -- 172.21.15.136:0/621325231 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c031640 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.287 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.285+0000 7f0cb1109640 1 -- 172.21.15.136:0/621325231 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c02d040 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 -- 172.21.15.136:0/621325231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 msgr2=0x7f0cac06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 --2- 172.21.15.136:0/621325231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c009870 tx=0x7f0c9c02b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 -- 172.21.15.136:0/621325231 shutdown_connections 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 --2- 172.21.15.136:0/621325231 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac06b1c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 --2- 172.21.15.136:0/621325231 >> v2:172.21.15.136:3300/0 conn(0x7f0cac0b0150 0x7f0cac0ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 -- 172.21.15.136:0/621325231 >> 172.21.15.136:0/621325231 conn(0x7f0cac0d0da0 msgr2=0x7f0cac0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 -- 172.21.15.136:0/621325231 shutdown_connections 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.286+0000 7f0cb436f640 1 -- 172.21.15.136:0/621325231 wait complete. 2024-03-18T00:25:00.290 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.287+0000 7f0cb436f640 1 Processor -- start 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.287+0000 7f0cb436f640 1 -- start start 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cac06b700 0x7f0cac1d1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac0b0530 con 0x7f0cac06b700 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0cac0d0900 con 0x7f0cac0b0150 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0cac0b06b0 con 0x7f0cac0ceeb0 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb290c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33196/0 (socket says 172.21.15.136:33196) 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb290c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50210/0 (socket says 172.21.15.136:50210) 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 -- 172.21.15.136:0/2246267689 learned_addr learned my addr 172.21.15.136:0/2246267689 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb210b640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cac06b700 0x7f0cac1d1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.291 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 -- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 msgr2=0x7f0cac0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 -- 172.21.15.136:0/2246267689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cac06b700 msgr2=0x7f0cac1d1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cac06b700 0x7f0cac1d1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 -- 172.21.15.136:0/2246267689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cac1d24e0 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb290c640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb190a640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c000c00 tx=0x7f0c9c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c040070 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c9c0399f0 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cac1f3ca0 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c9c035040 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.288+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cac1f4260 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.289+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0c9c04b060 con 0x7f0cac0b0150 2024-03-18T00:25:00.292 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.289+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f0c9c03a840 con 0x7f0cac0b0150 2024-03-18T00:25:00.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.289+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cac04f540 con 0x7f0cac0b0150 2024-03-18T00:25:00.293 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.287+0000 7fc3804da040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T00:25:00.293 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.292+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f0cac1d24e0 con 0x7f0cac0b0150 2024-03-18T00:25:00.294 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.294+0000 7fc983030040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T00:25:00.341 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.341+0000 7fc3804da040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T00:25:00.350 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.350+0000 7fc983030040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T00:25:00.364 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.364+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c3d419eb-c604-4be5-9cdd-c767d1be2f01", "id": 2} v 0) -- 0x7f0cac074d40 con 0x7f0cac0b0150 2024-03-18T00:25:00.369 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.369+0000 7f0ca2ffd640 1 -- 172.21.15.136:0/2246267689 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c3d419eb-c604-4be5-9cdd-c767d1be2f01", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f0c9c039e60 con 0x7f0cac0b0150 2024-03-18T00:25:00.370 INFO:teuthology.orchestra.run.smithi136.stdout:2 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 msgr2=0x7f0cac0c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0c9c000c00 tx=0x7f0c9c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 shutdown_connections 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0cac0ceeb0 0x7f0cac0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0cac0b0150 0x7f0cac0c7e70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 --2- 172.21.15.136:0/2246267689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0cac06b700 0x7f0cac1d1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 >> 172.21.15.136:0/2246267689 conn(0x7f0cac0d0da0 msgr2=0x7f0cac1e5480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 shutdown_connections 2024-03-18T00:25:00.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.370+0000 7f0cb436f640 1 -- 172.21.15.136:0/2246267689 wait complete. 2024-03-18T00:25:00.381 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc 3 2024-03-18T00:25:00.386 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.386+0000 7fc3804da040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T00:25:00.398 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.398+0000 7fc983030040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T00:25:00.439 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.439+0000 7fc3804da040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T00:25:00.455 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.455+0000 7fc983030040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T00:25:00.481 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.480+0000 7fc3804da040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T00:25:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.481+0000 7f715bbbc640 1 Processor -- start 2024-03-18T00:25:00.482 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.481+0000 7f715bbbc640 1 -- start start 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715bbbc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715bbbc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f715406b8d0 0x7f715415da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715bbbc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7154071ee0 con 0x7f71540ceeb0 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715bbbc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f7154072af0 con 0x7f715406b8d0 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715bbbc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f71540721c0 con 0x7f71540b0150 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f7159958640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715a159640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f715406b8d0 0x7f715415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f7159958640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50224/0 (socket says 172.21.15.136:50224) 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f715a159640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f715406b8d0 0x7f715415da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33210/0 (socket says 172.21.15.136:33210) 2024-03-18T00:25:00.485 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.482+0000 7f7159958640 1 -- 172.21.15.136:0/1267620178 learned_addr learned my addr 172.21.15.136:0/1267620178 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f715a159640 1 -- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 msgr2=0x7f71540ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f715a159640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f715a159640 1 -- 172.21.15.136:0/1267620178 >> v1:172.21.15.81:6789/0 conn(0x7f71540ceeb0 legacy=0x7f715406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f715a159640 1 -- 172.21.15.136:0/1267620178 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71540724a0 con 0x7f715406b8d0 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f7159958640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.483+0000 7f715a159640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f715415da20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d423ebf3b5736b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f7158956640 1 -- 172.21.15.136:0/1267620178 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c039070 con 0x7f715406b8d0 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f7158956640 1 -- 172.21.15.136:0/1267620178 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f714c02cbc0 con 0x7f715406b8d0 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f7158956640 1 -- 172.21.15.136:0/1267620178 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f714c034440 con 0x7f715406b8d0 2024-03-18T00:25:00.486 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 -- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 msgr2=0x7f715415da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f715415da20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f714c009d90 tx=0x7f714c02be10 comp rx=0 tx=0).stop 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 -- 172.21.15.136:0/1267620178 shutdown_connections 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f715415da20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 --2- 172.21.15.136:0/1267620178 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71540ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 -- 172.21.15.136:0/1267620178 >> 172.21.15.136:0/1267620178 conn(0x7f71540d0da0 msgr2=0x7f71540d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 -- 172.21.15.136:0/1267620178 shutdown_connections 2024-03-18T00:25:00.487 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.484+0000 7f715bbbc640 1 -- 172.21.15.136:0/1267620178 wait complete. 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 Processor -- start 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 -- start start 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f71541e0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71540ceeb0 0x7f71541e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71540b0530 con 0x7f71540ceeb0 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f71540d0900 con 0x7f715406b8d0 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715bbbc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f71540b06b0 con 0x7f71540b0150 2024-03-18T00:25:00.490 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f7159958640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f71541e0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f7159157640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f7159958640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f71541e0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33220/0 (socket says 172.21.15.136:33220) 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f7159157640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50236/0 (socket says 172.21.15.136:50236) 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f7159958640 1 -- 172.21.15.136:0/3188977663 learned_addr learned my addr 172.21.15.136:0/3188977663 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.486+0000 7f715a159640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71540ceeb0 0x7f71541e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 -- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 msgr2=0x7f71541e0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f71541e0930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 -- 172.21.15.136:0/3188977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71540ceeb0 msgr2=0x7f71541e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71540ceeb0 0x7f71541e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 -- 172.21.15.136:0/3188977663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71541e40c0 con 0x7f71540b0150 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f7159157640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f714800c3c0 tx=0x7f714800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.491 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71480052d0 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7148005490 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71541e43a0 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7148007260 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541ce200 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7148007400 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.487+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7148011590 con 0x7f71540b0150 2024-03-18T00:25:00.492 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.488+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154069190 con 0x7f71540b0150 2024-03-18T00:25:00.493 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.490+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7154069190 con 0x7f71540b0150 2024-03-18T00:25:00.501 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.501+0000 7fc983030040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T00:25:00.563 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.563+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc", "id": 3} v 0) -- 0x7f71540cf8b0 con 0x7f71540b0150 2024-03-18T00:25:00.568 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.568+0000 7f71467fc640 1 -- 172.21.15.136:0/3188977663 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f71540cf8b0 con 0x7f71540b0150 2024-03-18T00:25:00.568 INFO:teuthology.orchestra.run.smithi136.stdout:3 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 msgr2=0x7f71541cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f714800c3c0 tx=0x7f714800c880 comp rx=0 tx=0).stop 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 shutdown_connections 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71540ceeb0 0x7f71541e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71540b0150 0x7f71541cdcc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 --2- 172.21.15.136:0/3188977663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f715406b8d0 0x7f71541e0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 >> 172.21.15.136:0/3188977663 conn(0x7f71540d0da0 msgr2=0x7f71540d1180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 shutdown_connections 2024-03-18T00:25:00.570 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.569+0000 7f715bbbc640 1 -- 172.21.15.136:0/3188977663 wait complete. 2024-03-18T00:25:00.580 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 257fd9a3-e594-4e73-81ad-bc398662a7aa 4 2024-03-18T00:25:00.596 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.595+0000 7fc3804da040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T00:25:00.623 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.623+0000 7fc983030040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T00:25:00.664 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.664+0000 7fc3804da040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T00:25:00.698 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.697+0000 7fc983030040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T00:25:00.709 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.709+0000 7fc3804da040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T00:25:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 Processor -- start 2024-03-18T00:25:00.722 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 -- start start 2024-03-18T00:25:00.723 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117c06cf40 con 0x7f117c15e3f0 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117c06d220 con 0x7f117c0cc900 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.722+0000 7f1181627640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f117c0cf050 con 0x7f117c0ce6a0 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117b7fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f117c0cc900 0x7f117c0ccd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54522/0 (socket says 172.21.15.136:54522) 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50250/0 (socket says 172.21.15.136:50250) 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117b7fe640 1 -- 172.21.15.136:0/1030427134 learned_addr learned my addr 172.21.15.136:0/1030427134 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2816078876 0 0) 0x7f117c06d220 con 0x7f117c0cc900 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1164003520 con 0x7f117c0cc900 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117a7fc640 1 -- 172.21.15.136:0/1030427134 >> v1:172.21.15.136:6789/0 conn(0x7f117c0cc900 legacy=0x7f117c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117a7fc640 1 -- 172.21.15.136:0/1030427134 >> v1:172.21.15.81:6789/0 conn(0x7f117c15e3f0 legacy=0x7f117c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200011791 0 0) 0x7f117c06cf40 con 0x7f117c15e3f0 2024-03-18T00:25:00.724 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.723+0000 7f117a7fc640 1 -- 172.21.15.136:0/1030427134 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c06d500 con 0x7f117c0ce6a0 2024-03-18T00:25:00.725 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f117a7fc640 1 --2- 172.21.15.136:0/1030427134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11700097d0 tx=0x7f117002b9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35bb1cdc4819b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170034070 con 0x7f117c0ce6a0 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1170030880 con 0x7f117c0ce6a0 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1179ffb640 1 -- 172.21.15.136:0/1030427134 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1170030c30 con 0x7f117c0ce6a0 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1181627640 1 -- 172.21.15.136:0/1030427134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 msgr2=0x7f117c0ceb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1181627640 1 --2- 172.21.15.136:0/1030427134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f11700097d0 tx=0x7f117002b9c0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1181627640 1 -- 172.21.15.136:0/1030427134 shutdown_connections 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1181627640 1 --2- 172.21.15.136:0/1030427134 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0ce6a0 0x7f117c0ceb10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.724+0000 7f1181627640 1 -- 172.21.15.136:0/1030427134 >> 172.21.15.136:0/1030427134 conn(0x7f117c0d1e20 msgr2=0x7f117c0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.725+0000 7f1181627640 1 -- 172.21.15.136:0/1030427134 shutdown_connections 2024-03-18T00:25:00.726 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.725+0000 7f1181627640 1 -- 172.21.15.136:0/1030427134 wait complete. 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.726+0000 7f1181627640 1 Processor -- start 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.726+0000 7f1181627640 1 -- start start 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 0x7f117c152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f117c15e3f0 0x7f117c160370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.729 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f117c0b3680 con 0x7f117c15e3f0 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f117c0cc470 con 0x7f117c0ce6a0 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f117c0d13a0 con 0x7f117c0cc900 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 0x7f117c152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117a7fc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33230/0 (socket says 172.21.15.136:33230) 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117a7fc640 1 -- 172.21.15.136:0/1780198145 learned_addr learned my addr 172.21.15.136:0/1780198145 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117b7fe640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f117c15e3f0 0x7f117c160370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 -- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 msgr2=0x7f117c15fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 -- 172.21.15.136:0/1780198145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f117c15e3f0 msgr2=0x7f117c160370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f117c15e3f0 0x7f117c160370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 -- 172.21.15.136:0/1780198145 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c0b2150 con 0x7f117c0cc900 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117a7fc640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:00.730 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f117affd640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 0x7f117c152190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c410 tx=0x7f116c00c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c017070 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116c0035f0 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c0b2430 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116c003a20 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.727+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c1526d0 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.728+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f116c01a070 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.728+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f116c012910 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.729+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c04f540 con 0x7f117c0cc900 2024-03-18T00:25:00.731 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.731+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f116c021070 con 0x7f117c0cc900 2024-03-18T00:25:00.758 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.758+0000 7fc983030040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T00:25:00.761 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.761+0000 7fc3804da040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T00:25:00.807 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:00.807+0000 7fc3804da040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T00:25:00.823 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.822+0000 7fc983030040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T00:25:00.832 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.831+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "257fd9a3-e594-4e73-81ad-bc398662a7aa", "id": 4} v 0) -- 0x7f117c15bd90 con 0x7f117c0cc900 2024-03-18T00:25:00.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.837+0000 7f11637fe640 1 -- 172.21.15.136:0/1780198145 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "257fd9a3-e594-4e73-81ad-bc398662a7aa", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f116c003e00 con 0x7f117c0cc900 2024-03-18T00:25:00.837 INFO:teuthology.orchestra.run.smithi136.stdout:4 2024-03-18T00:25:00.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 msgr2=0x7f117c152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 0x7f117c152190 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f116c00c410 tx=0x7f116c00c810 comp rx=0 tx=0).stop 2024-03-18T00:25:00.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 shutdown_connections 2024-03-18T00:25:00.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f117c15e3f0 0x7f117c160370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.838 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f117c0ce6a0 0x7f117c15fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 --2- 172.21.15.136:0/1780198145 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f117c0cc900 0x7f117c152190 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 >> 172.21.15.136:0/1780198145 conn(0x7f117c0d1e20 msgr2=0x7f117c15c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 shutdown_connections 2024-03-18T00:25:00.839 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.838+0000 7f1181627640 1 -- 172.21.15.136:0/1780198145 wait complete. 2024-03-18T00:25:00.849 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new 6bf1ecd1-0ded-410d-b4e8-d522113a8d20 5 2024-03-18T00:25:00.873 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:00.873+0000 7fc983030040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T00:25:00.973 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.973+0000 7f73124a1640 1 Processor -- start 2024-03-18T00:25:00.974 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.973+0000 7f73124a1640 1 -- start start 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f73124a1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f730c15b120 0x7f730c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f73124a1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 0x7f730c0cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f73124a1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f730c0cc370 con 0x7f730c071d60 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f73124a1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f730c0cc650 con 0x7f730c15b120 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f73124a1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f730c0cc930 con 0x7f730c0cd410 2024-03-18T00:25:00.975 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f7310a3e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f730c071d60 0x7f730c15ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54534/0 (socket says 172.21.15.136:54534) 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730b7fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 0x7f730c0cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f7310a3e640 1 -- 172.21.15.136:0/102419604 learned_addr learned my addr 172.21.15.136:0/102419604 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730bfff640 1 --2- 172.21.15.136:0/102419604 >> v2:172.21.15.81:3300/0 conn(0x7f730c15b120 0x7f730c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730affd640 1 -- 172.21.15.136:0/102419604 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884005912 0 0) 0x7f730c0cc370 con 0x7f730c071d60 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730affd640 1 -- 172.21.15.136:0/102419604 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72f4003520 con 0x7f730c071d60 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730b7fe640 1 -- 172.21.15.136:0/102419604 >> v2:172.21.15.81:3300/0 conn(0x7f730c15b120 msgr2=0x7f730c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730b7fe640 1 --2- 172.21.15.136:0/102419604 >> v2:172.21.15.81:3300/0 conn(0x7f730c15b120 0x7f730c0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730b7fe640 1 -- 172.21.15.136:0/102419604 >> v1:172.21.15.136:6789/0 conn(0x7f730c071d60 legacy=0x7f730c15ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.976 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.974+0000 7f730b7fe640 1 -- 172.21.15.136:0/102419604 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c0ccc10 con 0x7f730c0cd410 2024-03-18T00:25:00.977 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f730b7fe640 1 --2- 172.21.15.136:0/102419604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 0x7f730c0cf590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f73000097a0 tx=0x7f730002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98d3ef4da0ba7edb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f730affd640 1 -- 172.21.15.136:0/102419604 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73000315a0 con 0x7f730c0cd410 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f730affd640 1 -- 172.21.15.136:0/102419604 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7300037070 con 0x7f730c0cd410 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f730affd640 1 -- 172.21.15.136:0/102419604 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7300031960 con 0x7f730c0cd410 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 -- 172.21.15.136:0/102419604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 msgr2=0x7f730c0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 --2- 172.21.15.136:0/102419604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 0x7f730c0cf590 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f73000097a0 tx=0x7f730002b840 comp rx=0 tx=0).stop 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 -- 172.21.15.136:0/102419604 shutdown_connections 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 --2- 172.21.15.136:0/102419604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c0cd410 0x7f730c0cf590 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 --2- 172.21.15.136:0/102419604 >> v2:172.21.15.81:3300/0 conn(0x7f730c15b120 0x7f730c0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 -- 172.21.15.136:0/102419604 >> 172.21.15.136:0/102419604 conn(0x7f730c0d0da0 msgr2=0x7f730c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 -- 172.21.15.136:0/102419604 shutdown_connections 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.976+0000 7f73124a1640 1 -- 172.21.15.136:0/102419604 wait complete. 2024-03-18T00:25:00.978 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.977+0000 7f73124a1640 1 Processor -- start 2024-03-18T00:25:00.979 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 -- start start 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 0x7f730c0b60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 0x7f730c0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 0x7f730c0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f730c0cf1e0 con 0x7f730c0cd410 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f730c0cf060 con 0x7f730c071d60 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f73124a1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f730c0cfad0 con 0x7f730c15b120 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f730bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 0x7f730c0b60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f7310a3e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 0x7f730c0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f730bfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 0x7f730c0b60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33238/0 (socket says 172.21.15.136:33238) 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.978+0000 7f730bfff640 1 -- 172.21.15.136:0/2793947543 learned_addr learned my addr 172.21.15.136:0/2793947543 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f730b7fe640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 0x7f730c0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:00.981 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 -- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 msgr2=0x7f730c0b60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 0x7f730c0b60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 -- 172.21.15.136:0/2793947543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 msgr2=0x7f730c0c7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 0x7f730c0c7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 -- 172.21.15.136:0/2793947543 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c0c9f30 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f730b7fe640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 0x7f730c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7310a3e640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 0x7f730c0c83b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f730400ca50 tx=0x7f730400cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304017070 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f730400abb0 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c0ca210 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304012400 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c0b6600 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f730401a070 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.979+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f730401cd30 con 0x7f730c15b120 2024-03-18T00:25:00.982 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.980+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c04f540 con 0x7f730c15b120 2024-03-18T00:25:00.983 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:00.982+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f730401c7b0 con 0x7f730c15b120 2024-03-18T00:25:01.055 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.054+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "6bf1ecd1-0ded-410d-b4e8-d522113a8d20", "id": 5} v 0) -- 0x7f730c15fa70 con 0x7f730c15b120 2024-03-18T00:25:01.060 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f7308ff9640 1 -- 172.21.15.136:0/2793947543 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6bf1ecd1-0ded-410d-b4e8-d522113a8d20", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f730401ca80 con 0x7f730c15b120 2024-03-18T00:25:01.060 INFO:teuthology.orchestra.run.smithi136.stdout:5 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 msgr2=0x7f730c0c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 0x7f730c0c83b0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f730400ca50 tx=0x7f730400cf10 comp rx=0 tx=0).stop 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 shutdown_connections 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f730c15b120 0x7f730c0c83b0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f730c0cd410 0x7f730c0c7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 --2- 172.21.15.136:0/2793947543 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f730c071d60 0x7f730c0b60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.060+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 >> 172.21.15.136:0/2793947543 conn(0x7f730c0d0da0 msgr2=0x7f730c0d0550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.061 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.061+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 shutdown_connections 2024-03-18T00:25:01.062 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.061+0000 7f73124a1640 1 -- 172.21.15.136:0/2793947543 wait complete. 2024-03-18T00:25:01.071 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new bb68e6b0-8faf-465e-a370-3bfe99a965ce 6 2024-03-18T00:25:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 Processor -- start 2024-03-18T00:25:01.172 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 -- start start 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600cce20 con 0x7f70600ce840 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600cd100 con 0x7f70600ceca0 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.172+0000 7f706504d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f70600cd3e0 con 0x7f706015c140 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705f59e640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f70600ceca0 0x7f70600b4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.136:54548/0 (socket says 172.21.15.136:54548) 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705f59e640 1 -- 172.21.15.136:0/4241944978 learned_addr learned my addr 172.21.15.136:0/4241944978 (peer_addr_for_me v1:172.21.15.136:0/0) 2024-03-18T00:25:01.174 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705ed9d640 1 --2- 172.21.15.136:0/4241944978 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705dd9b640 1 -- 172.21.15.136:0/4241944978 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203107242 0 0) 0x7f70600cd100 con 0x7f70600ceca0 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705dd9b640 1 -- 172.21.15.136:0/4241944978 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7048003520 con 0x7f70600ceca0 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705ed9d640 1 -- 172.21.15.136:0/4241944978 >> v1:172.21.15.136:6789/0 conn(0x7f70600ceca0 legacy=0x7f70600b4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705ed9d640 1 -- 172.21.15.136:0/4241944978 >> v1:172.21.15.81:6789/0 conn(0x7f70600ce840 legacy=0x7f70600b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.173+0000 7f705ed9d640 1 -- 172.21.15.136:0/4241944978 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600cd6c0 con 0x7f706015c140 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f705ed9d640 1 --2- 172.21.15.136:0/4241944978 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600d08c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f70500097d0 tx=0x7f705002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=750ebb66e029a117 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f705dd9b640 1 -- 172.21.15.136:0/4241944978 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050035020 con 0x7f706015c140 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f705dd9b640 1 -- 172.21.15.136:0/4241944978 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050031890 con 0x7f706015c140 2024-03-18T00:25:01.175 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f705dd9b640 1 -- 172.21.15.136:0/4241944978 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050031c60 con 0x7f706015c140 2024-03-18T00:25:01.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 -- 172.21.15.136:0/4241944978 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 msgr2=0x7f70600d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 --2- 172.21.15.136:0/4241944978 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600d08c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f70500097d0 tx=0x7f705002b930 comp rx=0 tx=0).stop 2024-03-18T00:25:01.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 -- 172.21.15.136:0/4241944978 shutdown_connections 2024-03-18T00:25:01.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 --2- 172.21.15.136:0/4241944978 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600d08c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.176 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 -- 172.21.15.136:0/4241944978 >> 172.21.15.136:0/4241944978 conn(0x7f706009b160 msgr2=0x7f70600d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 -- 172.21.15.136:0/4241944978 shutdown_connections 2024-03-18T00:25:01.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.174+0000 7f706504d640 1 -- 172.21.15.136:0/4241944978 wait complete. 2024-03-18T00:25:01.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.176+0000 7f706504d640 1 Processor -- start 2024-03-18T00:25:01.177 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.176+0000 7f706504d640 1 -- start start 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70600ceca0 0x7f70600b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70600d0e00 con 0x7f70600ceca0 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f70600cf130 con 0x7f70600ce840 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f70600d2710 con 0x7f706015c140 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705f59e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.179 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.136:33254/0 (socket says 172.21.15.136:33254) 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 -- 172.21.15.136:0/1601180953 learned_addr learned my addr 172.21.15.136:0/1601180953 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705e59c640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70600ceca0 0x7f70600b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 -- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 msgr2=0x7f70600b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 -- 172.21.15.136:0/1601180953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70600ceca0 msgr2=0x7f70600b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70600ceca0 0x7f70600b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 -- 172.21.15.136:0/1601180953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7060144a10 con 0x7f70600ce840 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705f59e640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f705ed9d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f70500046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050035040 con 0x7f70600ce840 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7050030b10 con 0x7f70600ce840 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70600c7600 con 0x7f70600ce840 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.177+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7050044430 con 0x7f70600ce840 2024-03-18T00:25:01.180 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.178+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7060144cb0 con 0x7f70600ce840 2024-03-18T00:25:01.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.178+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7050038020 con 0x7f70600ce840 2024-03-18T00:25:01.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.178+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f705003ba20 con 0x7f70600ce840 2024-03-18T00:25:01.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.178+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f706004f540 con 0x7f70600ce840 2024-03-18T00:25:01.181 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.180+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f705002d040 con 0x7f70600ce840 2024-03-18T00:25:01.181 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.181+0000 7fc3804da040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-18T00:25:01.253 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.253+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bb68e6b0-8faf-465e-a370-3bfe99a965ce", "id": 6} v 0) -- 0x7f70600ce620 con 0x7f70600ce840 2024-03-18T00:25:01.259 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.259+0000 7f70477fe640 1 -- 172.21.15.136:0/1601180953 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bb68e6b0-8faf-465e-a370-3bfe99a965ce", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f705003bcc0 con 0x7f70600ce840 2024-03-18T00:25:01.260 INFO:teuthology.orchestra.run.smithi136.stdout:6 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 msgr2=0x7f70600c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f70500098f0 tx=0x7f70500046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 shutdown_connections 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f706015c140 0x7f70600b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70600ceca0 0x7f70600b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 --2- 172.21.15.136:0/1601180953 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f70600ce840 0x7f70600c4810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 >> 172.21.15.136:0/1601180953 conn(0x7f706009b160 msgr2=0x7f706015a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.261 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 shutdown_connections 2024-03-18T00:25:01.262 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.260+0000 7f706504d640 1 -- 172.21.15.136:0/1601180953 wait complete. 2024-03-18T00:25:01.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo ceph --cluster ceph osd new e0a2b0d1-4b40-4946-8042-870c4989b8b2 7 2024-03-18T00:25:01.274 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.274+0000 7fc983030040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-18T00:25:01.315 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.315+0000 7fc3804da040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T00:25:01.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.371+0000 7fac17b77640 1 Processor -- start 2024-03-18T00:25:01.371 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.371+0000 7fac17b77640 1 -- start start 2024-03-18T00:25:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 0x7fac100ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac1006b700 0x7fac1006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.375 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fac10072af0 con 0x7fac100b0150 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fac10071ee0 con 0x7fac1006b700 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac17b77640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac100721c0 con 0x7fac100ceeb0 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15112640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fac1006b700 0x7fac1006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15112640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50306/0 (socket says 172.21.15.136:50306) 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15112640 1 -- 172.21.15.136:0/634023560 learned_addr learned my addr 172.21.15.136:0/634023560 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15913640 1 --2- 172.21.15.136:0/634023560 >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 0x7fac100ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 -- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 msgr2=0x7fac1006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:01.376 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 -- 172.21.15.136:0/634023560 >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 msgr2=0x7fac100ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 --2- 172.21.15.136:0/634023560 >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 0x7fac100ce970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac16114640 1 -- 172.21.15.136:0/634023560 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac100724a0 con 0x7fac1006b700 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15112640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.372+0000 7fac15913640 1 --2- 172.21.15.136:0/634023560 >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 0x7fac100ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.373+0000 7fac16114640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1006b700 0x7fac1006ddc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac10072ed0 tx=0x7fac0802bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20cb1e9f6b62dbe5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.373+0000 7fac14911640 1 -- 172.21.15.136:0/634023560 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08039070 con 0x7fac1006b700 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.373+0000 7fac14911640 1 -- 172.21.15.136:0/634023560 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0802cb40 con 0x7fac1006b700 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.373+0000 7fac14911640 1 -- 172.21.15.136:0/634023560 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac08034440 con 0x7fac1006b700 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 -- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1006b700 msgr2=0x7fac1006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1006b700 0x7fac1006ddc0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fac10072ed0 tx=0x7fac0802bd90 comp rx=0 tx=0).stop 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 -- 172.21.15.136:0/634023560 shutdown_connections 2024-03-18T00:25:01.377 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac1006b700 0x7fac1006ddc0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 --2- 172.21.15.136:0/634023560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac100ceeb0 0x7fac1006b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 --2- 172.21.15.136:0/634023560 >> v2:172.21.15.81:3300/0 conn(0x7fac100b0150 0x7fac100ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 -- 172.21.15.136:0/634023560 >> 172.21.15.136:0/634023560 conn(0x7fac100d0da0 msgr2=0x7fac100d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 -- 172.21.15.136:0/634023560 shutdown_connections 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.374+0000 7fac17b77640 1 -- 172.21.15.136:0/634023560 wait complete. 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.375+0000 7fac17b77640 1 Processor -- start 2024-03-18T00:25:01.378 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.375+0000 7fac17b77640 1 -- start start 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac100b0150 0x7fac101db990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 0x7fac101e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac100b0530 con 0x7fac100b0150 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac100d0900 con 0x7fac100ceeb0 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac17b77640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac100b06b0 con 0x7fac1006b700 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac16114640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 0x7fac101e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.136:50314/0 (socket says 172.21.15.136:50314) 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 -- 172.21.15.136:0/3912353014 learned_addr learned my addr 172.21.15.136:0/3912353014 (peer_addr_for_me v2:172.21.15.136:0/0) 2024-03-18T00:25:01.381 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15112640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac100b0150 0x7fac101db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 -- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 msgr2=0x7fac101e6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 0x7fac101e6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 -- 172.21.15.136:0/3912353014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac100b0150 msgr2=0x7fac101db990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac100b0150 0x7fac101db990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 -- 172.21.15.136:0/3912353014 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac101e87d0 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac16114640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 0x7fac101e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac15913640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00e810 tx=0x7fac0c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00f040 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.376+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac0c004030 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac101e7940 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac0c004400 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac101e7f00 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac0c00ca60 con 0x7fac1006b700 2024-03-18T00:25:01.382 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fac0c013a70 con 0x7fac1006b700 2024-03-18T00:25:01.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.377+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac1004f540 con 0x7fac1006b700 2024-03-18T00:25:01.383 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.379+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fac0c017020 con 0x7fac1006b700 2024-03-18T00:25:01.415 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.415+0000 7fc983030040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T00:25:01.433 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.433+0000 7fc3804da040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T00:25:01.451 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.450+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e0a2b0d1-4b40-4946-8042-870c4989b8b2", "id": 7} v 0) -- 0x7fac101d7560 con 0x7fac1006b700 2024-03-18T00:25:01.457 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.456+0000 7fac067fc640 1 -- 172.21.15.136:0/3912353014 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0a2b0d1-4b40-4946-8042-870c4989b8b2", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fac0c013d90 con 0x7fac1006b700 2024-03-18T00:25:01.457 INFO:teuthology.orchestra.run.smithi136.stdout:7 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 msgr2=0x7fac101db450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00e810 tx=0x7fac0c00ecd0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 shutdown_connections 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac100ceeb0 0x7fac101e6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac100b0150 0x7fac101db990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.458 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 --2- 172.21.15.136:0/3912353014 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac1006b700 0x7fac101db450 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 >> 172.21.15.136:0/3912353014 conn(0x7fac100d0da0 msgr2=0x7fac101dc280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 shutdown_connections 2024-03-18T00:25:01.459 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:01.457+0000 7fac17b77640 1 -- 172.21.15.136:0/3912353014 wait complete. 2024-03-18T00:25:01.468 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-18T00:25:01.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-18T00:25:01.471 INFO:tasks.ceph.osd.0:Started 2024-03-18T00:25:01.471 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-18T00:25:01.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-18T00:25:01.473 INFO:tasks.ceph.osd.1:Started 2024-03-18T00:25:01.473 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-18T00:25:01.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-18T00:25:01.475 INFO:tasks.ceph.osd.2:Started 2024-03-18T00:25:01.475 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-18T00:25:01.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-18T00:25:01.478 INFO:tasks.ceph.osd.3:Started 2024-03-18T00:25:01.478 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-18T00:25:01.478 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-18T00:25:01.481 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.481+0000 7fc3804da040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T00:25:01.510 INFO:tasks.ceph.osd.4:Started 2024-03-18T00:25:01.511 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-18T00:25:01.511 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-18T00:25:01.513 INFO:tasks.ceph.osd.5:Started 2024-03-18T00:25:01.513 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-18T00:25:01.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-18T00:25:01.515 INFO:tasks.ceph.osd.6:Started 2024-03-18T00:25:01.515 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-18T00:25:01.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-18T00:25:01.519 INFO:tasks.ceph.osd.7:Started 2024-03-18T00:25:01.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:01.543 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.543+0000 7fc983030040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T00:25:01.612 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.612+0000 7fc983030040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T00:25:01.625 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.625+0000 7fc3804da040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.632+0000 7fab62a0b640 1 Processor -- start 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.632+0000 7fab62a0b640 1 -- start start 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab62a0b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab5c0cf3f0 0x7fab5c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab62a0b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab5c0b44c0 0x7fab5c0b4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab62a0b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab5c06ef10 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab62a0b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c06f1c0 con 0x7fab5c0b44c0 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab62a0b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fab5c06f4a0 con 0x7fab5c0cf3f0 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab60fa8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab5c0b44c0 0x7fab5c0b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab5bfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fab5c0b3ba0 0x7fab5c06e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57328/0 (socket says 172.21.15.81:57328) 2024-03-18T00:25:01.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab60fa8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab5c0b44c0 0x7fab5c0b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33790/0 (socket says 172.21.15.81:33790) 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab5bfff640 1 -- 172.21.15.81:0/3486266230 learned_addr learned my addr 172.21.15.81:0/3486266230 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.633+0000 7fab5b7fe640 1 --2- 172.21.15.81:0/3486266230 >> v2:172.21.15.136:3300/0 conn(0x7fab5c0cf3f0 0x7fab5c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.634+0000 7fab60fa8640 1 -- 172.21.15.81:0/3486266230 >> v2:172.21.15.136:3300/0 conn(0x7fab5c0cf3f0 msgr2=0x7fab5c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.634+0000 7fab60fa8640 1 --2- 172.21.15.81:0/3486266230 >> v2:172.21.15.136:3300/0 conn(0x7fab5c0cf3f0 0x7fab5c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.634+0000 7fab60fa8640 1 -- 172.21.15.81:0/3486266230 >> v1:172.21.15.81:6789/0 conn(0x7fab5c0b3ba0 legacy=0x7fab5c06e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.634+0000 7fab5affd640 1 -- 172.21.15.81:0/3486266230 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189767762 0 0) 0x7fab5c06ef10 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.634+0000 7fab60fa8640 1 -- 172.21.15.81:0/3486266230 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c06f780 con 0x7fab5c0b44c0 2024-03-18T00:25:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab60fa8640 1 --2- 172.21.15.81:0/3486266230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b44c0 0x7fab5c0b4930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fab5c15ea70 tx=0x7fab5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f10038a2c9ad22 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab5affd640 1 -- 172.21.15.81:0/3486266230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54039070 con 0x7fab5c0b44c0 2024-03-18T00:25:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab5affd640 1 -- 172.21.15.81:0/3486266230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5402cc80 con 0x7fab5c0b44c0 2024-03-18T00:25:01.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab5affd640 1 -- 172.21.15.81:0/3486266230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab54034660 con 0x7fab5c0b44c0 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 -- 172.21.15.81:0/3486266230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b44c0 msgr2=0x7fab5c0b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 --2- 172.21.15.81:0/3486266230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b44c0 0x7fab5c0b4930 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fab5c15ea70 tx=0x7fab5402bed0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 -- 172.21.15.81:0/3486266230 shutdown_connections 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 --2- 172.21.15.81:0/3486266230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b44c0 0x7fab5c0b4930 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 --2- 172.21.15.81:0/3486266230 >> v2:172.21.15.136:3300/0 conn(0x7fab5c0cf3f0 0x7fab5c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.635+0000 7fab62a0b640 1 -- 172.21.15.81:0/3486266230 >> 172.21.15.81:0/3486266230 conn(0x7fab5c0d0d30 msgr2=0x7fab5c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.636+0000 7fab62a0b640 1 -- 172.21.15.81:0/3486266230 shutdown_connections 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.636+0000 7fab62a0b640 1 -- 172.21.15.81:0/3486266230 wait complete. 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.637+0000 7fab62a0b640 1 Processor -- start 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.637+0000 7fab62a0b640 1 -- start start 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab5c0b44c0 0x7fab5c13fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab5c0cf3f0 0x7fab5c1e03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:01.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c144b00 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab5c06fd40 con 0x7fab5c0cf3f0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fab5c144c80 con 0x7fab5c0b44c0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33794/0 (socket says 172.21.15.81:33794) 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 -- 172.21.15.81:0/1524708776 learned_addr learned my addr 172.21.15.81:0/1524708776 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab60fa8640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab5c0cf3f0 0x7fab5c1e03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5b7fe640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab5c0b44c0 0x7fab5c13fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 -- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab5c0b44c0 msgr2=0x7fab5c13fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab5c0b44c0 0x7fab5c13fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 -- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab5c0cf3f0 msgr2=0x7fab5c1e03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab5c0cf3f0 0x7fab5c1e03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 -- 172.21.15.81:0/1524708776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab5c1402f0 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab5bfff640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c500 tx=0x7fab4c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:01.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c018070 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab4c007580 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab5c1405d0 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab4c004a20 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.638+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab5c140b90 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.639+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fab4c01b070 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.639+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fab4c012ad0 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.640+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab5c04f5b0 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.642+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fab4c01d440 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.702+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab5c073070 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.702+0000 7fab58ff9640 1 -- 172.21.15.81:0/1524708776 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fab4c01d6e0 con 0x7fab5c0b3ba0 2024-03-18T00:25:01.703 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:01.703 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:01.452616+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 msgr2=0x7fab5c141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c500 tx=0x7fab4c00c9c0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 shutdown_connections 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab5c0cf3f0 0x7fab5c1e03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab5c0b44c0 0x7fab5c13fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 --2- 172.21.15.81:0/1524708776 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab5c0b3ba0 0x7fab5c141390 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 >> 172.21.15.81:0/1524708776 conn(0x7fab5c0d0d30 msgr2=0x7fab5c143bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 shutdown_connections 2024-03-18T00:25:01.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:01.703+0000 7fab62a0b640 1 -- 172.21.15.81:0/1524708776 wait complete. 2024-03-18T00:25:01.714 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-18T00:25:01.714 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-18T00:25:01.725 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.724+0000 7fc983030040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T00:25:01.726 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.725+0000 7fc3804da040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T00:25:01.820 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.819+0000 7fc983030040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T00:25:01.883 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.883+0000 7fc3804da040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T00:25:01.926 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:01.926+0000 7fc3804da040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T00:25:01.976 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:01.976+0000 7fc983030040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T00:25:02.018 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:02.018+0000 7fc983030040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T00:25:02.080 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:02.079+0000 7fc3804da040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T00:25:02.091 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T00:25:02.090+0000 7fb307c68640 -1 Falling back to public interface 2024-03-18T00:25:02.091 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T00:25:02.090+0000 7f7e8d016640 -1 Falling back to public interface 2024-03-18T00:25:02.091 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T00:25:02.090+0000 7fb306c17640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-03-18T00:25:02.091 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T00:25:02.090+0000 7f7e8ba05640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6802/0: (98) Address already in use 2024-03-18T00:25:02.094 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T00:25:02.094+0000 7f221edac640 -1 Falling back to public interface 2024-03-18T00:25:02.102 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T00:25:02.102+0000 7f9520728640 -1 Falling back to public interface 2024-03-18T00:25:02.114 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T00:25:02.113+0000 7f66efb73640 -1 Falling back to public interface 2024-03-18T00:25:02.118 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T00:25:02.118+0000 7f23e960c640 -1 Falling back to public interface 2024-03-18T00:25:02.119 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T00:25:02.119+0000 7f5aec106640 -1 Falling back to public interface 2024-03-18T00:25:02.128 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T00:25:02.127+0000 7f5d4700c640 -1 Falling back to public interface 2024-03-18T00:25:02.182 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:02.182+0000 7fc983030040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T00:25:02.521 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:02.611 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.610+0000 7f3251863640 1 Processor -- start 2024-03-18T00:25:02.611 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.610+0000 7f3251863640 1 -- start start 2024-03-18T00:25:02.612 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f3251863640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f324c0b60a0 0x7f324c06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:02.612 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f3251863640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324c0b6480 con 0x7f324c0cf780 2024-03-18T00:25:02.612 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f3251863640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324c15aa00 con 0x7f324c06ea30 2024-03-18T00:25:02.612 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f3251863640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f324c06c230 con 0x7f324c0b60a0 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f324b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f324c0cf780 0x7f324c0b3880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:57340/0 (socket says 172.21.15.81:57340) 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f324b7fe640 1 -- 172.21.15.81:0/1381474731 learned_addr learned my addr 172.21.15.81:0/1381474731 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.611+0000 7f324affd640 1 --2- 172.21.15.81:0/1381474731 >> v2:172.21.15.136:3300/0 conn(0x7f324c0b60a0 0x7f324c06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769524724 0 0) 0x7f324c0b6480 con 0x7f324c0cf780 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3238003520 con 0x7f324c0cf780 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3043802980 0 0) 0x7f3238003520 con 0x7f324c0cf780 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f324affd640 1 -- 172.21.15.81:0/1381474731 >> v1:172.21.15.136:6789/0 conn(0x7f324c06ea30 legacy=0x7f324c0cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f324affd640 1 -- 172.21.15.81:0/1381474731 >> v1:172.21.15.81:6789/0 conn(0x7f324c0cf780 legacy=0x7f324c0b3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.613 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.612+0000 7f324affd640 1 -- 172.21.15.81:0/1381474731 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c06b620 con 0x7f324c0b60a0 2024-03-18T00:25:02.614 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f324affd640 1 --2- 172.21.15.81:0/1381474731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0b60a0 0x7f324c06c6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f324402b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d94ad6361ddd38 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244037070 con 0x7f324c0b60a0 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244030510 con 0x7f324c0b60a0 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3249ffb640 1 -- 172.21.15.81:0/1381474731 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0019f0 con 0x7f324c0b60a0 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 -- 172.21.15.81:0/1381474731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0b60a0 msgr2=0x7f324c06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 --2- 172.21.15.81:0/1381474731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0b60a0 0x7f324c06c6c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f32440097a0 tx=0x7f324402b790 comp rx=0 tx=0).stop 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 -- 172.21.15.81:0/1381474731 shutdown_connections 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 --2- 172.21.15.81:0/1381474731 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0b60a0 0x7f324c06c6c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 -- 172.21.15.81:0/1381474731 >> 172.21.15.81:0/1381474731 conn(0x7f324c0cd010 msgr2=0x7f324c0cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 -- 172.21.15.81:0/1381474731 shutdown_connections 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.613+0000 7f3251863640 1 -- 172.21.15.81:0/1381474731 wait complete. 2024-03-18T00:25:02.615 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.614+0000 7f3251863640 1 Processor -- start 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 -- start start 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324c0b60a0 0x7f324c166540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0cf780 0x7f324c166a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f324c06bec0 con 0x7f324c06ea30 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f324c06bbe0 con 0x7f324c0cf780 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f3251863640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f324c06b1d0 con 0x7f324c0b60a0 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f324affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f324affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33806/0 (socket says 172.21.15.81:33806) 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.615+0000 7f324affd640 1 -- 172.21.15.81:0/3672929788 learned_addr learned my addr 172.21.15.81:0/3672929788 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:02.618 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324a7fc640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324c0b60a0 0x7f324c166540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324b7fe640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0cf780 0x7f324c166a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 -- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324c0b60a0 msgr2=0x7f324c166540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324c0b60a0 0x7f324c166540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 -- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0cf780 msgr2=0x7f324c166a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0cf780 0x7f324c166a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 -- 172.21.15.81:0/3672929788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c157b00 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f324affd640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3244035040 tx=0x7f32440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244042070 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3244004220 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244037040 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324c157de0 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324c1583a0 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f324403a040 con 0x7f324c06ea30 2024-03-18T00:25:02.619 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.616+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f3244003ce0 con 0x7f324c06ea30 2024-03-18T00:25:02.620 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.617+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324c04f540 con 0x7f324c06ea30 2024-03-18T00:25:02.620 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.619+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f324403e670 con 0x7f324c06ea30 2024-03-18T00:25:02.684 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.684+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f324c159840 con 0x7f324c06ea30 2024-03-18T00:25:02.685 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.684+0000 7f3243fff640 1 -- 172.21.15.81:0/3672929788 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f324403e850 con 0x7f324c06ea30 2024-03-18T00:25:02.685 INFO:teuthology.misc.health.smithi081.stdout: 2024-03-18T00:25:02.685 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:01.452616+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:02.686 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 msgr2=0x7f324c137740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:02.686 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3244035040 tx=0x7f32440046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.686 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 shutdown_connections 2024-03-18T00:25:02.686 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324c0cf780 0x7f324c166a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.687 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324c0b60a0 0x7f324c166540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.687 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 --2- 172.21.15.81:0/3672929788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f324c06ea30 0x7f324c137740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:02.687 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.685+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 >> 172.21.15.81:0/3672929788 conn(0x7f324c0cd010 msgr2=0x7f324c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:02.687 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.686+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 shutdown_connections 2024-03-18T00:25:02.687 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:02.686+0000 7f3251863640 1 -- 172.21.15.81:0/3672929788 wait complete. 2024-03-18T00:25:02.695 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-18T00:25:02.894 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:02.893+0000 7fc3804da040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T00:25:03.012 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:03.012+0000 7fc983030040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T00:25:03.169 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:03.169+0000 7fc3804da040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T00:25:03.223 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:03.222+0000 7fc3804da040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T00:25:03.292 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:03.292+0000 7fc983030040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T00:25:03.336 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:03.336+0000 7fc3804da040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T00:25:03.344 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:03.344+0000 7fc983030040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T00:25:03.465 INFO:tasks.ceph.mgr.x.smithi136.stderr:2024-03-18T00:25:03.465+0000 7fc983030040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T00:25:04.362 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:04.361+0000 7fc321902640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-18T00:25:04.362 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-03-18T00:25:04.362+0000 7fc321902640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-18T00:25:05.617 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T00:25:05.616+0000 7f221edac640 -1 osd.2 0 log_to_monitors true 2024-03-18T00:25:05.627 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T00:25:05.626+0000 7f7e8d016640 -1 osd.0 0 log_to_monitors true 2024-03-18T00:25:05.632 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T00:25:05.632+0000 7f9520728640 -1 osd.3 0 log_to_monitors true 2024-03-18T00:25:05.632 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T00:25:05.632+0000 7fb307c68640 -1 osd.1 0 log_to_monitors true 2024-03-18T00:25:05.647 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T00:25:05.647+0000 7f5aec106640 -1 osd.6 0 log_to_monitors true 2024-03-18T00:25:05.653 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T00:25:05.653+0000 7f66efb73640 -1 osd.4 0 log_to_monitors true 2024-03-18T00:25:05.658 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T00:25:05.658+0000 7f5d4700c640 -1 osd.5 0 log_to_monitors true 2024-03-18T00:25:05.658 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T00:25:05.658+0000 7f23e960c640 -1 osd.7 0 log_to_monitors true 2024-03-18T00:25:08.847 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T00:25:08.847+0000 7f5ae809c640 -1 osd.6 0 waiting for initial osdmap 2024-03-18T00:25:08.859 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T00:25:08.859+0000 7f66ebb09640 -1 osd.4 0 waiting for initial osdmap 2024-03-18T00:25:08.861 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T00:25:08.861+0000 7f5adfebc640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:08.867 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T00:25:08.867+0000 7f23e4f7d640 -1 osd.7 0 waiting for initial osdmap 2024-03-18T00:25:08.872 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T00:25:08.872+0000 7f66e3929640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:08.878 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T00:25:08.878+0000 7f23dcd9d640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:08.884 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T00:25:08.884+0000 7f5d4297d640 -1 osd.5 0 waiting for initial osdmap 2024-03-18T00:25:08.900 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T00:25:08.900+0000 7f5d3a79d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:09.430 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T00:25:09.430+0000 7fb303bfe640 -1 osd.1 0 waiting for initial osdmap 2024-03-18T00:25:09.446 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T00:25:09.446+0000 7fb2fba1e640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:09.459 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T00:25:09.459+0000 7f7e89200640 -1 osd.0 0 waiting for initial osdmap 2024-03-18T00:25:09.463 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T00:25:09.462+0000 7f951c6be640 -1 osd.3 0 waiting for initial osdmap 2024-03-18T00:25:09.473 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T00:25:09.473+0000 7f7e8080c640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:09.480 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T00:25:09.480+0000 7f95144de640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:09.486 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T00:25:09.486+0000 7f221ad42640 -1 osd.2 0 waiting for initial osdmap 2024-03-18T00:25:09.500 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T00:25:09.500+0000 7f2212b62640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T00:25:09.502 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:09.590 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.589+0000 7fcd5d9b3640 1 Processor -- start 2024-03-18T00:25:09.590 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.589+0000 7fcd5d9b3640 1 -- start start 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd5d9b3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 0x7fcd5806fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd5d9b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd580b4540 0x7fcd580d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd5d9b3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd58070390 con 0x7fcd5809a990 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd5d9b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcd5815e900 con 0x7fcd580b4540 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd5d9b3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fcd58070670 con 0x7fcd5815e520 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd4ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd580b4540 0x7fcd580d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd4ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcd580b4540 0x7fcd580d0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53154/0 (socket says 172.21.15.81:53154) 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd4ffff640 1 -- 172.21.15.81:0/1254582931 learned_addr learned my addr 172.21.15.81:0/1254582931 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd4ffff640 1 -- 172.21.15.81:0/1254582931 >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 msgr2=0x7fcd5806fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.590+0000 7fcd56ffd640 1 --2- 172.21.15.81:0/1254582931 >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 0x7fcd5806fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.592 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1254582931 >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 0x7fcd5806fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd4ffff640 1 -- 172.21.15.81:0/1254582931 >> v1:172.21.15.136:6789/0 conn(0x7fcd5809a990 legacy=0x7fcd580cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd4ffff640 1 -- 172.21.15.81:0/1254582931 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd580d0410 con 0x7fcd580b4540 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd56ffd640 1 --2- 172.21.15.81:0/1254582931 >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 0x7fcd5806fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1254582931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd580b4540 0x7fcd580d0ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd58072ac0 tx=0x7fcd4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df05defa78d57bd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd567fc640 1 -- 172.21.15.81:0/1254582931 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40035020 con 0x7fcd580b4540 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd567fc640 1 -- 172.21.15.81:0/1254582931 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd40031870 con 0x7fcd580b4540 2024-03-18T00:25:09.593 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.591+0000 7fcd567fc640 1 -- 172.21.15.81:0/1254582931 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd40031c40 con 0x7fcd580b4540 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1254582931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd580b4540 msgr2=0x7fcd580d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1254582931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd580b4540 0x7fcd580d0ef0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fcd58072ac0 tx=0x7fcd4002b910 comp rx=0 tx=0).stop 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1254582931 shutdown_connections 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1254582931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd580b4540 0x7fcd580d0ef0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1254582931 >> v2:172.21.15.136:3300/0 conn(0x7fcd5815e520 0x7fcd5806fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1254582931 >> 172.21.15.81:0/1254582931 conn(0x7fcd580b3a20 msgr2=0x7fcd580b3e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1254582931 shutdown_connections 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.592+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1254582931 wait complete. 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.593+0000 7fcd5d9b3640 1 Processor -- start 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.593+0000 7fcd5d9b3640 1 -- start start 2024-03-18T00:25:09.596 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 0x7fcd580aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd5815e520 0x7fcd580b29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd580d0a60 con 0x7fcd5809a990 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcd58070150 con 0x7fcd5815e520 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd5d9b3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcd580d00c0 con 0x7fcd580b4540 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53156/0 (socket says 172.21.15.81:53156) 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 -- 172.21.15.81:0/1093942965 learned_addr learned my addr 172.21.15.81:0/1093942965 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd577fe640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd5815e520 0x7fcd580b29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 0x7fcd580aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 -- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 msgr2=0x7fcd580aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 0x7fcd580aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 -- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd5815e520 msgr2=0x7fcd580b29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:09.597 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd5815e520 0x7fcd580b29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 -- 172.21.15.81:0/1093942965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd580af530 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 0x7fcd580aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd56ffd640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c7f0 tx=0x7fcd4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.594+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48015070 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.595+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd48007820 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.595+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd48007bd0 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.595+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd580af810 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.595+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd580c6be0 con 0x7fcd5809a990 2024-03-18T00:25:09.598 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.596+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd5804f540 con 0x7fcd5809a990 2024-03-18T00:25:09.599 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.596+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 90080+0+0 (secure 0 0 0) 0x7fcd48018070 con 0x7fcd5809a990 2024-03-18T00:25:09.599 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.596+0000 7fcd54ff9640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 0x7fcd3806e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:09.599 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.596+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fcd48089c50 con 0x7fcd5809a990 2024-03-18T00:25:09.599 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.596+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 0x7fcd3806e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:09.599 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.597+0000 7fcd4ffff640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 0x7fcd3806e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd40036000 tx=0x7fcd40008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:09.601 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.601+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fcd48059640 con 0x7fcd5809a990 2024-03-18T00:25:09.774 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.774+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd581562d0 con 0x7fcd5809a990 2024-03-18T00:25:09.775 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.774+0000 7fcd54ff9640 1 -- 172.21.15.81:0/1093942965 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fcd4805ce50 con 0x7fcd5809a990 2024-03-18T00:25:09.775 INFO:teuthology.misc.health.smithi081.stdout: 2024-03-18T00:25:09.775 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":12,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:07.363235+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 msgr2=0x7fcd3806e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 0x7fcd3806e000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd40036000 tx=0x7fcd40008030 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 msgr2=0x7fcd58155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800c7f0 tx=0x7fcd4800ccb0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 shutdown_connections 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcd5815e520 0x7fcd580b29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcd580b4540 0x7fcd580aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcd3806bb40 0x7fcd3806e000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 --2- 172.21.15.81:0/1093942965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd5809a990 0x7fcd58155d90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 >> 172.21.15.81:0/1093942965 conn(0x7fcd580b3a20 msgr2=0x7fcd5806c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 shutdown_connections 2024-03-18T00:25:09.777 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:09.776+0000 7fcd5d9b3640 1 -- 172.21.15.81:0/1093942965 wait complete. 2024-03-18T00:25:09.786 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-18T00:25:16.593 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:16.694 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.693+0000 7f2b328a0640 1 Processor -- start 2024-03-18T00:25:16.694 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 -- start start 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c15c100 0x7f2b2c0ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c4e0 0x7f2b2c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 0x7f2b2c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c0cedc0 con 0x7f2b2c15c100 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2b2c0cf0a0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b328a0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0cf380 con 0x7f2b2c15c4e0 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.694+0000 7f2b2bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c15c100 0x7f2b2c0ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2b2c15c100 0x7f2b2c0ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57354/0 (socket says 172.21.15.81:57354) 2024-03-18T00:25:16.696 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 -- 172.21.15.81:0/72061612 learned_addr learned my addr 172.21.15.81:0/72061612 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c4e0 0x7f2b2c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b30e3d640 1 --2- 172.21.15.81:0/72061612 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 0x7f2b2c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 -- 172.21.15.81:0/72061612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c4e0 msgr2=0x7f2b2c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c4e0 0x7f2b2c0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 -- 172.21.15.81:0/72061612 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 msgr2=0x7f2b2c0b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/72061612 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 0x7f2b2c0b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b2bfff640 1 -- 172.21.15.81:0/72061612 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0cf660 con 0x7f2b2c15c100 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.695+0000 7f2b30e3d640 1 --2- 172.21.15.81:0/72061612 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 0x7f2b2c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c15c100 0x7f2b2c0ce590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0cc550 tx=0x7f2b1c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c9f79ad4185447 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b2affd640 1 -- 172.21.15.81:0/72061612 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02e070 con 0x7f2b2c15c100 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b2affd640 1 -- 172.21.15.81:0/72061612 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c037070 con 0x7f2b2c15c100 2024-03-18T00:25:16.697 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b2affd640 1 -- 172.21.15.81:0/72061612 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c031a00 con 0x7f2b2c15c100 2024-03-18T00:25:16.700 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 -- 172.21.15.81:0/72061612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c15c100 msgr2=0x7f2b2c0ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:16.700 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c15c100 0x7f2b2c0ce590 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b2c0cc550 tx=0x7f2b1c02b880 comp rx=0 tx=0).stop 2024-03-18T00:25:16.700 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 -- 172.21.15.81:0/72061612 shutdown_connections 2024-03-18T00:25:16.700 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 --2- 172.21.15.81:0/72061612 >> v2:172.21.15.136:3300/0 conn(0x7f2b2c0d0000 0x7f2b2c0b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.700 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c4e0 0x7f2b2c0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 --2- 172.21.15.81:0/72061612 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c15c100 0x7f2b2c0ce590 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 -- 172.21.15.81:0/72061612 >> 172.21.15.81:0/72061612 conn(0x7f2b2c0d1f80 msgr2=0x7f2b2c0d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 -- 172.21.15.81:0/72061612 shutdown_connections 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.696+0000 7f2b328a0640 1 -- 172.21.15.81:0/72061612 wait complete. 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.697+0000 7f2b328a0640 1 Processor -- start 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 -- start start 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 0x7f2b2c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 0x7f2b2c1f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c0b1cd0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2b2c0ccb70 con 0x7f2b2c15c4e0 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.698+0000 7f2b328a0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2b2c0b1e50 con 0x7f2b2c15c100 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.701 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57368/0 (socket says 172.21.15.81:57368) 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 -- 172.21.15.81:0/2759240402 learned_addr learned my addr 172.21.15.81:0/2759240402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b30e3d640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 0x7f2b2c1f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 0x7f2b2c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 -- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 msgr2=0x7f2b2c1594e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 0x7f2b2c1594e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 -- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 msgr2=0x7f2b2c1f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 0x7f2b2c1f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 -- 172.21.15.81:0/2759240402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b2c0cb4d0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b30e3d640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 0x7f2b2c1f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 0x7f2b2c1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b2bfff640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c02b8c0 tx=0x7f2b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c032880 con 0x7f2b2c0d0000 2024-03-18T00:25:16.702 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b1c032a40 con 0x7f2b2c0d0000 2024-03-18T00:25:16.703 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b2c159a20 con 0x7f2b2c0d0000 2024-03-18T00:25:16.703 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c032e30 con 0x7f2b2c0d0000 2024-03-18T00:25:16.703 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.699+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b2c0cba50 con 0x7f2b2c0d0000 2024-03-18T00:25:16.703 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.700+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b2c04f540 con 0x7f2b2c0d0000 2024-03-18T00:25:16.704 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.701+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2b1c0453f0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.704 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.701+0000 7f2b28ff9640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 0x7f2b1806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:16.704 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.701+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f2b1c0ac4f0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.704 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.701+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 0x7f2b1806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:16.704 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.702+0000 7f2b2b7fe640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 0x7f2b1806e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:16.707 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.706+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2b1c040070 con 0x7f2b2c0d0000 2024-03-18T00:25:16.879 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.879+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2b2c0b1ab0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.880 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.879+0000 7f2b28ff9640 1 -- 172.21.15.81:0/2759240402 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7f2b1c07b3c0 con 0x7f2b2c0d0000 2024-03-18T00:25:16.880 INFO:teuthology.misc.health.smithi081.stdout: 2024-03-18T00:25:16.881 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:13.481975+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:16.883 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 msgr2=0x7f2b1806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:16.883 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 0x7f2b1806e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b20006fd0 tx=0x7f2b20008040 comp rx=0 tx=0).stop 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 msgr2=0x7f2b2c0caf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c02b8c0 tx=0x7f2b1c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 shutdown_connections 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2b2c15c4e0 0x7f2b2c1f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2b2c15c100 0x7f2b2c1594e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.884 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2b1806bbd0 0x7f2b1806e090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.885 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 --2- 172.21.15.81:0/2759240402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2b2c0d0000 0x7f2b2c0caf90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:16.885 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 >> 172.21.15.81:0/2759240402 conn(0x7f2b2c0d1f80 msgr2=0x7f2b2c06f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:16.885 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 shutdown_connections 2024-03-18T00:25:16.885 INFO:teuthology.misc.health.smithi081.stderr:2024-03-18T00:25:16.881+0000 7f2b328a0640 1 -- 172.21.15.81:0/2759240402 wait complete. 2024-03-18T00:25:16.891 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-18T00:25:16.892 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-18T00:25:16.892 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T00:25:16.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T00:25:16.894 INFO:tasks.ceph.mds.a:Started 2024-03-18T00:25:16.894 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T00:25:16.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T00:25:16.896 INFO:tasks.ceph.mds.c:Started 2024-03-18T00:25:16.897 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T00:25:16.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T00:25:16.899 INFO:tasks.ceph.mds.b:Started 2024-03-18T00:25:16.899 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-18T00:25:16.900 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-18T00:25:16.902 INFO:tasks.ceph.mds.d:Started 2024-03-18T00:25:16.902 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-18T00:25:16.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:16.970 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-03-18T00:25:16.971 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-03-18T00:25:16.986 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-03-18T00:25:16.987 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-03-18T00:25:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.007+0000 7fb809722640 1 Processor -- start 2024-03-18T00:25:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.007+0000 7fb809722640 1 -- start start 2024-03-18T00:25:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.008+0000 7fb809722640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb8040d2d50 0x7fb8040d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.008+0000 7fb809722640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 0x7fb8040b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.008+0000 7fb809722640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8040d1200 con 0x7fb80415e5a0 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.008+0000 7fb809722640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb8040cff90 con 0x7fb8040d2d50 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.008+0000 7fb809722640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb8040b34d0 con 0x7fb8040d1e40 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8037fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 0x7fb8040b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8027fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb8040d2d50 0x7fb8040d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb802ffd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb80415e5a0 0x7fb8040d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:56558/0 (socket says 172.21.15.81:56558) 2024-03-18T00:25:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb802ffd640 1 -- 172.21.15.81:0/1475581840 learned_addr learned my addr 172.21.15.81:0/1475581840 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8037fe640 1 -- 172.21.15.81:0/1475581840 >> v2:172.21.15.136:3300/0 conn(0x7fb8040d2d50 msgr2=0x7fb8040d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8037fe640 1 --2- 172.21.15.81:0/1475581840 >> v2:172.21.15.136:3300/0 conn(0x7fb8040d2d50 0x7fb8040d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb801ffb640 1 -- 172.21.15.81:0/1475581840 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232084945 0 0) 0x7fb8040d1200 con 0x7fb80415e5a0 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8037fe640 1 -- 172.21.15.81:0/1475581840 >> v1:172.21.15.136:6789/0 conn(0x7fb80415e5a0 legacy=0x7fb8040d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.009+0000 7fb8037fe640 1 -- 172.21.15.81:0/1475581840 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040d14e0 con 0x7fb8040d1e40 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb8037fe640 1 --2- 172.21.15.81:0/1475581840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 0x7fb8040b3c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009d90 tx=0x7fb7fc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6cc1ddb7a480b558 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb801ffb640 1 -- 172.21.15.81:0/1475581840 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc039070 con 0x7fb8040d1e40 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb801ffb640 1 -- 172.21.15.81:0/1475581840 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7fc02cbc0 con 0x7fb8040d1e40 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb801ffb640 1 -- 172.21.15.81:0/1475581840 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7fc034440 con 0x7fb8040d1e40 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 -- 172.21.15.81:0/1475581840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 msgr2=0x7fb8040b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 --2- 172.21.15.81:0/1475581840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 0x7fb8040b3c40 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009d90 tx=0x7fb7fc02be10 comp rx=0 tx=0).stop 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 -- 172.21.15.81:0/1475581840 shutdown_connections 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 --2- 172.21.15.81:0/1475581840 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb8040d1e40 0x7fb8040b3c40 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 --2- 172.21.15.81:0/1475581840 >> v2:172.21.15.136:3300/0 conn(0x7fb8040d2d50 0x7fb8040d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 -- 172.21.15.81:0/1475581840 >> 172.21.15.81:0/1475581840 conn(0x7fb8040d4060 msgr2=0x7fb8040d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 -- 172.21.15.81:0/1475581840 shutdown_connections 2024-03-18T00:25:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.010+0000 7fb809722640 1 -- 172.21.15.81:0/1475581840 wait complete. 2024-03-18T00:25:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 Processor -- start 2024-03-18T00:25:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 -- start start 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8040d1e40 0x7fb8041e4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb80415e5a0 0x7fb8040cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8040b4300 con 0x7fb8040d2d50 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb8040b4180 con 0x7fb8040d1e40 2024-03-18T00:25:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.012+0000 7fb809722640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb8040b4480 con 0x7fb80415e5a0 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57396/0 (socket says 172.21.15.81:57396) 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 -- 172.21.15.81:0/797841724 learned_addr learned my addr 172.21.15.81:0/797841724 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb802ffd640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8040d1e40 0x7fb8041e4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8037fe640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb80415e5a0 0x7fb8040cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 -- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb80415e5a0 msgr2=0x7fb8040cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb80415e5a0 0x7fb8040cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 -- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8040d1e40 msgr2=0x7fb8041e4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8040d1e40 0x7fb8041e4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 -- 172.21.15.81:0/797841724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8040cbc20 con 0x7fb8040d2d50 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb8027fc640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00eb70 tx=0x7fb7ec00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec017070 con 0x7fb8040d2d50 2024-03-18T00:25:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec00ed80 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8041f7620 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.013+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec00ce50 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.014+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8041f78e0 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.014+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb80404f5b0 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.015+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb7ec01a070 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.015+0000 7fb7fb7fe640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 0x7fb7e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.015+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb7ec08a420 con 0x7fb8040d2d50 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.015+0000 7fb802ffd640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 0x7fb7e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.016+0000 7fb802ffd640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 0x7fb7e406e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f60 tx=0x7fb7f4007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.020+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb7ec058b30 con 0x7fb8040d2d50 2024-03-18T00:25:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.194+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb8041e5c60 con 0x7fb8040d2d50 2024-03-18T00:25:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.195+0000 7fb7fb7fe640 1 -- 172.21.15.81:0/797841724 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fb7ec05cbd0 con 0x7fb8040d2d50 2024-03-18T00:25:17.197 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:17.197 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:13.481975+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 msgr2=0x7fb7e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 0x7fb7e406e090 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7f4000f60 tx=0x7fb7f4007e40 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 msgr2=0x7fb8040cb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec00eb70 tx=0x7fb7ec00c520 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 shutdown_connections 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb80415e5a0 0x7fb8040cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb7e406bbd0 0x7fb7e406e090 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8040d2d50 0x7fb8040cb1a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 --2- 172.21.15.81:0/797841724 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb8040d1e40 0x7fb8041e4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 >> 172.21.15.81:0/797841724 conn(0x7fb8040d4060 msgr2=0x7fb8041e6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 shutdown_connections 2024-03-18T00:25:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.197+0000 7fb809722640 1 -- 172.21.15.81:0/797841724 wait complete. 2024-03-18T00:25:17.210 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:17.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:17.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.313+0000 7f0c8ab32640 1 Processor -- start 2024-03-18T00:25:17.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.313+0000 7f0c8ab32640 1 -- start start 2024-03-18T00:25:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c8ab32640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c840ceae0 0x7f0c840d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c8ab32640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c840b31d0 con 0x7f0c8415fa40 2024-03-18T00:25:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c8ab32640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c840cd560 con 0x7f0c840cf480 2024-03-18T00:25:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c8ab32640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0c840cd840 con 0x7f0c840ceae0 2024-03-18T00:25:17.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c888ce640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0c840ceae0 0x7f0c840d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c890cf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0c8415fa40 0x7f0c840c5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33120/0 (socket says 172.21.15.81:33120) 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c890cf640 1 -- 172.21.15.81:0/744902124 learned_addr learned my addr 172.21.15.81:0/744902124 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c888ce640 1 -- 172.21.15.81:0/744902124 >> v1:172.21.15.136:6789/0 conn(0x7f0c840cf480 legacy=0x7f0c8415f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c888ce640 1 -- 172.21.15.81:0/744902124 >> v1:172.21.15.81:6789/0 conn(0x7f0c8415fa40 legacy=0x7f0c840c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c888ce640 1 -- 172.21.15.81:0/744902124 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840b2e60 con 0x7f0c840ceae0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.314+0000 7f0c837fe640 1 -- 172.21.15.81:0/744902124 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14327164 0 0) 0x7f0c840b31d0 con 0x7f0c8415fa40 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.315+0000 7f0c888ce640 1 --2- 172.21.15.81:0/744902124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840ceae0 0x7f0c840d29c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c780097a0 tx=0x7f0c7802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf5db21c437a2e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.315+0000 7f0c837fe640 1 -- 172.21.15.81:0/744902124 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780315a0 con 0x7f0c840ceae0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.315+0000 7f0c837fe640 1 -- 172.21.15.81:0/744902124 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c78037070 con 0x7f0c840ceae0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.315+0000 7f0c837fe640 1 -- 172.21.15.81:0/744902124 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c78031960 con 0x7f0c840ceae0 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 -- 172.21.15.81:0/744902124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840ceae0 msgr2=0x7f0c840d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/744902124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840ceae0 0x7f0c840d29c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c780097a0 tx=0x7f0c7802b840 comp rx=0 tx=0).stop 2024-03-18T00:25:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 -- 172.21.15.81:0/744902124 shutdown_connections 2024-03-18T00:25:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/744902124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c840ceae0 0x7f0c840d29c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 -- 172.21.15.81:0/744902124 >> 172.21.15.81:0/744902124 conn(0x7f0c840d1ea0 msgr2=0x7f0c840d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 -- 172.21.15.81:0/744902124 shutdown_connections 2024-03-18T00:25:17.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.316+0000 7f0c8ab32640 1 -- 172.21.15.81:0/744902124 wait complete. 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.317+0000 7f0c8ab32640 1 Processor -- start 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.317+0000 7f0c8ab32640 1 -- start start 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c840ceae0 0x7f0c8406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c840cf480 0x7f0c840b22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840cf040 con 0x7f0c8415fa40 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0c840ceec0 con 0x7f0c840cf480 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0c840cf1c0 con 0x7f0c840ceae0 2024-03-18T00:25:17.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57412/0 (socket says 172.21.15.81:57412) 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 -- 172.21.15.81:0/1306393104 learned_addr learned my addr 172.21.15.81:0/1306393104 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c888ce640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c840ceae0 0x7f0c8406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c83fff640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c840cf480 0x7f0c840b22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 -- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c840ceae0 msgr2=0x7f0c8406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c840ceae0 0x7f0c8406c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 -- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c840cf480 msgr2=0x7f0c840b22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c840cf480 0x7f0c840b22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 -- 172.21.15.81:0/1306393104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c840cc300 con 0x7f0c8415fa40 2024-03-18T00:25:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c890cf640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c780 tx=0x7f0c7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c018070 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c7c00a640 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8406c960 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00aab0 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.318+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8406cf20 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.319+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8406b6b0 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.320+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0c7c01b070 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.320+0000 7f0c817fa640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 0x7f0c6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.320+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f0c7c089d20 con 0x7f0c8415fa40 2024-03-18T00:25:17.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.320+0000 7f0c888ce640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 0x7f0c6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.321+0000 7f0c888ce640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 0x7f0c6806e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c78036000 tx=0x7f0c7803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.325+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0c8406b6b0 con 0x7f0c8415fa40 2024-03-18T00:25:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.497+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0c8415ebe0 con 0x7f0c8415fa40 2024-03-18T00:25:17.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.498+0000 7f0c817fa640 1 -- 172.21.15.81:0/1306393104 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f0c7c058b60 con 0x7f0c8415fa40 2024-03-18T00:25:17.498 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.499+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 msgr2=0x7f0c6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.499+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 0x7f0c6806e090 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0c78036000 tx=0x7f0c7803d040 comp rx=0 tx=0).stop 2024-03-18T00:25:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.499+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 msgr2=0x7f0c840cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.499+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00c780 tx=0x7f0c7c00cc40 comp rx=0 tx=0).stop 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 shutdown_connections 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0c6806bbd0 0x7f0c6806e090 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c8415fa40 0x7f0c840cbdc0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0c840cf480 0x7f0c840b22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 --2- 172.21.15.81:0/1306393104 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0c840ceae0 0x7f0c8406c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 >> 172.21.15.81:0/1306393104 conn(0x7f0c840d1ea0 msgr2=0x7f0c840d07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 shutdown_connections 2024-03-18T00:25:17.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.500+0000 7f0c8ab32640 1 -- 172.21.15.81:0/1306393104 wait complete. 2024-03-18T00:25:17.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:17.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.611+0000 7fd138827640 1 Processor -- start 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.611+0000 7fd138827640 1 -- start start 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd138827640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd13415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd138827640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1340afbe0 0x7fd13406e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd138827640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13415f710 con 0x7fd13406ed90 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd138827640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd134070850 con 0x7fd1340afbe0 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd138827640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd13406e3c0 con 0x7fd13415bf30 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd12bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd1340afbe0 0x7fd13406e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd132d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd13406ed90 0x7fd13406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33128/0 (socket says 172.21.15.81:33128) 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd132d9d640 1 -- 172.21.15.81:0/463575678 learned_addr learned my addr 172.21.15.81:0/463575678 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd12bfff640 1 -- 172.21.15.81:0/463575678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 msgr2=0x7fd13415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:17.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd12bfff640 1 --2- 172.21.15.81:0/463575678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd13415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd12bfff640 1 -- 172.21.15.81:0/463575678 >> v1:172.21.15.81:6789/0 conn(0x7fd13406ed90 legacy=0x7fd13406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd131d9b640 1 -- 172.21.15.81:0/463575678 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612142388 0 0) 0x7fd12c001490 con 0x7fd13406ed90 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.612+0000 7fd12bfff640 1 -- 172.21.15.81:0/463575678 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1340b0080 con 0x7fd1340afbe0 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.613+0000 7fd12bfff640 1 --2- 172.21.15.81:0/463575678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd13406e850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0097a0 tx=0x7fd11c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f67f56906b7354 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.613+0000 7fd131d9b640 1 -- 172.21.15.81:0/463575678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c035020 con 0x7fd1340afbe0 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.613+0000 7fd131d9b640 1 -- 172.21.15.81:0/463575678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd11c031830 con 0x7fd1340afbe0 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.613+0000 7fd131d9b640 1 -- 172.21.15.81:0/463575678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd11c031c00 con 0x7fd1340afbe0 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 -- 172.21.15.81:0/463575678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 msgr2=0x7fd13406e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 --2- 172.21.15.81:0/463575678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd13406e850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0097a0 tx=0x7fd11c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 -- 172.21.15.81:0/463575678 shutdown_connections 2024-03-18T00:25:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 --2- 172.21.15.81:0/463575678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd13406e850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 --2- 172.21.15.81:0/463575678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd13415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 -- 172.21.15.81:0/463575678 >> 172.21.15.81:0/463575678 conn(0x7fd1340d0d30 msgr2=0x7fd1340d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 -- 172.21.15.81:0/463575678 shutdown_connections 2024-03-18T00:25:17.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.614+0000 7fd138827640 1 -- 172.21.15.81:0/463575678 wait complete. 2024-03-18T00:25:17.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.615+0000 7fd138827640 1 Processor -- start 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.615+0000 7fd138827640 1 -- start start 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd1341548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 0x7fd134149390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406b8d0 con 0x7fd1340afbe0 2024-03-18T00:25:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd13406e050 con 0x7fd13414d0a0 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd138827640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd13406ba50 con 0x7fd13415bf30 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57434/0 (socket says 172.21.15.81:57434) 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 -- 172.21.15.81:0/7170550 learned_addr learned my addr 172.21.15.81:0/7170550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd12bfff640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd1341548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd132d9d640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 0x7fd134149390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 -- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 msgr2=0x7fd1341548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd1341548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 -- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 msgr2=0x7fd134149390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 0x7fd134149390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 -- 172.21.15.81:0/7170550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341f7d10 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd12bfff640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd1341548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd132d9d640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 0x7fd134149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.616+0000 7fd13259c640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd12400b410 tx=0x7fd12400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124015020 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd124011850 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341f7ff0 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124011c40 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341f85b0 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.617+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd134155280 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.618+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd124018020 con 0x7fd1340afbe0 2024-03-18T00:25:17.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.618+0000 7fd12affd640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 0x7fd11406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.618+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd12408a640 con 0x7fd1340afbe0 2024-03-18T00:25:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.618+0000 7fd12bfff640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 0x7fd11406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.619+0000 7fd12bfff640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 0x7fd11406e090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd11c036000 tx=0x7fd11c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.623+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd12401f020 con 0x7fd1340afbe0 2024-03-18T00:25:17.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.831+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd13404f5b0 con 0x7fd1340afbe0 2024-03-18T00:25:17.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.832+0000 7fd12affd640 1 -- 172.21.15.81:0/7170550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7fd1240172c0 con 0x7fd1340afbe0 2024-03-18T00:25:17.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:17.833 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-18T00:25:17.833 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 msgr2=0x7fd11406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 0x7fd11406e090 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd11c036000 tx=0x7fd11c008030 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 msgr2=0x7fd134154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd12400b410 tx=0x7fd12400b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 shutdown_connections 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd13414d0a0 0x7fd134149390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd13415bf30 0x7fd1341548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd11406bbd0 0x7fd11406e090 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 --2- 172.21.15.81:0/7170550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1340afbe0 0x7fd134154380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:17.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 >> 172.21.15.81:0/7170550 conn(0x7fd1340d0d30 msgr2=0x7fd1340aee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 shutdown_connections 2024-03-18T00:25:17.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:17.834+0000 7fd138827640 1 -- 172.21.15.81:0/7170550 wait complete. 2024-03-18T00:25:19.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.957+0000 7f13f6d1b640 1 Processor -- start 2024-03-18T00:25:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.957+0000 7f13f6d1b640 1 -- start start 2024-03-18T00:25:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f6d1b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13f00b2280 0x7f13f006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f6d1b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13f00d0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f6d1b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13f015ec80 con 0x7f13f00d0850 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f6d1b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f13f00d0ce0 con 0x7f13f00b2280 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f6d1b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13f006db30 con 0x7f13f00cfd70 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f52b8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f13f00d0850 0x7f13f0162370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33142/0 (socket says 172.21.15.81:33142) 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f52b8640 1 -- 172.21.15.81:0/1866906093 learned_addr learned my addr 172.21.15.81:0/1866906093 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192466701 0 0) 0x7f13f015ec80 con 0x7f13f00d0850 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e0003520 con 0x7f13f00d0850 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13f4ab7640 1 --2- 172.21.15.81:0/1866906093 >> v2:172.21.15.136:3300/0 conn(0x7f13f00b2280 0x7f13f006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13effff640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13f00d0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 90338395 0 0) 0x7f13e0003520 con 0x7f13f00d0850 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 msgr2=0x7f13f00d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13f00d0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 >> v2:172.21.15.136:3300/0 conn(0x7f13f00b2280 msgr2=0x7f13f006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.958+0000 7f13ef7fe640 1 --2- 172.21.15.81:0/1866906093 >> v2:172.21.15.136:3300/0 conn(0x7f13f00b2280 0x7f13f006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f006cf20 con 0x7f13f00d0850 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f13e80019f0 con 0x7f13f00d0850 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 >> v1:172.21.15.81:6789/0 conn(0x7f13f00d0850 legacy=0x7f13f0162370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13e0003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e0003fa0 0x7f13e0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13e0004d40 0x7f13e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13f00d0ce0 con 0x7f13e0003fa0 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13f006db30 con 0x7f13e0004d40 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13e000bb20 con 0x7f13f00cfd70 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e0003fa0 0x7f13e0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13f52b8640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13e0004d40 0x7f13e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13f4ab7640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13e0003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 -- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 msgr2=0x7f13e0003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13f00cfd70 0x7f13e0003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 -- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13e0004d40 msgr2=0x7f13e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13e0004d40 0x7f13e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.959+0000 7f13effff640 1 -- 172.21.15.81:0/1866906093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e0003520 con 0x7f13e0003fa0 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13effff640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e0003fa0 0x7f13e0004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009ac0 tx=0x7f13e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a2300add784192 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc039070 con 0x7f13e0003fa0 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13dc02c6b0 con 0x7f13e0003fa0 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13ef7fe640 1 -- 172.21.15.81:0/1866906093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13dc009690 con 0x7f13e0003fa0 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13f6d1b640 1 -- 172.21.15.81:0/1866906093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e0003fa0 msgr2=0x7f13e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/1866906093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13e0003fa0 0x7f13e0004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009ac0 tx=0x7f13e0005830 comp rx=0 tx=0).stop 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13f52b8640 1 -- 172.21.15.81:0/1866906093 reap_dead start 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13f6d1b640 1 -- 172.21.15.81:0/1866906093 shutdown_connections 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.960+0000 7f13f6d1b640 1 -- 172.21.15.81:0/1866906093 >> 172.21.15.81:0/1866906093 conn(0x7f13f00d1e70 msgr2=0x7f13f00d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.961+0000 7f13f6d1b640 1 -- 172.21.15.81:0/1866906093 shutdown_connections 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.961+0000 7f13f6d1b640 1 -- 172.21.15.81:0/1866906093 wait complete. 2024-03-18T00:25:19.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.962+0000 7f13f6d1b640 1 Processor -- start 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.962+0000 7f13f6d1b640 1 -- start start 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13e0003fa0 0x7f13f00c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13f0154430 0x7f13f01f5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13f006d7c0 con 0x7f13f015c2c0 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13f006d4e0 con 0x7f13f0154430 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13f00b2660 con 0x7f13e0003fa0 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57460/0 (socket says 172.21.15.81:57460) 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 -- 172.21.15.81:0/3002021138 learned_addr learned my addr 172.21.15.81:0/3002021138 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f4ab7640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13e0003fa0 0x7f13f00c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13effff640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13f0154430 0x7f13f01f5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 -- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13e0003fa0 msgr2=0x7f13f00c7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13e0003fa0 0x7f13f00c7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 -- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13f0154430 msgr2=0x7f13f01f5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13f0154430 0x7f13f01f5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 -- 172.21.15.81:0/3002021138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13f00cc860 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f52b8640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13f00cc450 tx=0x7f13e8007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e800ab00 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13e8018070 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13f00ccb40 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13e80133f0 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.963+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13f00cd100 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.964+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13f004f5b0 con 0x7f13f015c2c0 2024-03-18T00:25:19.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.965+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f13e8013590 con 0x7f13f015c2c0 2024-03-18T00:25:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.965+0000 7f13ed7fa640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 0x7f13d406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.965+0000 7f13f4ab7640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 0x7f13d406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.965+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f13e808ab20 con 0x7f13f015c2c0 2024-03-18T00:25:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.966+0000 7f13f4ab7640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 0x7f13d406e0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13f006e100 tx=0x7f13e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:19.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:19.970+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f13e8059310 con 0x7f13f015c2c0 2024-03-18T00:25:20.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.178+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13f00b5c70 con 0x7f13f015c2c0 2024-03-18T00:25:20.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.179+0000 7f13ed7fa640 1 -- 172.21.15.81:0/3002021138 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f13e805d3b0 con 0x7f13f015c2c0 2024-03-18T00:25:20.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:20.180 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4278,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-18T00:25:20.180 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-03-18T00:25:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.180+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 msgr2=0x7f13d406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.180+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 0x7f13d406e0c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f13f006e100 tx=0x7f13e4008040 comp rx=0 tx=0).stop 2024-03-18T00:25:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.180+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 msgr2=0x7f13f015c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.180+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f13f00cc450 tx=0x7f13e8007a90 comp rx=0 tx=0).stop 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 shutdown_connections 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13d406bc00 0x7f13d406e0c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13f015c2c0 0x7f13f015c770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13f0154430 0x7f13f01f5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 --2- 172.21.15.81:0/3002021138 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13e0003fa0 0x7f13f00c7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 >> 172.21.15.81:0/3002021138 conn(0x7f13f00d1e70 msgr2=0x7f13f0070850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 shutdown_connections 2024-03-18T00:25:20.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.181+0000 7f13f6d1b640 1 -- 172.21.15.81:0/3002021138 wait complete. 2024-03-18T00:25:20.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:20.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.291+0000 7fec81a97640 1 Processor -- start 2024-03-18T00:25:20.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.291+0000 7fec81a97640 1 -- start start 2024-03-18T00:25:20.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec81a97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7c0cda20 0x7fec7c06e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec81a97640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fec7c0cde00 0x7fec7c0cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec81a97640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec7c15ec10 con 0x7fec7c06bf90 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec81a97640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fec7c06b4f0 con 0x7fec7c0cda20 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec81a97640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fec7c15eef0 con 0x7fec7c0cde00 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7c0cda20 0x7fec7c06e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fec7c0cda20 0x7fec7c06e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57466/0 (socket says 172.21.15.81:57466) 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 -- 172.21.15.81:0/2538945100 learned_addr learned my addr 172.21.15.81:0/2538945100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7affd640 1 --2- 172.21.15.81:0/2538945100 >> v2:172.21.15.136:3300/0 conn(0x7fec7c0cde00 0x7fec7c0cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 -- 172.21.15.81:0/2538945100 >> v2:172.21.15.136:3300/0 conn(0x7fec7c0cde00 msgr2=0x7fec7c0cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 --2- 172.21.15.81:0/2538945100 >> v2:172.21.15.136:3300/0 conn(0x7fec7c0cde00 0x7fec7c0cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 -- 172.21.15.81:0/2538945100 >> v1:172.21.15.136:6789/0 conn(0x7fec7c06bf90 legacy=0x7fec7c162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.292+0000 7fec7b7fe640 1 -- 172.21.15.81:0/2538945100 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c15f1d0 con 0x7fec7c0cda20 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.293+0000 7fec7b7fe640 1 --2- 172.21.15.81:0/2538945100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cda20 0x7fec7c06e680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec7c09f070 tx=0x7fec6c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b88531b17f81e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.293+0000 7fec7a7fc640 1 -- 172.21.15.81:0/2538945100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c034070 con 0x7fec7c0cda20 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.293+0000 7fec7a7fc640 1 -- 172.21.15.81:0/2538945100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec6c030860 con 0x7fec7c0cda20 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.293+0000 7fec7a7fc640 1 -- 172.21.15.81:0/2538945100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c030c30 con 0x7fec7c0cda20 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 -- 172.21.15.81:0/2538945100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cda20 msgr2=0x7fec7c06e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 --2- 172.21.15.81:0/2538945100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cda20 0x7fec7c06e680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fec7c09f070 tx=0x7fec6c02b9a0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 -- 172.21.15.81:0/2538945100 shutdown_connections 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 --2- 172.21.15.81:0/2538945100 >> v2:172.21.15.136:3300/0 conn(0x7fec7c0cde00 0x7fec7c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 --2- 172.21.15.81:0/2538945100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cda20 0x7fec7c06e680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 -- 172.21.15.81:0/2538945100 >> 172.21.15.81:0/2538945100 conn(0x7fec7c0b2ab0 msgr2=0x7fec7c0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 -- 172.21.15.81:0/2538945100 shutdown_connections 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.294+0000 7fec81a97640 1 -- 172.21.15.81:0/2538945100 wait complete. 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.295+0000 7fec81a97640 1 Processor -- start 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.295+0000 7fec81a97640 1 -- start start 2024-03-18T00:25:20.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec7c06bf90 0x7fec7c0add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec7c1576b0 0x7fec7c1609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c06ebc0 con 0x7fec7c0cde00 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c15f790 con 0x7fec7c1576b0 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec81a97640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fec7c15e8c0 con 0x7fec7c06bf90 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57470/0 (socket says 172.21.15.81:57470) 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 -- 172.21.15.81:0/20062476 learned_addr learned my addr 172.21.15.81:0/20062476 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 -- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec7c06bf90 msgr2=0x7fec7c0add90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec7c06bf90 0x7fec7c0add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7bfff640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec7c1576b0 0x7fec7c1609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 -- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec7c1576b0 msgr2=0x7fec7c1609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec7c1576b0 0x7fec7c1609f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 -- 172.21.15.81:0/20062476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c0af6f0 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec7affd640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d800 tx=0x7fec7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.296+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7000b6c0 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.297+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec70019070 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.297+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c0af9d0 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.297+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7000ba80 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.297+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c0aff90 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.297+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c04f5b0 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.298+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fec7000bc20 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.298+0000 7fec63fff640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 0x7fec6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.298+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fec7008ac30 con 0x7fec7c0cde00 2024-03-18T00:25:20.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.298+0000 7fec7b7fe640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 0x7fec6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.299+0000 7fec7b7fe640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 0x7fec6806e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec6c036000 tx=0x7fec6c03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.303+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fec70059a70 con 0x7fec7c0cde00 2024-03-18T00:25:20.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.475+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fec7c0b30e0 con 0x7fec7c0cde00 2024-03-18T00:25:20.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.476+0000 7fec63fff640 1 -- 172.21.15.81:0/20062476 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12896 (secure 0 0 0) 0x7fec70059370 con 0x7fec7c0cde00 2024-03-18T00:25:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:20.477 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:13.481975+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 msgr2=0x7fec6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 0x7fec6806e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fec6c036000 tx=0x7fec6c03b040 comp rx=0 tx=0).stop 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 msgr2=0x7fec7c14d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d800 tx=0x7fec7000dcc0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 shutdown_connections 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fec7c1576b0 0x7fec7c1609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fec6806bbd0 0x7fec6806e090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec7c0cde00 0x7fec7c14d600 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 --2- 172.21.15.81:0/20062476 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fec7c06bf90 0x7fec7c0add90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 >> 172.21.15.81:0/20062476 conn(0x7fec7c0b2ab0 msgr2=0x7fec7c0cf7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 shutdown_connections 2024-03-18T00:25:20.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.478+0000 7fec81a97640 1 -- 172.21.15.81:0/20062476 wait complete. 2024-03-18T00:25:20.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:20.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.595+0000 7f19cd2b8640 1 Processor -- start 2024-03-18T00:25:20.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.595+0000 7f19cd2b8640 1 -- start start 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19cd2b8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 0x7f19c806b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19cd2b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19c815da20 0x7f19c815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19cd2b8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c8071ee0 con 0x7f19c80b0150 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19cd2b8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f19c8072af0 con 0x7f19c815da20 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19cd2b8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19c806bb60 con 0x7f19c806b1c0 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19c815da20 0x7f19c815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19c80b0150 0x7f19c80ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33156/0 (socket says 172.21.15.81:33156) 2024-03-18T00:25:20.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c6ffd640 1 -- 172.21.15.81:0/2792702881 learned_addr learned my addr 172.21.15.81:0/2792702881 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c67fc640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 0x7f19c806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c77fe640 1 -- 172.21.15.81:0/2792702881 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 msgr2=0x7f19c806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c77fe640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 0x7f19c806b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c77fe640 1 -- 172.21.15.81:0/2792702881 >> v1:172.21.15.81:6789/0 conn(0x7f19c80b0150 legacy=0x7f19c80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c5ffb640 1 -- 172.21.15.81:0/2792702881 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3073021462 0 0) 0x7f19c8071ee0 con 0x7f19c80b0150 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c77fe640 1 -- 172.21.15.81:0/2792702881 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80721c0 con 0x7f19c815da20 2024-03-18T00:25:20.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.596+0000 7f19c67fc640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 0x7f19c806b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.597+0000 7f19c77fe640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c815da20 0x7f19c815de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097a0 tx=0x7f19c002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddff6dbe6101a8c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.597+0000 7f19c5ffb640 1 -- 172.21.15.81:0/2792702881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c00315a0 con 0x7f19c815da20 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.597+0000 7f19c5ffb640 1 -- 172.21.15.81:0/2792702881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19c0037070 con 0x7f19c815da20 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.597+0000 7f19c5ffb640 1 -- 172.21.15.81:0/2792702881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19c0031960 con 0x7f19c815da20 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 -- 172.21.15.81:0/2792702881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c815da20 msgr2=0x7f19c815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c815da20 0x7f19c815de80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f19c00097a0 tx=0x7f19c002b840 comp rx=0 tx=0).stop 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 -- 172.21.15.81:0/2792702881 shutdown_connections 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c815da20 0x7f19c815de80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/2792702881 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c806b1c0 0x7f19c806b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 -- 172.21.15.81:0/2792702881 >> 172.21.15.81:0/2792702881 conn(0x7f19c80d0da0 msgr2=0x7f19c80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 -- 172.21.15.81:0/2792702881 shutdown_connections 2024-03-18T00:25:20.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.598+0000 7f19cd2b8640 1 -- 172.21.15.81:0/2792702881 wait complete. 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.599+0000 7f19cd2b8640 1 Processor -- start 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.599+0000 7f19cd2b8640 1 -- start start 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c80b0150 0x7f19c80c6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19c815da20 0x7f19c81f4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80cf080 con 0x7f19c806b1c0 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8072780 con 0x7f19c815da20 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19cd2b8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19c80d0900 con 0x7f19c80b0150 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57484/0 (socket says 172.21.15.81:57484) 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 -- 172.21.15.81:0/1367838245 learned_addr learned my addr 172.21.15.81:0/1367838245 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 -- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c80b0150 msgr2=0x7f19c80c6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c80b0150 0x7f19c80c6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 -- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19c815da20 msgr2=0x7f19c81f4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19c815da20 0x7f19c81f4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 -- 172.21.15.81:0/1367838245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80c5710 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.600+0000 7f19c6ffd640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19b800c890 tx=0x7f19b800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.601+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b8018070 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.601+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b800a640 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.601+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c80c59f0 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.601+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b800aa30 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.601+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c80c69f0 con 0x7f19c806b1c0 2024-03-18T00:25:20.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.602+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c80c6bf0 con 0x7f19c806b1c0 2024-03-18T00:25:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.602+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f19b801b070 con 0x7f19c806b1c0 2024-03-18T00:25:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.603+0000 7f19af7fe640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 0x7f19b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.603+0000 7f19c67fc640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 0x7f19b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.603+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f19b8089d80 con 0x7f19c806b1c0 2024-03-18T00:25:20.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.603+0000 7f19c67fc640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 0x7f19b406e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19bc006fd0 tx=0x7f19bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.607+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f19b8058c50 con 0x7f19c806b1c0 2024-03-18T00:25:20.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.780+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19c80c4b80 con 0x7f19c806b1c0 2024-03-18T00:25:20.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.780+0000 7f19af7fe640 1 -- 172.21.15.81:0/1367838245 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f19b8058550 con 0x7f19c806b1c0 2024-03-18T00:25:20.781 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 msgr2=0x7f19b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 0x7f19b406e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f19bc006fd0 tx=0x7f19bc008040 comp rx=0 tx=0).stop 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 msgr2=0x7f19c80c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f19b800c890 tx=0x7f19b800cd50 comp rx=0 tx=0).stop 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 shutdown_connections 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19c815da20 0x7f19c81f4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19c80b0150 0x7f19c80c6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19b406bbd0 0x7f19b406e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.782+0000 7f19cd2b8640 1 --2- 172.21.15.81:0/1367838245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19c806b1c0 0x7f19c80c4da0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.783+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 >> 172.21.15.81:0/1367838245 conn(0x7f19c80d0da0 msgr2=0x7f19c80b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.783+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 shutdown_connections 2024-03-18T00:25:20.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.783+0000 7f19cd2b8640 1 -- 172.21.15.81:0/1367838245 wait complete. 2024-03-18T00:25:20.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T00:25:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 Processor -- start 2024-03-18T00:25:20.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 -- start start 2024-03-18T00:25:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa7f006b8d0 0x7fa7f00cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7f015fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7f01603e0 con 0x7fa7f015c160 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.893+0000 7fa7f8310640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa7f00b49c0 con 0x7fa7f006b8d0 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f8310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f0160c80 con 0x7fa7f00cf5b0 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f60ac640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa7f015c160 0x7fa7f006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33164/0 (socket says 172.21.15.81:33164) 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f60ac640 1 -- 172.21.15.81:0/1013620413 learned_addr learned my addr 172.21.15.81:0/1013620413 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f68ad640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7f015fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f58ab640 1 --2- 172.21.15.81:0/1013620413 >> v2:172.21.15.136:3300/0 conn(0x7fa7f006b8d0 0x7fa7f00cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3052641679 0 0) 0x7fa7f01603e0 con 0x7fa7f015c160 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7dc003520 con 0x7fa7f015c160 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3385977840 0 0) 0x7fa7dc003520 con 0x7fa7f015c160 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 msgr2=0x7fa7f015fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7f015fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 >> v2:172.21.15.136:3300/0 conn(0x7fa7f006b8d0 msgr2=0x7fa7f00cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 --2- 172.21.15.81:0/1013620413 >> v2:172.21.15.136:3300/0 conn(0x7fa7f006b8d0 0x7fa7f00cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f01606c0 con 0x7fa7f015c160 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7fa7ec001670 con 0x7fa7f015c160 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 >> v1:172.21.15.81:6789/0 conn(0x7fa7f015c160 legacy=0x7fa7f006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7dc003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc003fa0 0x7fa7dc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7dc004d40 0x7fa7dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f0160c80 con 0x7fa7dc004d40 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7dc00b9c0 con 0x7fa7dc003fa0 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa7dc00bb70 con 0x7fa7f00cf5b0 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f68ad640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7dc004d40 0x7fa7dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f60ac640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7dc003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.894+0000 7fa7f58ab640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc003fa0 0x7fa7dc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 -- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 msgr2=0x7fa7dc003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f00cf5b0 0x7fa7dc003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 -- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc003fa0 msgr2=0x7fa7dc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc003fa0 0x7fa7dc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 -- 172.21.15.81:0/1013620413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7dc003520 con 0x7fa7dc004d40 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f68ad640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7dc004d40 0x7fa7dc0051c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009fc0 tx=0x7fa7dc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab74be804d3d4e0f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8039070 con 0x7fa7dc004d40 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e802cc20 con 0x7fa7dc004d40 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.895+0000 7fa7f50aa640 1 -- 172.21.15.81:0/1013620413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8009c10 con 0x7fa7dc004d40 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 -- 172.21.15.81:0/1013620413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7dc004d40 msgr2=0x7fa7dc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 --2- 172.21.15.81:0/1013620413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7dc004d40 0x7fa7dc0051c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8009fc0 tx=0x7fa7dc005830 comp rx=0 tx=0).stop 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f68ad640 1 -- 172.21.15.81:0/1013620413 reap_dead start 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 -- 172.21.15.81:0/1013620413 shutdown_connections 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 -- 172.21.15.81:0/1013620413 >> 172.21.15.81:0/1013620413 conn(0x7fa7f00b2ab0 msgr2=0x7fa7f00b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 -- 172.21.15.81:0/1013620413 shutdown_connections 2024-03-18T00:25:20.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.896+0000 7fa7f8310640 1 -- 172.21.15.81:0/1013620413 wait complete. 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.897+0000 7fa7f8310640 1 Processor -- start 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.897+0000 7fa7f8310640 1 -- start start 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc004d40 0x7fa7f014e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f014fc30 0x7fa7f01500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f015c540 con 0x7fa7f014c250 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa7f00b4bf0 con 0x7fa7dc004d40 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f8310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa7f015fce0 con 0x7fa7f014fc30 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57492/0 (socket says 172.21.15.81:57492) 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 -- 172.21.15.81:0/2560389833 learned_addr learned my addr 172.21.15.81:0/2560389833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 -- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f014fc30 msgr2=0x7fa7f01500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f014fc30 0x7fa7f01500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f60ac640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc004d40 0x7fa7f014e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 -- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc004d40 msgr2=0x7fa7f014e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc004d40 0x7fa7f014e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 -- 172.21.15.81:0/2560389833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7f015d4e0 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7f58ab640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4011910 tx=0x7fa7e4011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.898+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4009590 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.899+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7e400faf0 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.899+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7e4014440 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.899+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7f014e5f0 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.899+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7f015da60 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.900+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7f004f5b0 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.900+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa7e4012040 con 0x7fa7f014c250 2024-03-18T00:25:20.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.900+0000 7fa7e2ffd640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 0x7fa7d406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.901+0000 7fa7f60ac640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 0x7fa7d406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.901+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa7e408ae40 con 0x7fa7f014c250 2024-03-18T00:25:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.901+0000 7fa7f60ac640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 0x7fa7d406e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001eb0 tx=0x7fa7ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:20.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:20.905+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa7e4019030 con 0x7fa7f014c250 2024-03-18T00:25:21.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.079+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa7f00cf160 con 0x7fa7f014c250 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.079+0000 7fa7e2ffd640 1 -- 172.21.15.81:0/2560389833 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fa7e4059bf0 con 0x7fa7f014c250 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:25:21.080 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 msgr2=0x7fa7d406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 0x7fa7d406e0c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec001eb0 tx=0x7fa7ec009040 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 msgr2=0x7fa7f014bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fa7e4011910 tx=0x7fa7e4011dd0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 shutdown_connections 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa7f014fc30 0x7fa7f01500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa7d406bc00 0x7fa7d406e0c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7f014c250 0x7fa7f014bc10 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 --2- 172.21.15.81:0/2560389833 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa7dc004d40 0x7fa7f014e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 >> 172.21.15.81:0/2560389833 conn(0x7fa7f00b2ab0 msgr2=0x7fa7f00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 shutdown_connections 2024-03-18T00:25:21.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.081+0000 7fa7f8310640 1 -- 172.21.15.81:0/2560389833 wait complete. 2024-03-18T00:25:21.092 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T00:25:21.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T00:25:21.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.195+0000 7fde2fda9640 1 Processor -- start 2024-03-18T00:25:21.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 -- start start 2024-03-18T00:25:21.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde280ae6e0 0x7fde280d0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde2806f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde2815f590 con 0x7fde2815ae90 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fde2815f870 con 0x7fde280ae6e0 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.196+0000 7fde2fda9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fde2806e890 con 0x7fde280d0fb0 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2d344640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fde280ae6e0 0x7fde280d0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2e346640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde2806f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2db45640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fde2815ae90 0x7fde2815ead0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:56584/0 (socket says 172.21.15.81:56584) 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2db45640 1 -- 172.21.15.81:0/3063224405 learned_addr learned my addr 172.21.15.81:0/3063224405 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2d344640 1 -- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 msgr2=0x7fde2806f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2d344640 1 --2- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde2806f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2d344640 1 -- 172.21.15.81:0/3063224405 >> v1:172.21.15.136:6789/0 conn(0x7fde2815ae90 legacy=0x7fde2815ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2d344640 1 -- 172.21.15.81:0/3063224405 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2806eb70 con 0x7fde280ae6e0 2024-03-18T00:25:21.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.197+0000 7fde2cb43640 1 -- 172.21.15.81:0/3063224405 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2436834114 0 0) 0x7fde2815f590 con 0x7fde2815ae90 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2d344640 1 --2- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde280ae6e0 0x7fde280d0a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde1802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24f5f1b409c7a33e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2cb43640 1 -- 172.21.15.81:0/3063224405 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18035020 con 0x7fde280ae6e0 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2cb43640 1 -- 172.21.15.81:0/3063224405 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde18031830 con 0x7fde280ae6e0 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2cb43640 1 -- 172.21.15.81:0/3063224405 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde18031c00 con 0x7fde280ae6e0 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2fda9640 1 -- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde280ae6e0 msgr2=0x7fde280d0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.198+0000 7fde2fda9640 1 --2- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde280ae6e0 0x7fde280d0a70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fde180097a0 tx=0x7fde1802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 -- 172.21.15.81:0/3063224405 shutdown_connections 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 --2- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde2806f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 --2- 172.21.15.81:0/3063224405 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde280ae6e0 0x7fde280d0a70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 -- 172.21.15.81:0/3063224405 >> 172.21.15.81:0/3063224405 conn(0x7fde2806c2d0 msgr2=0x7fde2806c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 -- 172.21.15.81:0/3063224405 shutdown_connections 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.199+0000 7fde2fda9640 1 -- 172.21.15.81:0/3063224405 wait complete. 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 Processor -- start 2024-03-18T00:25:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 -- start start 2024-03-18T00:25:21.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde280b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde2815ae90 0x7fde280b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde2815f1e0 con 0x7fde280ae6e0 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fde280b4950 con 0x7fde2815ae90 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.200+0000 7fde2fda9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fde28143950 con 0x7fde280d0fb0 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57496/0 (socket says 172.21.15.81:57496) 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 -- 172.21.15.81:0/4213539055 learned_addr learned my addr 172.21.15.81:0/4213539055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2e346640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde2815ae90 0x7fde280b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2d344640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde280b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 -- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 msgr2=0x7fde280b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde280b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 -- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde2815ae90 msgr2=0x7fde280b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde2815ae90 0x7fde280b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 -- 172.21.15.81:0/4213539055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde28143de0 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2db45640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde2400c7f0 tx=0x7fde2400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde24018070 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde2400a640 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde280b3820 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde2400aa30 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.201+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde28143020 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.202+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2804f540 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.203+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fde2401b070 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.203+0000 7fde1e7fc640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 0x7fde0c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.203+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fde24089c20 con 0x7fde280ae6e0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.203+0000 7fde2d344640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 0x7fde0c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.203+0000 7fde2d344640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 0x7fde0c06e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde18036000 tx=0x7fde1803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.207+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fde240584a0 con 0x7fde280ae6e0 2024-03-18T00:25:21.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.380+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fde2806e460 con 0x7fde280ae6e0 2024-03-18T00:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.501+0000 7fde1e7fc640 1 -- 172.21.15.81:0/4213539055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fde2405c540 con 0x7fde280ae6e0 2024-03-18T00:25:21.502 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-03-18T00:25:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.503+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 msgr2=0x7fde0c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.503+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 0x7fde0c06e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde18036000 tx=0x7fde1803d040 comp rx=0 tx=0).stop 2024-03-18T00:25:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 msgr2=0x7fde280b32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fde2400c7f0 tx=0x7fde2400ccb0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 shutdown_connections 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fde2815ae90 0x7fde280b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fde280d0fb0 0x7fde280b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fde0c06bbd0 0x7fde0c06e090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 --2- 172.21.15.81:0/4213539055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde280ae6e0 0x7fde280b32e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 >> 172.21.15.81:0/4213539055 conn(0x7fde2806c2d0 msgr2=0x7fde280af170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 shutdown_connections 2024-03-18T00:25:21.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.504+0000 7fde2fda9640 1 -- 172.21.15.81:0/4213539055 wait complete. 2024-03-18T00:25:21.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T00:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.624+0000 7fc61b9b2640 1 Processor -- start 2024-03-18T00:25:21.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 -- start start 2024-03-18T00:25:21.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 0x7fc6140d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6140ce840 0x7fc6140ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 0x7fc6140b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc6140cf1e0 con 0x7fc6140ce840 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc6140cce20 con 0x7fc6140b7110 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc61b9b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140cd100 con 0x7fc61415c140 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc618f4d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6140ce840 0x7fc6140ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.625+0000 7fc618f4d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc6140ce840 0x7fc6140ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57502/0 (socket says 172.21.15.81:57502) 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 -- 172.21.15.81:0/3993597136 learned_addr learned my addr 172.21.15.81:0/3993597136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc619f4f640 1 --2- 172.21.15.81:0/3993597136 >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 0x7fc6140b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc61974e640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 0x7fc6140d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 -- 172.21.15.81:0/3993597136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 msgr2=0x7fc6140d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 0x7fc6140d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 -- 172.21.15.81:0/3993597136 >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 msgr2=0x7fc6140b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 --2- 172.21.15.81:0/3993597136 >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 0x7fc6140b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 -- 172.21.15.81:0/3993597136 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6140cd3e0 con 0x7fc6140ce840 2024-03-18T00:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc61974e640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 0x7fc6140d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc619f4f640 1 --2- 172.21.15.81:0/3993597136 >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 0x7fc6140b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:21.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.626+0000 7fc618f4d640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6140ce840 0x7fc6140ceca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b38f0 tx=0x7fc60402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76bf94a65ca8c15 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc60bfff640 1 -- 172.21.15.81:0/3993597136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604035020 con 0x7fc6140ce840 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc60bfff640 1 -- 172.21.15.81:0/3993597136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60402d040 con 0x7fc6140ce840 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc60bfff640 1 -- 172.21.15.81:0/3993597136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604031a80 con 0x7fc6140ce840 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3993597136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6140ce840 msgr2=0x7fc6140ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6140ce840 0x7fc6140ceca0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc6140b38f0 tx=0x7fc60402b900 comp rx=0 tx=0).stop 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3993597136 shutdown_connections 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3993597136 >> v2:172.21.15.136:3300/0 conn(0x7fc6140b7110 0x7fc6140b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6140ce840 0x7fc6140ceca0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3993597136 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc61415c140 0x7fc6140d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3993597136 >> 172.21.15.81:0/3993597136 conn(0x7fc61409b160 msgr2=0x7fc6140d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:21.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3993597136 shutdown_connections 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.627+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3993597136 wait complete. 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.628+0000 7fc61b9b2640 1 Processor -- start 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.628+0000 7fc61b9b2640 1 -- start start 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6140b7110 0x7fc6140cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ce840 0x7fc6141522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140d0e00 con 0x7fc61415c140 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc6140cd9a0 con 0x7fc6140ce840 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc61b9b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc6140d2710 con 0x7fc6140b7110 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57518/0 (socket says 172.21.15.81:57518) 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 -- 172.21.15.81:0/3526212480 learned_addr learned my addr 172.21.15.81:0/3526212480 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 -- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6140b7110 msgr2=0x7fc6140cbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6140b7110 0x7fc6140cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 -- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ce840 msgr2=0x7fc6141522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc618f4d640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ce840 0x7fc6141522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ce840 0x7fc6141522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.629+0000 7fc619f4f640 1 -- 172.21.15.81:0/3526212480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc614152090 con 0x7fc61415c140 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc619f4f640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00cd10 tx=0x7fc60c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00f680 con 0x7fc61415c140 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc60c00f840 con 0x7fc61415c140 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6140c7520 con 0x7fc61415c140 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60c00fc30 con 0x7fc61415c140 2024-03-18T00:25:21.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.630+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6140c7ae0 con 0x7fc61415c140 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.631+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc61404f540 con 0x7fc61415c140 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.631+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc60c0213f0 con 0x7fc61415c140 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.632+0000 7fc609ffb640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 0x7fc5f806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.632+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fc60c08b600 con 0x7fc61415c140 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.632+0000 7fc61974e640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 0x7fc5f806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:21.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.632+0000 7fc61974e640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 0x7fc5f806e0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc610006fd0 tx=0x7fc610008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:21.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.636+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc60c014030 con 0x7fc61415c140 2024-03-18T00:25:21.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:21.809+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc6140ce620 con 0x7fc61415c140 2024-03-18T00:25:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.503+0000 7fc609ffb640 1 -- 172.21.15.81:0/3526212480 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) ==== 170+0+0 (secure 0 0 0) 0x7fc60c059bf0 con 0x7fc61415c140 2024-03-18T00:25:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-03-18T00:25:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 msgr2=0x7fc5f806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 0x7fc5f806e0c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc610006fd0 tx=0x7fc610008040 comp rx=0 tx=0).stop 2024-03-18T00:25:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 msgr2=0x7fc614151670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00cd10 tx=0x7fc60c00a650 comp rx=0 tx=0).stop 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 shutdown_connections 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc5f806bc00 0x7fc5f806e0c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61415c140 0x7fc614151670 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc6140ce840 0x7fc6141522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 --2- 172.21.15.81:0/3526212480 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc6140b7110 0x7fc6140cbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 >> 172.21.15.81:0/3526212480 conn(0x7fc61409b160 msgr2=0x7fc6140b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 shutdown_connections 2024-03-18T00:25:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.506+0000 7fc61b9b2640 1 -- 172.21.15.81:0/3526212480 wait complete. 2024-03-18T00:25:22.526 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T00:25:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 Processor -- start 2024-03-18T00:25:22.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 -- start start 2024-03-18T00:25:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 0x7fb9ec06be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0b5410 con 0x7fb9ec06c340 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec06b340 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.628+0000 7fb9f0844640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0b56b0 con 0x7fb9ec0b4f60 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57532/0 (socket says 172.21.15.81:57532) 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 -- 172.21.15.81:0/3880768045 learned_addr learned my addr 172.21.15.81:0/3880768045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9e3fff640 1 --2- 172.21.15.81:0/3880768045 >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 0x7fb9ec06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 -- 172.21.15.81:0/3880768045 >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 msgr2=0x7fb9ec06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 --2- 172.21.15.81:0/3880768045 >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 0x7fb9ec06be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 -- 172.21.15.81:0/3880768045 >> v1:172.21.15.136:6789/0 conn(0x7fb9ec06c340 legacy=0x7fb9ec0716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9ea59c640 1 -- 172.21.15.81:0/3880768045 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec06b600 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.629+0000 7fb9e3fff640 1 --2- 172.21.15.81:0/3880768045 >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 0x7fb9ec06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9ea59c640 1 --2- 172.21.15.81:0/3880768045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0d03a0 tx=0x7fb9dc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419a49336a0f8ba1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9e9d9b640 1 -- 172.21.15.81:0/3880768045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc035020 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9e9d9b640 1 -- 172.21.15.81:0/3880768045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc031870 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9e9d9b640 1 -- 172.21.15.81:0/3880768045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc031c40 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 -- 172.21.15.81:0/3880768045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 msgr2=0x7fb9ec0afb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3880768045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0d03a0 tx=0x7fb9dc02b910 comp rx=0 tx=0).stop 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 -- 172.21.15.81:0/3880768045 shutdown_connections 2024-03-18T00:25:22.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3880768045 >> v2:172.21.15.136:3300/0 conn(0x7fb9ec0b4f60 0x7fb9ec06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3880768045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec0afb00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 -- 172.21.15.81:0/3880768045 >> 172.21.15.81:0/3880768045 conn(0x7fb9ec0cd040 msgr2=0x7fb9ec0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 -- 172.21.15.81:0/3880768045 shutdown_connections 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.630+0000 7fb9f0844640 1 -- 172.21.15.81:0/3880768045 wait complete. 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 Processor -- start 2024-03-18T00:25:22.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 -- start start 2024-03-18T00:25:22.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9ec0b4f60 0x7fb9ec157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9ec0ab0a0 0x7fb9ec0ab520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec15c650 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec15c4d0 con 0x7fb9ec0b4f60 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9f0844640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec071db0 con 0x7fb9ec0ab0a0 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57548/0 (socket says 172.21.15.81:57548) 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9e3fff640 1 -- 172.21.15.81:0/3735758775 learned_addr learned my addr 172.21.15.81:0/3735758775 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.632+0000 7fb9ea59c640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9ec0b4f60 0x7fb9ec157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9ead9d640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9ec0ab0a0 0x7fb9ec0ab520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 -- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9ec0ab0a0 msgr2=0x7fb9ec0ab520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9ec0ab0a0 0x7fb9ec0ab520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 -- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9ec0b4f60 msgr2=0x7fb9ec157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:22.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9ec0b4f60 0x7fb9ec157e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 -- 172.21.15.81:0/3735758775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec0ae440 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e3fff640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400e810 tx=0x7fb9d400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d400f040 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9d4004030 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec0ade80 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4004400 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.633+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec0a9550 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.634+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec04f540 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.635+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb9d400c6d0 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.635+0000 7fb9e2ffd640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 0x7fb9cc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.635+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fb9d408aa90 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.635+0000 7fb9ea59c640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 0x7fb9cc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:22.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.635+0000 7fb9ea59c640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 0x7fb9cc06e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc036000 tx=0x7fb9dc03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:22.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.639+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb9d4017020 con 0x7fb9ec15c0f0 2024-03-18T00:25:22.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:25:22.715 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:25:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:22.852+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fb9ec0af510 con 0x7fb9ec15c0f0 2024-03-18T00:25:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.519+0000 7fb9e2ffd640 1 -- 172.21.15.81:0/3735758775 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fb9d4059070 con 0x7fb9ec15c0f0 2024-03-18T00:25:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 msgr2=0x7fb9cc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 0x7fb9cc06e090 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc036000 tx=0x7fb9dc03c040 comp rx=0 tx=0).stop 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 msgr2=0x7fb9ec1e5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400e810 tx=0x7fb9d400ecd0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 shutdown_connections 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb9ec0ab0a0 0x7fb9ec0ab520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb9cc06bbd0 0x7fb9cc06e090 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9ec15c0f0 0x7fb9ec1e5a60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 --2- 172.21.15.81:0/3735758775 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb9ec0b4f60 0x7fb9ec157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.522+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 >> 172.21.15.81:0/3735758775 conn(0x7fb9ec0cd040 msgr2=0x7fb9ec0cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:23.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.523+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 shutdown_connections 2024-03-18T00:25:23.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.525+0000 7fb9f0844640 1 -- 172.21.15.81:0/3735758775 wait complete. 2024-03-18T00:25:23.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.648+0000 7f138a362640 1 Processor -- start 2024-03-18T00:25:23.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.648+0000 7f138a362640 1 -- start start 2024-03-18T00:25:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.649+0000 7f138a362640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 0x7f13840d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.649+0000 7f138a362640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.649+0000 7f138a362640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13840cd510 con 0x7f138415c780 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.649+0000 7f138a362640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f13840cd7f0 con 0x7f13840cef80 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.649+0000 7f138a362640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13840cdad0 con 0x7f138415c3a0 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f1383fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 0x7f13840d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f13888ff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f13888ff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55238/0 (socket says 172.21.15.81:55238) 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f13837fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f138415c780 0x7f13840ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:56604/0 (socket says 172.21.15.81:56604) 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f13888ff640 1 -- 172.21.15.81:0/1433772922 learned_addr learned my addr 172.21.15.81:0/1433772922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f1383fff640 1 -- 172.21.15.81:0/1433772922 >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 msgr2=0x7f13840af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f1383fff640 1 --2- 172.21.15.81:0/1433772922 >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f1383fff640 1 -- 172.21.15.81:0/1433772922 >> v1:172.21.15.136:6789/0 conn(0x7f138415c780 legacy=0x7f13840ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f1383fff640 1 -- 172.21.15.81:0/1433772922 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13840cddb0 con 0x7f138415c3a0 2024-03-18T00:25:23.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.650+0000 7f13888ff640 1 --2- 172.21.15.81:0/1433772922 >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.651+0000 7f1383fff640 1 --2- 172.21.15.81:0/1433772922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 0x7f13840d2980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13740097a0 tx=0x7f137402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c706eea8942492d9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.651+0000 7f1382ffd640 1 -- 172.21.15.81:0/1433772922 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374035020 con 0x7f138415c3a0 2024-03-18T00:25:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.651+0000 7f1382ffd640 1 -- 172.21.15.81:0/1433772922 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1374031830 con 0x7f138415c3a0 2024-03-18T00:25:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.651+0000 7f1382ffd640 1 -- 172.21.15.81:0/1433772922 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1374031c00 con 0x7f138415c3a0 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 -- 172.21.15.81:0/1433772922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 msgr2=0x7f13840d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 --2- 172.21.15.81:0/1433772922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 0x7f13840d2980 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f13740097a0 tx=0x7f137402b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 -- 172.21.15.81:0/1433772922 shutdown_connections 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 --2- 172.21.15.81:0/1433772922 >> v2:172.21.15.136:3300/0 conn(0x7f13840cef80 0x7f13840af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 --2- 172.21.15.81:0/1433772922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c3a0 0x7f13840d2980 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 -- 172.21.15.81:0/1433772922 >> 172.21.15.81:0/1433772922 conn(0x7f13840d1e60 msgr2=0x7f13840d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 -- 172.21.15.81:0/1433772922 shutdown_connections 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.652+0000 7f138a362640 1 -- 172.21.15.81:0/1433772922 wait complete. 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.653+0000 7f138a362640 1 Processor -- start 2024-03-18T00:25:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.653+0000 7f138a362640 1 -- start start 2024-03-18T00:25:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 0x7f138409c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c780 0x7f13840b0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13840cf590 con 0x7f138415c3a0 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13840cf410 con 0x7f13840cef80 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f138a362640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13840af540 con 0x7f138415c780 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f13837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 0x7f138409c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55240/0 (socket says 172.21.15.81:55240) 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f13837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 0x7f138409c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57562/0 (socket says 172.21.15.81:57562) 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 -- 172.21.15.81:0/1990113732 learned_addr learned my addr 172.21.15.81:0/1990113732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f13888ff640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c780 0x7f13840b0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 -- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c780 msgr2=0x7f13840b0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c780 0x7f13840b0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 -- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 msgr2=0x7f138409c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 0x7f138409c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 -- 172.21.15.81:0/1990113732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f138409e220 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.654+0000 7f1383fff640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13740098c0 tx=0x7f13740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f137403b980 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f137403bb20 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f138409e4c0 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13740453f0 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f138409ea80 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.655+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f138404f5b0 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.656+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f137404c060 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.656+0000 7f1380ff9640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 0x7f137006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.656+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f13740ac5b0 con 0x7f13840cef80 2024-03-18T00:25:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.656+0000 7f13837fe640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 0x7f137006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.657+0000 7f13837fe640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 0x7f137006e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13840c8810 tx=0x7f1378000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.661+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1374040070 con 0x7f13840cef80 2024-03-18T00:25:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.837+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1384070720 con 0x7f13840cef80 2024-03-18T00:25:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.839+0000 7f1380ff9640 1 -- 172.21.15.81:0/1990113732 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16630 (secure 0 0 0) 0x7f1374031800 con 0x7f13840cef80 2024-03-18T00:25:23.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:23.840 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:22.854268+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.840+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 msgr2=0x7f137006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.840+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 0x7f137006e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f13840c8810 tx=0x7f1378000ed0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.840+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 msgr2=0x7f138409f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.840+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f13740098c0 tx=0x7f13740046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 shutdown_connections 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f138415c780 0x7f13840b0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f137006bbd0 0x7f137006e090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f138415c3a0 0x7f138409c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 --2- 172.21.15.81:0/1990113732 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13840cef80 0x7f138409f280 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 >> 172.21.15.81:0/1990113732 conn(0x7f13840d1e60 msgr2=0x7f13840c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 shutdown_connections 2024-03-18T00:25:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.841+0000 7f138a362640 1 -- 172.21.15.81:0/1990113732 wait complete. 2024-03-18T00:25:23.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.951+0000 7f1d0ff09640 1 Processor -- start 2024-03-18T00:25:23.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.951+0000 7f1d0ff09640 1 -- start start 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0ff09640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0ff09640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 0x7f1d080d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0ff09640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d080b1750 con 0x7f1d080d1300 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0ff09640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1d081629b0 con 0x7f1d0806f2b0 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0ff09640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d08162ee0 con 0x7f1d0806fab0 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0dca5640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0d4a4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 0x7f1d080d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0e4a6640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1d080d1300 0x7f1d080cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:56618/0 (socket says 172.21.15.81:56618) 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0e4a6640 1 -- 172.21.15.81:0/3079206265 learned_addr learned my addr 172.21.15.81:0/3079206265 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.952+0000 7f1d0dca5640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:48138/0 (socket says 172.21.15.81:48138) 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3079206265 >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 msgr2=0x7f1d080d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:23.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0dca5640 1 --2- 172.21.15.81:0/3079206265 >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 0x7f1d080d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3079206265 >> v1:172.21.15.136:6789/0 conn(0x7f1d080d1300 legacy=0x7f1d080cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3079206265 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d080703d0 con 0x7f1d0806fab0 2024-03-18T00:25:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0d4a4640 1 --2- 172.21.15.81:0/3079206265 >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 0x7f1d080d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:23.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.953+0000 7f1d0dca5640 1 --2- 172.21.15.81:0/3079206265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009d90 tx=0x7f1d0402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8cf1216a2206e88 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0cca3640 1 -- 172.21.15.81:0/3079206265 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04039070 con 0x7f1d0806fab0 2024-03-18T00:25:23.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0cca3640 1 -- 172.21.15.81:0/3079206265 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d0402cc50 con 0x7f1d0806fab0 2024-03-18T00:25:23.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0cca3640 1 -- 172.21.15.81:0/3079206265 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04034440 con 0x7f1d0806fab0 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3079206265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 msgr2=0x7f1d0806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3079206265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009d90 tx=0x7f1d0402bea0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3079206265 shutdown_connections 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3079206265 >> v2:172.21.15.136:3300/0 conn(0x7f1d0806f2b0 0x7f1d080d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3079206265 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0806fe90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3079206265 >> 172.21.15.81:0/3079206265 conn(0x7f1d080d1ee0 msgr2=0x7f1d080d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3079206265 shutdown_connections 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.954+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3079206265 wait complete. 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.955+0000 7f1d0ff09640 1 Processor -- start 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 -- start start 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 0x7f1d0806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080d02e0 con 0x7f1d0806f2b0 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1d08161d70 con 0x7f1d08156330 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0ff09640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1d080d05c0 con 0x7f1d0806fab0 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0dca5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0dca5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57572/0 (socket says 172.21.15.81:57572) 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3610033000 learned_addr learned my addr 172.21.15.81:0/3610033000 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0d4a4640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.956+0000 7f1d0e4a6640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 0x7f1d0806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 msgr2=0x7f1d0815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0815f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 msgr2=0x7f1d0806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:23.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 0x7f1d0806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 -- 172.21.15.81:0/3610033000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0815ec80 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0e4a6640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 0x7f1d0806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0d4a4640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0dca5640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009eb0 tx=0x7f1d04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04039050 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d04045070 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d0815d290 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04009450 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.957+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0815d570 con 0x7f1d0806f2b0 2024-03-18T00:25:23.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.958+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0804f5b0 con 0x7f1d0806f2b0 2024-03-18T00:25:23.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.958+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1d0403e610 con 0x7f1d0806f2b0 2024-03-18T00:25:23.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.959+0000 7f1cfe7fc640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 0x7f1cec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:23.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.959+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f1d040ad500 con 0x7f1d0806f2b0 2024-03-18T00:25:23.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.959+0000 7f1d0d4a4640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 0x7f1cec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:23.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.959+0000 7f1d0d4a4640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 0x7f1cec06e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d0815bdb0 tx=0x7f1cf8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:23.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:23.963+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1d0407c080 con 0x7f1d0806f2b0 2024-03-18T00:25:24.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.138+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d0806f890 con 0x7f1d0806f2b0 2024-03-18T00:25:24.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.139+0000 7f1cfe7fc640 1 -- 172.21.15.81:0/3610033000 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+16630 (secure 0 0 0) 0x7f1d0407b980 con 0x7f1d0806f2b0 2024-03-18T00:25:24.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:24.140 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":19,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:22.854268+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:24.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 msgr2=0x7f1cec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 0x7f1cec06e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d0815bdb0 tx=0x7f1cf8008040 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 msgr2=0x7f1d0815df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1d04009eb0 tx=0x7f1d04004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 shutdown_connections 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1d08156330 0x7f1d0806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1d0806fab0 0x7f1d0815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1cec06bbd0 0x7f1cec06e090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 --2- 172.21.15.81:0/3610033000 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1d0806f2b0 0x7f1d0815df80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 >> 172.21.15.81:0/3610033000 conn(0x7f1d080d1ee0 msgr2=0x7f1d0806c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 shutdown_connections 2024-03-18T00:25:24.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.141+0000 7f1d0ff09640 1 -- 172.21.15.81:0/3610033000 wait complete. 2024-03-18T00:25:24.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T00:25:24.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.254+0000 7f2be1297640 1 Processor -- start 2024-03-18T00:25:24.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.254+0000 7f2be1297640 1 -- start start 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2be1297640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2bdc0ce840 0x7f2bdc0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2be1297640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bdc0cce20 con 0x7f2bdc0b7110 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2be1297640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bdc0cd100 con 0x7f2bdc15c140 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2be1297640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2bdc0cf1e0 con 0x7f2bdc0ce840 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2bdb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2bdc0b7110 0x7f2bdc0b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33166/0 (socket says 172.21.15.81:33166) 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2bdb7fe640 1 -- 172.21.15.81:0/4124354184 learned_addr learned my addr 172.21.15.81:0/4124354184 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.255+0000 7f2bda7fc640 1 --2- 172.21.15.81:0/4124354184 >> v2:172.21.15.136:3300/0 conn(0x7f2bdc0ce840 0x7f2bdc0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686473510 0 0) 0x7f2bdc0cce20 con 0x7f2bdc0b7110 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bc4003520 con 0x7f2bdc0b7110 2024-03-18T00:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bda7fc640 1 -- 172.21.15.81:0/4124354184 >> v1:172.21.15.136:6789/0 conn(0x7f2bdc15c140 legacy=0x7f2bdc0d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548166743 0 0) 0x7f2bdc0cd100 con 0x7f2bdc15c140 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bda7fc640 1 -- 172.21.15.81:0/4124354184 >> v1:172.21.15.81:6789/0 conn(0x7f2bdc0b7110 legacy=0x7f2bdc0b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bda7fc640 1 -- 172.21.15.81:0/4124354184 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc0cd3e0 con 0x7f2bdc0ce840 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.256+0000 7f2bda7fc640 1 --2- 172.21.15.81:0/4124354184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc0ceca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097a0 tx=0x7f2bd002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c91dbde05ac5e188 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0034070 con 0x7f2bdc0ce840 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd0030610 con 0x7f2bdc0ce840 2024-03-18T00:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2bd9ffb640 1 -- 172.21.15.81:0/4124354184 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd00309e0 con 0x7f2bdc0ce840 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 -- 172.21.15.81:0/4124354184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc0ce840 msgr2=0x7f2bdc0ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 --2- 172.21.15.81:0/4124354184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc0ceca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2bd00097a0 tx=0x7f2bd002b960 comp rx=0 tx=0).stop 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 -- 172.21.15.81:0/4124354184 shutdown_connections 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 --2- 172.21.15.81:0/4124354184 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc0ceca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 -- 172.21.15.81:0/4124354184 >> 172.21.15.81:0/4124354184 conn(0x7f2bdc09b160 msgr2=0x7f2bdc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 -- 172.21.15.81:0/4124354184 shutdown_connections 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.257+0000 7f2be1297640 1 -- 172.21.15.81:0/4124354184 wait complete. 2024-03-18T00:25:24.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.258+0000 7f2be1297640 1 Processor -- start 2024-03-18T00:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.258+0000 7f2be1297640 1 -- start start 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2bdc0b7110 0x7f2bdc154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc15c140 0x7f2bdc0b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc0b7cb0 con 0x7f2bdc0ce840 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc0cd9a0 con 0x7f2bdc15c140 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2be1297640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2bdc0d2710 con 0x7f2bdc0b7110 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2bda7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2bda7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57576/0 (socket says 172.21.15.81:57576) 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2bda7fc640 1 -- 172.21.15.81:0/2847122244 learned_addr learned my addr 172.21.15.81:0/2847122244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:24.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2bdaffd640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2bdc0b7110 0x7f2bdc154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.259+0000 7f2bdb7fe640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc15c140 0x7f2bdc0b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 -- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2bdc0b7110 msgr2=0x7f2bdc154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2bdc0b7110 0x7f2bdc154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 -- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc15c140 msgr2=0x7f2bdc0b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc15c140 0x7f2bdc0b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 -- 172.21.15.81:0/2847122244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc06d130 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bda7fc640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0000c00 tx=0x7f2bd00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0034040 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bd0030410 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc158550 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0039c50 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.260+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc06c930 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.261+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bdc04f540 con 0x7f2bdc0ce840 2024-03-18T00:25:24.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.261+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2bd0037070 con 0x7f2bdc0ce840 2024-03-18T00:25:24.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.262+0000 7f2bc37fe640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 0x7f2bc806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:24.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.262+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f2bd00ac880 con 0x7f2bdc0ce840 2024-03-18T00:25:24.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.262+0000 7f2bdaffd640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 0x7f2bc806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:24.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.262+0000 7f2bdaffd640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 0x7f2bc806e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000f60 tx=0x7f2bcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:24.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.266+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2bd007ad20 con 0x7f2bdc0ce840 2024-03-18T00:25:24.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.475+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f2bdc0ce620 con 0x7f2bdc0ce840 2024-03-18T00:25:24.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.940+0000 7f2bc37fe640 1 -- 172.21.15.81:0/2847122244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f2bd007edc0 con 0x7f2bdc0ce840 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 msgr2=0x7f2bc806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 0x7f2bc806e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc000f60 tx=0x7f2bcc009040 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 msgr2=0x7f2bdc157b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0000c00 tx=0x7f2bd00046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 shutdown_connections 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2bdc15c140 0x7f2bdc0b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2bc806bbd0 0x7f2bc806e090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bdc0ce840 0x7f2bdc157b20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 --2- 172.21.15.81:0/2847122244 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2bdc0b7110 0x7f2bdc154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 >> 172.21.15.81:0/2847122244 conn(0x7f2bdc09b160 msgr2=0x7f2bdc0743b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 shutdown_connections 2024-03-18T00:25:24.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:24.942+0000 7f2be1297640 1 -- 172.21.15.81:0/2847122244 wait complete. 2024-03-18T00:25:24.954 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-18T00:25:24.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T00:25:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.057+0000 7f14025df640 1 Processor -- start 2024-03-18T00:25:25.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.057+0000 7f14025df640 1 -- start start 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f14025df640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc0716a0 0x7f13fc06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f14025df640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13fc06b930 0x7f13fc06bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f14025df640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13fc06d700 con 0x7f13fc06c570 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f14025df640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f13fc06efc0 con 0x7f13fc06b930 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f14025df640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc06b1c0 con 0x7f13fc0716a0 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f1400b7c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13fc06b930 0x7f13fc06bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f1400b7c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f13fc06b930 0x7f13fc06bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57580/0 (socket says 172.21.15.81:57580) 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f1400b7c640 1 -- 172.21.15.81:0/751516555 learned_addr learned my addr 172.21.15.81:0/751516555 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.058+0000 7f13fbfff640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc0716a0 0x7f13fc06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f1400b7c640 1 -- 172.21.15.81:0/751516555 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc0716a0 msgr2=0x7f13fc06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f1400b7c640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc0716a0 0x7f13fc06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f1400b7c640 1 -- 172.21.15.81:0/751516555 >> v1:172.21.15.136:6789/0 conn(0x7f13fc06c570 legacy=0x7f13fc071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f1400b7c640 1 -- 172.21.15.81:0/751516555 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc06d9e0 con 0x7f13fc06b930 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f1400b7c640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc06bdc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009e50 tx=0x7f13f402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca8832ec3dacde3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.059+0000 7f13faffd640 1 -- 172.21.15.81:0/751516555 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f402cb00 con 0x7f13fc06b930 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f13faffd640 1 -- 172.21.15.81:0/751516555 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f402cca0 con 0x7f13fc06b930 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f13faffd640 1 -- 172.21.15.81:0/751516555 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4034610 con 0x7f13fc06b930 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 -- 172.21.15.81:0/751516555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 msgr2=0x7f13fc06bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc06bdc0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009e50 tx=0x7f13f402bf60 comp rx=0 tx=0).stop 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 -- 172.21.15.81:0/751516555 shutdown_connections 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc06bdc0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 --2- 172.21.15.81:0/751516555 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc0716a0 0x7f13fc06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 -- 172.21.15.81:0/751516555 >> 172.21.15.81:0/751516555 conn(0x7f13fc0cd040 msgr2=0x7f13fc0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 -- 172.21.15.81:0/751516555 shutdown_connections 2024-03-18T00:25:25.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.060+0000 7f14025df640 1 -- 172.21.15.81:0/751516555 wait complete. 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.061+0000 7f14025df640 1 Processor -- start 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.061+0000 7f14025df640 1 -- start start 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc06c570 0x7f13fc14e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13fc0716a0 0x7f13fc151530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc0cef60 con 0x7f13fc06b930 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc06b4a0 con 0x7f13fc0716a0 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f14025df640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc0cf0e0 con 0x7f13fc06c570 2024-03-18T00:25:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57582/0 (socket says 172.21.15.81:57582) 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 -- 172.21.15.81:0/829871765 learned_addr learned my addr 172.21.15.81:0/829871765 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f1400b7c640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13fc0716a0 0x7f13fc151530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fb7fe640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc06c570 0x7f13fc14e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 -- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc06c570 msgr2=0x7f13fc14e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc06c570 0x7f13fc14e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 -- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13fc0716a0 msgr2=0x7f13fc151530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13fc0716a0 0x7f13fc151530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.062+0000 7f13fbfff640 1 -- 172.21.15.81:0/829871765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc14f780 con 0x7f13fc06b930 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f13fbfff640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13f000e870 tx=0x7f13f000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f0017070 con 0x7f13fc06b930 2024-03-18T00:25:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f000c940 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f000cd30 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc151f10 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.063+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc1524d0 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.064+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc0692d0 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.064+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f13f001a070 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.065+0000 7f13f8ff9640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 0x7f13e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.065+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f13f008a890 con 0x7f13fc06b930 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.065+0000 7f13fb7fe640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 0x7f13e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.065+0000 7f13fb7fe640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 0x7f13e806e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13fc1505b0 tx=0x7f13ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.069+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f13fc0692d0 con 0x7f13fc06b930 2024-03-18T00:25:25.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.277+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f13fc04f540 con 0x7f13fc06b930 2024-03-18T00:25:25.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.944+0000 7f13f8ff9640 1 -- 172.21.15.81:0/829871765 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f13f0058d30 con 0x7f13fc06b930 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 msgr2=0x7f13e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 0x7f13e806e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f13fc1505b0 tx=0x7f13ec009040 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 msgr2=0x7f13fc14f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13f000e870 tx=0x7f13f000ed30 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 shutdown_connections 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f13fc0716a0 0x7f13fc151530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f13fc06c570 0x7f13fc14e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f13e806bbd0 0x7f13e806e090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 --2- 172.21.15.81:0/829871765 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f13fc06b930 0x7f13fc14f0a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:25.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 >> 172.21.15.81:0/829871765 conn(0x7f13fc0cd040 msgr2=0x7f13fc0b3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 shutdown_connections 2024-03-18T00:25:25.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:25.946+0000 7f14025df640 1 -- 172.21.15.81:0/829871765 wait complete. 2024-03-18T00:25:25.958 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T00:25:25.958 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:26.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.058+0000 7f57508b2640 1 Processor -- start 2024-03-18T00:25:26.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.058+0000 7f57508b2640 1 -- start start 2024-03-18T00:25:26.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f57508b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 0x7f574c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f57508b2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574c0cd510 con 0x7f574c0cef80 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f57508b2640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f574c0cd7f0 con 0x7f574c15c3a0 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f57508b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f574c0cdad0 con 0x7f574c15c780 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f574ad9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f574c0cef80 0x7f574c0af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55642/0 (socket says 172.21.15.81:55642) 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.059+0000 7f574ad9d640 1 -- 172.21.15.81:0/4187167324 learned_addr learned my addr 172.21.15.81:0/4187167324 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f5749d9b640 1 --2- 172.21.15.81:0/4187167324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 0x7f574c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783816557 0 0) 0x7f574c0cd510 con 0x7f574c0cef80 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5734003520 con 0x7f574c0cef80 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3219690832 0 0) 0x7f574c0cd7f0 con 0x7f574c15c3a0 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f574c0cd510 con 0x7f574c15c3a0 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f5749d9b640 1 -- 172.21.15.81:0/4187167324 >> v1:172.21.15.136:6789/0 conn(0x7f574c15c3a0 legacy=0x7f574c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f5749d9b640 1 -- 172.21.15.81:0/4187167324 >> v1:172.21.15.81:6789/0 conn(0x7f574c0cef80 legacy=0x7f574c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.060+0000 7f5749d9b640 1 -- 172.21.15.81:0/4187167324 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c0cddb0 con 0x7f574c15c780 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f5749d9b640 1 --2- 172.21.15.81:0/4187167324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 0x7f574c0d2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5740009dc0 tx=0x7f574002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b411ce87a9d7cf90 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740039070 con 0x7f574c15c780 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f574002ccd0 con 0x7f574c15c780 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f574959a640 1 -- 172.21.15.81:0/4187167324 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5740034640 con 0x7f574c15c780 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 -- 172.21.15.81:0/4187167324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 msgr2=0x7f574c0d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 --2- 172.21.15.81:0/4187167324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 0x7f574c0d2980 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5740009dc0 tx=0x7f574002bf20 comp rx=0 tx=0).stop 2024-03-18T00:25:26.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 -- 172.21.15.81:0/4187167324 shutdown_connections 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 --2- 172.21.15.81:0/4187167324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c780 0x7f574c0d2980 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 -- 172.21.15.81:0/4187167324 >> 172.21.15.81:0/4187167324 conn(0x7f574c0d1e60 msgr2=0x7f574c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 -- 172.21.15.81:0/4187167324 shutdown_connections 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.061+0000 7f57508b2640 1 -- 172.21.15.81:0/4187167324 wait complete. 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 Processor -- start 2024-03-18T00:25:26.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 -- start start 2024-03-18T00:25:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c3a0 0x7f574c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f574c15c780 0x7f574c0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0cf590 con 0x7f574c0cef80 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f574c0cf410 con 0x7f574c15c780 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f57508b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f574c0af710 con 0x7f574c15c3a0 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.063+0000 7f574a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59116/0 (socket says 172.21.15.81:59116) 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 -- 172.21.15.81:0/1291615326 learned_addr learned my addr 172.21.15.81:0/1291615326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574ad9d640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f574c15c780 0x7f574c0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f5749d9b640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c3a0 0x7f574c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 -- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c3a0 msgr2=0x7f574c0b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c3a0 0x7f574c0b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 -- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f574c15c780 msgr2=0x7f574c0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f574c15c780 0x7f574c0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 -- 172.21.15.81:0/1291615326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574c0b1a30 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f574a59c640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574400c500 tx=0x7f574400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57440052d0 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5744005490 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574c0b1d10 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5744012870 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.064+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f574c0b22d0 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.065+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f574c0ce370 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.065+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5744012a10 con 0x7f574c0cef80 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.066+0000 7f573affd640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 0x7f572c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.066+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f574408a610 con 0x7f574c0cef80 2024-03-18T00:25:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.066+0000 7f5749d9b640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 0x7f572c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.066+0000 7f5749d9b640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 0x7f572c06e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5740036000 tx=0x7f5740030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.070+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5744058ac0 con 0x7f574c0cef80 2024-03-18T00:25:26.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.278+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f574c04f590 con 0x7f574c0cef80 2024-03-18T00:25:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.279+0000 7f573affd640 1 -- 172.21.15.81:0/1291615326 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f574405cb60 con 0x7f574c0cef80 2024-03-18T00:25:26.279 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:26.279 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:25:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:25:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 msgr2=0x7f572c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 0x7f572c06e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5740036000 tx=0x7f5740030000 comp rx=0 tx=0).stop 2024-03-18T00:25:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 msgr2=0x7f574c159680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f574400c500 tx=0x7f574400c9c0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 shutdown_connections 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f574c15c780 0x7f574c0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f574c15c3a0 0x7f574c0b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572c06bbd0 0x7f572c06e090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 --2- 172.21.15.81:0/1291615326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f574c0cef80 0x7f574c159680 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.280+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 >> 172.21.15.81:0/1291615326 conn(0x7f574c0d1e60 msgr2=0x7f574c15f040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.281+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 shutdown_connections 2024-03-18T00:25:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.281+0000 7f57508b2640 1 -- 172.21.15.81:0/1291615326 wait complete. 2024-03-18T00:25:26.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.391+0000 7f4279e63640 1 Processor -- start 2024-03-18T00:25:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.391+0000 7f4279e63640 1 -- start start 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4279e63640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f427415f520 0x7f42740d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4279e63640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 0x7f42741610c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4279e63640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42740cf4e0 con 0x7f427415e390 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4279e63640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f42740d0060 con 0x7f427415f520 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4279e63640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f42740d2fd0 con 0x7f42740d0fd0 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f42737fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f427415e390 0x7f42740cec00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55648/0 (socket says 172.21.15.81:55648) 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f42737fe640 1 -- 172.21.15.81:0/2112936445 learned_addr learned my addr 172.21.15.81:0/2112936445 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4272ffd640 1 --2- 172.21.15.81:0/2112936445 >> v2:172.21.15.136:3300/0 conn(0x7f427415f520 0x7f42740d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4273fff640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 0x7f42741610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f42727fc640 1 -- 172.21.15.81:0/2112936445 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931777898 0 0) 0x7f42740cf4e0 con 0x7f427415e390 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f42727fc640 1 -- 172.21.15.81:0/2112936445 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f425c003520 con 0x7f427415e390 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4272ffd640 1 -- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 msgr2=0x7f42741610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4272ffd640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 0x7f42741610c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4272ffd640 1 -- 172.21.15.81:0/2112936445 >> v1:172.21.15.81:6789/0 conn(0x7f427415e390 legacy=0x7f42740cec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4272ffd640 1 -- 172.21.15.81:0/2112936445 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42740cf7c0 con 0x7f427415f520 2024-03-18T00:25:26.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.392+0000 7f4273fff640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 0x7f42741610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.393+0000 7f4272ffd640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415f520 0x7f42740d0a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42680097a0 tx=0x7f426802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f59920a059f95df4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.393+0000 7f42727fc640 1 -- 172.21.15.81:0/2112936445 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42680315a0 con 0x7f427415f520 2024-03-18T00:25:26.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.393+0000 7f42727fc640 1 -- 172.21.15.81:0/2112936445 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4268037070 con 0x7f427415f520 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.393+0000 7f42727fc640 1 -- 172.21.15.81:0/2112936445 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4268031940 con 0x7f427415f520 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 -- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415f520 msgr2=0x7f42740d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415f520 0x7f42740d0a90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f42680097a0 tx=0x7f426802b840 comp rx=0 tx=0).stop 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 -- 172.21.15.81:0/2112936445 shutdown_connections 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f42740d0fd0 0x7f42741610c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 --2- 172.21.15.81:0/2112936445 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415f520 0x7f42740d0a90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 -- 172.21.15.81:0/2112936445 >> 172.21.15.81:0/2112936445 conn(0x7f427409d3c0 msgr2=0x7f42740d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 -- 172.21.15.81:0/2112936445 shutdown_connections 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.394+0000 7f4279e63640 1 -- 172.21.15.81:0/2112936445 wait complete. 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.395+0000 7f4279e63640 1 Processor -- start 2024-03-18T00:25:26.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.395+0000 7f4279e63640 1 -- start start 2024-03-18T00:25:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415e390 0x7f4274156ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f427415f520 0x7f427406d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f427415e770 con 0x7f42740d0fd0 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f42740cfd80 con 0x7f427415e390 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f427415fcf0 con 0x7f427415f520 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59132/0 (socket says 172.21.15.81:59132) 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 -- 172.21.15.81:0/1649742415 learned_addr learned my addr 172.21.15.81:0/1649742415 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4272ffd640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415e390 0x7f4274156ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4273fff640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f427415f520 0x7f427406d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 -- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f427415f520 msgr2=0x7f427406d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f427415f520 0x7f427406d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 -- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415e390 msgr2=0x7f4274156ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415e390 0x7f4274156ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 -- 172.21.15.81:0/1649742415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4274157600 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f42737fe640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f426400c430 tx=0x7f426400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4264017070 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4264005ce0 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42640072f0 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42741578e0 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.396+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4274157ea0 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.397+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f427404f5b0 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.398+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f426401a070 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.398+0000 7f425bfff640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 0x7f426006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.398+0000 7f4272ffd640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 0x7f426006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.398+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4264089e10 con 0x7f42740d0fd0 2024-03-18T00:25:26.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.399+0000 7f4272ffd640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 0x7f426006e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.403+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f42640582b0 con 0x7f42740d0fd0 2024-03-18T00:25:26.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.578+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42740ced40 con 0x7f42740d0fd0 2024-03-18T00:25:26.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.579+0000 7f425bfff640 1 -- 172.21.15.81:0/1649742415 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f426405c350 con 0x7f42740d0fd0 2024-03-18T00:25:26.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:26.579 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:26.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 msgr2=0x7f426006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 0x7f426006e090 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4268036000 tx=0x7f426803d040 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 msgr2=0x7f42740b9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f426400c430 tx=0x7f426400c830 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 shutdown_connections 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f427415f520 0x7f427406d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f427415e390 0x7f4274156ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f426006bbd0 0x7f426006e090 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 --2- 172.21.15.81:0/1649742415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42740d0fd0 0x7f42740b9910 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 >> 172.21.15.81:0/1649742415 conn(0x7f427409d3c0 msgr2=0x7f4274074290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 shutdown_connections 2024-03-18T00:25:26.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.581+0000 7f4279e63640 1 -- 172.21.15.81:0/1649742415 wait complete. 2024-03-18T00:25:26.592 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T00:25:26.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.691+0000 7f501fa7e640 1 Processor -- start 2024-03-18T00:25:26.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.691+0000 7f501fa7e640 1 -- start start 2024-03-18T00:25:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501fa7e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f501806bf90 0x7f501806c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501fa7e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50180cf4f0 con 0x7f50180cde00 2024-03-18T00:25:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501fa7e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f501815ec10 con 0x7f50180cda20 2024-03-18T00:25:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501fa7e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f501806b4f0 con 0x7f501806bf90 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501d019640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f50180cde00 0x7f50180cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55664/0 (socket says 172.21.15.81:55664) 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.692+0000 7f501d019640 1 -- 172.21.15.81:0/43445123 learned_addr learned my addr 172.21.15.81:0/43445123 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501e01b640 1 --2- 172.21.15.81:0/43445123 >> v2:172.21.15.136:3300/0 conn(0x7f501806bf90 0x7f501806c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113269009 0 0) 0x7f5008001110 con 0x7f50180cde00 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5004003520 con 0x7f50180cde00 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501e01b640 1 -- 172.21.15.81:0/43445123 >> v1:172.21.15.136:6789/0 conn(0x7f50180cda20 legacy=0x7f501806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468694698 0 0) 0x7f501815ec10 con 0x7f50180cda20 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501e01b640 1 -- 172.21.15.81:0/43445123 >> v1:172.21.15.81:6789/0 conn(0x7f50180cde00 legacy=0x7f50180cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.693+0000 7f501e01b640 1 -- 172.21.15.81:0/43445123 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f501815eef0 con 0x7f501806bf90 2024-03-18T00:25:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501e01b640 1 --2- 172.21.15.81:0/43445123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f501806bf90 0x7f501806c3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f501002bd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b03b98467028d9d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5010039070 con 0x7f501806bf90 2024-03-18T00:25:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f501002c860 con 0x7f501806bf90 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501c818640 1 -- 172.21.15.81:0/43445123 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008001840 con 0x7f501806bf90 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501fa7e640 1 -- 172.21.15.81:0/43445123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f501806bf90 msgr2=0x7f501806c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501fa7e640 1 --2- 172.21.15.81:0/43445123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f501806bf90 0x7f501806c3e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5010009d90 tx=0x7f501002bd30 comp rx=0 tx=0).stop 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501fa7e640 1 -- 172.21.15.81:0/43445123 shutdown_connections 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501fa7e640 1 --2- 172.21.15.81:0/43445123 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f501806bf90 0x7f501806c3e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.694+0000 7f501fa7e640 1 -- 172.21.15.81:0/43445123 >> 172.21.15.81:0/43445123 conn(0x7f50180b2ab0 msgr2=0x7f50180b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.695+0000 7f501fa7e640 1 -- 172.21.15.81:0/43445123 shutdown_connections 2024-03-18T00:25:26.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.695+0000 7f501fa7e640 1 -- 172.21.15.81:0/43445123 wait complete. 2024-03-18T00:25:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 Processor -- start 2024-03-18T00:25:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 -- start start 2024-03-18T00:25:26.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f501806bf90 0x7f50181604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50180cde00 0x7f50181611a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f501815f4b0 con 0x7f50180cda20 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f501806c920 con 0x7f50180cde00 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501fa7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f501815f790 con 0x7f501806bf90 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501d019640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501d019640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59140/0 (socket says 172.21.15.81:59140) 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501d019640 1 -- 172.21.15.81:0/1349877980 learned_addr learned my addr 172.21.15.81:0/1349877980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501d81a640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f501806bf90 0x7f50181604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.696+0000 7f501e01b640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50180cde00 0x7f50181611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 -- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f501806bf90 msgr2=0x7f50181604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f501806bf90 0x7f50181604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 -- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50180cde00 msgr2=0x7f50181611a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50180cde00 0x7f50181611a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 -- 172.21.15.81:0/1349877980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50181616e0 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501d019640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f500800c7a0 tx=0x7f500800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008018070 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50080074e0 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5008004a00 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50180b3b50 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.697+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50180b4110 con 0x7f50180cda20 2024-03-18T00:25:26.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.698+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f501804f5b0 con 0x7f50180cda20 2024-03-18T00:25:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.698+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f500801b070 con 0x7f50180cda20 2024-03-18T00:25:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.699+0000 7f500e7fc640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 0x7f4ffc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.699+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f500808a050 con 0x7f50180cda20 2024-03-18T00:25:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.699+0000 7f501d81a640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 0x7f4ffc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:26.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.699+0000 7f501d81a640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 0x7f4ffc06e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5014000f60 tx=0x7f5014009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:26.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.703+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f50180cf4f0 con 0x7f50180cda20 2024-03-18T00:25:26.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.874+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f501815e950 con 0x7f4ffc06bbd0 2024-03-18T00:25:26.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.880+0000 7f500e7fc640 1 -- 172.21.15.81:0/1349877980 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237139 (secure 0 0 0) 0x7f501815e950 con 0x7f4ffc06bbd0 2024-03-18T00:25:26.883 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:26.884 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 msgr2=0x7f4ffc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 0x7f4ffc06e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5014000f60 tx=0x7f5014009040 comp rx=0 tx=0).stop 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 msgr2=0x7f5018150a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f500800c7a0 tx=0x7f500800cc60 comp rx=0 tx=0).stop 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 shutdown_connections 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f50180cde00 0x7f50181611a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4ffc06bbd0 0x7f4ffc06e090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f50180cda20 0x7f5018150a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 --2- 172.21.15.81:0/1349877980 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f501806bf90 0x7f50181604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 >> 172.21.15.81:0/1349877980 conn(0x7f50180b2ab0 msgr2=0x7f50180d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 shutdown_connections 2024-03-18T00:25:26.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:26.883+0000 7f501fa7e640 1 -- 172.21.15.81:0/1349877980 wait complete. 2024-03-18T00:25:26.895 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-18T00:25:25.359003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218552,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756168,"statfs":{"total":773094113280,"available":772870316032,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-18T00:25:15.553282+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:15.553282+0000","last_peered":"2024-03-18T00:25:15.553282+0000","last_clean":"2024-03-18T00:25:15.553282+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:15.553282+0000","last_undegraded":"2024-03-18T00:25:15.553282+0000","last_fullsized":"2024-03-18T00:25:15.553282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:26.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.034+0000 7f2f3331d640 1 Processor -- start 2024-03-18T00:25:27.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.034+0000 7f2f3331d640 1 -- start start 2024-03-18T00:25:27.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f3331d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f3331d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 0x7f2f2c0ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f3331d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c15fc70 con 0x7f2f2c1598e0 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f3331d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2f2c0b3c80 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f3331d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c15ff50 con 0x7f2f2c159cc0 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f318ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 0x7f2f2c0ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f310b9640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f2f2c1598e0 0x7f2f2c0d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48484/0 (socket says 172.21.15.81:48484) 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37118/0 (socket says 172.21.15.81:37118) 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f310b9640 1 -- 172.21.15.81:0/2704659538 learned_addr learned my addr 172.21.15.81:0/2704659538 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f318ba640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 0x7f2f2c0ae850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47462/0 (socket says 172.21.15.81:47462) 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 -- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 msgr2=0x7f2f2c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:27.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 0x7f2f2c0ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 -- 172.21.15.81:0/2704659538 >> v1:172.21.15.136:6789/0 conn(0x7f2f2c1598e0 legacy=0x7f2f2c0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f308b8640 1 -- 172.21.15.81:0/2704659538 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c160230 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.035+0000 7f2f23fff640 1 -- 172.21.15.81:0/2704659538 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1402119196 0 0) 0x7f2f2c15fc70 con 0x7f2f2c1598e0 2024-03-18T00:25:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f308b8640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0097a0 tx=0x7f2f1c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9267f8478651908 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f23fff640 1 -- 172.21.15.81:0/2704659538 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c035020 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f23fff640 1 -- 172.21.15.81:0/2704659538 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f1c031830 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f23fff640 1 -- 172.21.15.81:0/2704659538 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c031c00 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f3331d640 1 -- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c0d07f0 msgr2=0x7f2f2c0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.036+0000 7f2f3331d640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0097a0 tx=0x7f2f1c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 -- 172.21.15.81:0/2704659538 shutdown_connections 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c159cc0 0x7f2f2c0ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 --2- 172.21.15.81:0/2704659538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c0d07f0 0x7f2f2c0b3740 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 -- 172.21.15.81:0/2704659538 >> 172.21.15.81:0/2704659538 conn(0x7f2f2c06b5e0 msgr2=0x7f2f2c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 -- 172.21.15.81:0/2704659538 shutdown_connections 2024-03-18T00:25:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.037+0000 7f2f3331d640 1 -- 172.21.15.81:0/2704659538 wait complete. 2024-03-18T00:25:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 Processor -- start 2024-03-18T00:25:27.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 -- start start 2024-03-18T00:25:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c0d07f0 0x7f2f2c1f4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c1598e0 0x7f2f2c14d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c06cc70 con 0x7f2f2c159cc0 2024-03-18T00:25:27.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c1607f0 con 0x7f2f2c1598e0 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.038+0000 7f2f3331d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c06cdf0 con 0x7f2f2c0d07f0 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59154/0 (socket says 172.21.15.81:59154) 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 -- 172.21.15.81:0/449308050 learned_addr learned my addr 172.21.15.81:0/449308050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f310b9640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c0d07f0 0x7f2f2c1f4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f308b8640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c1598e0 0x7f2f2c14d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 -- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c0d07f0 msgr2=0x7f2f2c1f4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c0d07f0 0x7f2f2c1f4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 -- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c1598e0 msgr2=0x7f2f2c14d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c1598e0 0x7f2f2c14d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 -- 172.21.15.81:0/449308050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c1f52b0 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f318ba640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400efc0 tx=0x7f2f2400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24018020 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f24014480 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c1f5550 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f24009e60 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.039+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c1f5b10 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.040+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c04f5b0 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.041+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2f24005d10 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.041+0000 7f2f21ffb640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 0x7f2f1006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.041+0000 7f2f310b9640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 0x7f2f1006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.041+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2f2408b650 con 0x7f2f2c159cc0 2024-03-18T00:25:27.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.042+0000 7f2f310b9640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 0x7f2f1006e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f60 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.046+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2f24022030 con 0x7f2f2c159cc0 2024-03-18T00:25:27.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.215+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2f2c0ad150 con 0x7f2f1006bbd0 2024-03-18T00:25:27.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.220+0000 7f2f21ffb640 1 -- 172.21.15.81:0/449308050 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237139 (secure 0 0 0) 0x7f2f2c0ad150 con 0x7f2f1006bbd0 2024-03-18T00:25:27.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:27.225 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 msgr2=0x7f2f1006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 0x7f2f1006e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000f60 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 msgr2=0x7f2f2c15e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2f2400efc0 tx=0x7f2f2400c490 comp rx=0 tx=0).stop 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 shutdown_connections 2024-03-18T00:25:27.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2f1006bbd0 0x7f2f1006e090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c159cc0 0x7f2f2c15e6d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2f2c1598e0 0x7f2f2c14d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 --2- 172.21.15.81:0/449308050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2f2c0d07f0 0x7f2f2c1f4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 >> 172.21.15.81:0/449308050 conn(0x7f2f2c06b5e0 msgr2=0x7f2f2c15a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 shutdown_connections 2024-03-18T00:25:27.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.223+0000 7f2f3331d640 1 -- 172.21.15.81:0/449308050 wait complete. 2024-03-18T00:25:27.234 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-03-18T00:25:25.359003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":218552,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756168,"statfs":{"total":773094113280,"available":772870316032,"internally_reserved":0,"allocated":2433024,"data_stored":1546872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000688"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":162,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-03-18T00:25:15.553282+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:15.553282+0000","last_peered":"2024-03-18T00:25:15.553282+0000","last_clean":"2024-03-18T00:25:15.553282+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:15.553282+0000","last_undegraded":"2024-03-18T00:25:15.553282+0000","last_fullsized":"2024-03-18T00:25:15.553282+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:22.502686+0000","last_change":"2024-03-18T00:25:22.502686+0000","last_active":"2024-03-18T00:25:22.502686+0000","last_peered":"2024-03-18T00:25:22.502686+0000","last_clean":"2024-03-18T00:25:22.502686+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:22.502686+0000","last_undegraded":"2024-03-18T00:25:22.502686+0000","last_fullsized":"2024-03-18T00:25:22.502686+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T00:25:21.497728+0000","last_change":"2024-03-18T00:25:21.497728+0000","last_active":"2024-03-18T00:25:21.497728+0000","last_peered":"2024-03-18T00:25:21.497728+0000","last_clean":"2024-03-18T00:25:21.497728+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T00:25:21.497728+0000","last_undegraded":"2024-03-18T00:25:21.497728+0000","last_fullsized":"2024-03-18T00:25:21.497728+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27172,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344668,"statfs":{"total":96636764160,"available":96608940032,"internally_reserved":0,"allocated":155648,"data_stored":45767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27752,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344088,"statfs":{"total":96636764160,"available":96608346112,"internally_reserved":0,"allocated":749568,"data_stored":636135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:27.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:27.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.376+0000 7f29f02c0640 1 Processor -- start 2024-03-18T00:25:27.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.376+0000 7f29f02c0640 1 -- start start 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29f02c0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 0x7f29e806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29f02c0640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f29e80d2a00 0x7f29e80cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29f02c0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29e80b1750 con 0x7f29e806f2b0 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29f02c0640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f29e81629b0 con 0x7f29e80d2a00 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29f02c0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f29e8162ee0 con 0x7f29e806fab0 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ed85b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f29e806f2b0 0x7f29e80d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55668/0 (socket says 172.21.15.81:55668) 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ed85b640 1 -- 172.21.15.81:0/2025445013 learned_addr learned my addr 172.21.15.81:0/2025445013 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:27.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee05c640 1 --2- 172.21.15.81:0/2025445013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 0x7f29e806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee85d640 1 --2- 172.21.15.81:0/2025445013 >> v2:172.21.15.136:3300/0 conn(0x7f29e80d2a00 0x7f29e80cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ed05a640 1 -- 172.21.15.81:0/2025445013 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116342292 0 0) 0x7f29e80b1750 con 0x7f29e806f2b0 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ed05a640 1 -- 172.21.15.81:0/2025445013 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29d4003520 con 0x7f29e806f2b0 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee05c640 1 -- 172.21.15.81:0/2025445013 >> v2:172.21.15.136:3300/0 conn(0x7f29e80d2a00 msgr2=0x7f29e80cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee05c640 1 --2- 172.21.15.81:0/2025445013 >> v2:172.21.15.136:3300/0 conn(0x7f29e80d2a00 0x7f29e80cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee05c640 1 -- 172.21.15.81:0/2025445013 >> v1:172.21.15.81:6789/0 conn(0x7f29e806f2b0 legacy=0x7f29e80d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.377+0000 7f29ee05c640 1 -- 172.21.15.81:0/2025445013 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e80703d0 con 0x7f29e806fab0 2024-03-18T00:25:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.378+0000 7f29ee05c640 1 --2- 172.21.15.81:0/2025445013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 0x7f29e806fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef1996cb35933f12 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.378+0000 7f29ed05a640 1 -- 172.21.15.81:0/2025445013 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4035020 con 0x7f29e806fab0 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.378+0000 7f29ed05a640 1 -- 172.21.15.81:0/2025445013 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e4031830 con 0x7f29e806fab0 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.378+0000 7f29ed05a640 1 -- 172.21.15.81:0/2025445013 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e4031be0 con 0x7f29e806fab0 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 -- 172.21.15.81:0/2025445013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 msgr2=0x7f29e806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 --2- 172.21.15.81:0/2025445013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 0x7f29e806fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f29e40097a0 tx=0x7f29e402b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 -- 172.21.15.81:0/2025445013 shutdown_connections 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 --2- 172.21.15.81:0/2025445013 >> v2:172.21.15.136:3300/0 conn(0x7f29e80d2a00 0x7f29e80cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 --2- 172.21.15.81:0/2025445013 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e806fab0 0x7f29e806fe90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 -- 172.21.15.81:0/2025445013 >> 172.21.15.81:0/2025445013 conn(0x7f29e80d1ee0 msgr2=0x7f29e80d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 -- 172.21.15.81:0/2025445013 shutdown_connections 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.379+0000 7f29f02c0640 1 -- 172.21.15.81:0/2025445013 wait complete. 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.380+0000 7f29f02c0640 1 Processor -- start 2024-03-18T00:25:27.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.380+0000 7f29f02c0640 1 -- start start 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e806f2b0 0x7f29e80c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e80d2a00 0x7f29e809c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29e8162c00 con 0x7f29e806fab0 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f29e8161d70 con 0x7f29e806f2b0 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f29e80d02e0 con 0x7f29e80d2a00 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59158/0 (socket says 172.21.15.81:59158) 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 -- 172.21.15.81:0/696922275 learned_addr learned my addr 172.21.15.81:0/696922275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ee05c640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e806f2b0 0x7f29e80c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ee85d640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e80d2a00 0x7f29e809c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 -- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e80d2a00 msgr2=0x7f29e809c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e80d2a00 0x7f29e809c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 -- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e806f2b0 msgr2=0x7f29e80c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e806f2b0 0x7f29e80c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 -- 172.21.15.81:0/696922275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e815de80 con 0x7f29e806fab0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29ed85b640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c390 tx=0x7f29d800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d8017070 con 0x7f29e806fab0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29d8005ce0 con 0x7f29e806fab0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29d80072f0 con 0x7f29e806fab0 2024-03-18T00:25:27.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.381+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e815da10 con 0x7f29e806fab0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.382+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e815e3d0 con 0x7f29e806fab0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.382+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e80c9550 con 0x7f29e806fab0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.383+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f29d801a070 con 0x7f29e806fab0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.383+0000 7f29deffd640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 0x7f29cc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.383+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f29d8089d60 con 0x7f29e806fab0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.383+0000 7f29ee05c640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 0x7f29cc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.384+0000 7f29ee05c640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 0x7f29cc06e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29e4036000 tx=0x7f29e403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.389+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f29e80c9550 con 0x7f29e806fab0 2024-03-18T00:25:27.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.560+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29e804f5b0 con 0x7f29cc06bbd0 2024-03-18T00:25:27.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.566+0000 7f29deffd640 1 -- 172.21.15.81:0/696922275 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f29e804f5b0 con 0x7f29cc06bbd0 2024-03-18T00:25:27.569 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:27.570 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 msgr2=0x7f29cc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 0x7f29cc06e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29e4036000 tx=0x7f29e403d040 comp rx=0 tx=0).stop 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 msgr2=0x7f29e809d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f29d800c390 tx=0x7f29d800c850 comp rx=0 tx=0).stop 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 shutdown_connections 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29e80d2a00 0x7f29e809c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f29cc06bbd0 0x7f29cc06e090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29e806fab0 0x7f29e809d910 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 --2- 172.21.15.81:0/696922275 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29e806f2b0 0x7f29e80c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 >> 172.21.15.81:0/696922275 conn(0x7f29e80d1ee0 msgr2=0x7f29e80b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 shutdown_connections 2024-03-18T00:25:27.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.569+0000 7f29f02c0640 1 -- 172.21.15.81:0/696922275 wait complete. 2024-03-18T00:25:27.580 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-18T00:25:27.359401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.856340"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360165+0000","last_change":"2024-03-18T00:25:23.535915+0000","last_active":"2024-03-18T00:25:25.360165+0000","last_peered":"2024-03-18T00:25:25.360165+0000","last_clean":"2024-03-18T00:25:25.360165+0000","last_became_active":"2024-03-18T00:25:23.535620+0000","last_became_peered":"2024-03-18T00:25:23.535620+0000","last_unstale":"2024-03-18T00:25:25.360165+0000","last_undegraded":"2024-03-18T00:25:25.360165+0000","last_fullsized":"2024-03-18T00:25:25.360165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527350+0000","last_change":"2024-03-18T00:25:23.526470+0000","last_active":"2024-03-18T00:25:24.527350+0000","last_peered":"2024-03-18T00:25:24.527350+0000","last_clean":"2024-03-18T00:25:24.527350+0000","last_became_active":"2024-03-18T00:25:23.526181+0000","last_became_peered":"2024-03-18T00:25:23.526181+0000","last_unstale":"2024-03-18T00:25:24.527350+0000","last_undegraded":"2024-03-18T00:25:24.527350+0000","last_fullsized":"2024-03-18T00:25:24.527350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933336+0000","last_change":"2024-03-18T00:25:23.529914+0000","last_active":"2024-03-18T00:25:24.933336+0000","last_peered":"2024-03-18T00:25:24.933336+0000","last_clean":"2024-03-18T00:25:24.933336+0000","last_became_active":"2024-03-18T00:25:23.529601+0000","last_became_peered":"2024-03-18T00:25:23.529601+0000","last_unstale":"2024-03-18T00:25:24.933336+0000","last_undegraded":"2024-03-18T00:25:24.933336+0000","last_fullsized":"2024-03-18T00:25:24.933336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:42:59.751721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360378+0000","last_change":"2024-03-18T00:25:23.543302+0000","last_active":"2024-03-18T00:25:25.360378+0000","last_peered":"2024-03-18T00:25:25.360378+0000","last_clean":"2024-03-18T00:25:25.360378+0000","last_became_active":"2024-03-18T00:25:23.542926+0000","last_became_peered":"2024-03-18T00:25:23.542926+0000","last_unstale":"2024-03-18T00:25:25.360378+0000","last_undegraded":"2024-03-18T00:25:25.360378+0000","last_fullsized":"2024-03-18T00:25:25.360378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360045+0000","last_change":"2024-03-18T00:25:23.539758+0000","last_active":"2024-03-18T00:25:25.360045+0000","last_peered":"2024-03-18T00:25:25.360045+0000","last_clean":"2024-03-18T00:25:25.360045+0000","last_became_active":"2024-03-18T00:25:23.537575+0000","last_became_peered":"2024-03-18T00:25:23.537575+0000","last_unstale":"2024-03-18T00:25:25.360045+0000","last_undegraded":"2024-03-18T00:25:25.360045+0000","last_fullsized":"2024-03-18T00:25:25.360045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360144+0000","last_change":"2024-03-18T00:25:23.528725+0000","last_active":"2024-03-18T00:25:25.360144+0000","last_peered":"2024-03-18T00:25:25.360144+0000","last_clean":"2024-03-18T00:25:25.360144+0000","last_became_active":"2024-03-18T00:25:23.528456+0000","last_became_peered":"2024-03-18T00:25:23.528456+0000","last_unstale":"2024-03-18T00:25:25.360144+0000","last_undegraded":"2024-03-18T00:25:25.360144+0000","last_fullsized":"2024-03-18T00:25:25.360144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359549+0000","last_change":"2024-03-18T00:25:23.532811+0000","last_active":"2024-03-18T00:25:25.359549+0000","last_peered":"2024-03-18T00:25:25.359549+0000","last_clean":"2024-03-18T00:25:25.359549+0000","last_became_active":"2024-03-18T00:25:23.530841+0000","last_became_peered":"2024-03-18T00:25:23.530841+0000","last_unstale":"2024-03-18T00:25:25.359549+0000","last_undegraded":"2024-03-18T00:25:25.359549+0000","last_fullsized":"2024-03-18T00:25:25.359549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524831+0000","last_change":"2024-03-18T00:25:23.536908+0000","last_active":"2024-03-18T00:25:24.524831+0000","last_peered":"2024-03-18T00:25:24.524831+0000","last_clean":"2024-03-18T00:25:24.524831+0000","last_became_active":"2024-03-18T00:25:23.536369+0000","last_became_peered":"2024-03-18T00:25:23.536369+0000","last_unstale":"2024-03-18T00:25:24.524831+0000","last_undegraded":"2024-03-18T00:25:24.524831+0000","last_fullsized":"2024-03-18T00:25:24.524831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360205+0000","last_change":"2024-03-18T00:25:23.535358+0000","last_active":"2024-03-18T00:25:25.360205+0000","last_peered":"2024-03-18T00:25:25.360205+0000","last_clean":"2024-03-18T00:25:25.360205+0000","last_became_active":"2024-03-18T00:25:23.535099+0000","last_became_peered":"2024-03-18T00:25:23.535099+0000","last_unstale":"2024-03-18T00:25:25.360205+0000","last_undegraded":"2024-03-18T00:25:25.360205+0000","last_fullsized":"2024-03-18T00:25:25.360205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525233+0000","last_change":"2024-03-18T00:25:23.524721+0000","last_active":"2024-03-18T00:25:24.525233+0000","last_peered":"2024-03-18T00:25:24.525233+0000","last_clean":"2024-03-18T00:25:24.525233+0000","last_became_active":"2024-03-18T00:25:23.524434+0000","last_became_peered":"2024-03-18T00:25:23.524434+0000","last_unstale":"2024-03-18T00:25:24.525233+0000","last_undegraded":"2024-03-18T00:25:24.525233+0000","last_fullsized":"2024-03-18T00:25:24.525233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525031+0000","last_change":"2024-03-18T00:25:23.525372+0000","last_active":"2024-03-18T00:25:24.525031+0000","last_peered":"2024-03-18T00:25:24.525031+0000","last_clean":"2024-03-18T00:25:24.525031+0000","last_became_active":"2024-03-18T00:25:23.524989+0000","last_became_peered":"2024-03-18T00:25:23.524989+0000","last_unstale":"2024-03-18T00:25:24.525031+0000","last_undegraded":"2024-03-18T00:25:24.525031+0000","last_fullsized":"2024-03-18T00:25:24.525031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859513+0000","last_change":"2024-03-18T00:25:23.536156+0000","last_active":"2024-03-18T00:25:24.859513+0000","last_peered":"2024-03-18T00:25:24.859513+0000","last_clean":"2024-03-18T00:25:24.859513+0000","last_became_active":"2024-03-18T00:25:23.535858+0000","last_became_peered":"2024-03-18T00:25:23.535858+0000","last_unstale":"2024-03-18T00:25:24.859513+0000","last_undegraded":"2024-03-18T00:25:24.859513+0000","last_fullsized":"2024-03-18T00:25:24.859513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524955+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.524955+0000","last_peered":"2024-03-18T00:25:24.524955+0000","last_clean":"2024-03-18T00:25:24.524955+0000","last_became_active":"2024-03-18T00:25:23.537444+0000","last_became_peered":"2024-03-18T00:25:23.537444+0000","last_unstale":"2024-03-18T00:25:24.524955+0000","last_undegraded":"2024-03-18T00:25:24.524955+0000","last_fullsized":"2024-03-18T00:25:24.524955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933313+0000","last_change":"2024-03-18T00:25:23.528214+0000","last_active":"2024-03-18T00:25:24.933313+0000","last_peered":"2024-03-18T00:25:24.933313+0000","last_clean":"2024-03-18T00:25:24.933313+0000","last_became_active":"2024-03-18T00:25:23.527939+0000","last_became_peered":"2024-03-18T00:25:23.527939+0000","last_unstale":"2024-03-18T00:25:24.933313+0000","last_undegraded":"2024-03-18T00:25:24.933313+0000","last_fullsized":"2024-03-18T00:25:24.933313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:48.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527062+0000","last_change":"2024-03-18T00:25:23.539451+0000","last_active":"2024-03-18T00:25:24.527062+0000","last_peered":"2024-03-18T00:25:24.527062+0000","last_clean":"2024-03-18T00:25:24.527062+0000","last_became_active":"2024-03-18T00:25:23.539183+0000","last_became_peered":"2024-03-18T00:25:23.539183+0000","last_unstale":"2024-03-18T00:25:24.527062+0000","last_undegraded":"2024-03-18T00:25:24.527062+0000","last_fullsized":"2024-03-18T00:25:24.527062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359583+0000","last_change":"2024-03-18T00:25:23.529121+0000","last_active":"2024-03-18T00:25:25.359583+0000","last_peered":"2024-03-18T00:25:25.359583+0000","last_clean":"2024-03-18T00:25:25.359583+0000","last_became_active":"2024-03-18T00:25:23.528826+0000","last_became_peered":"2024-03-18T00:25:23.528826+0000","last_unstale":"2024-03-18T00:25:25.359583+0000","last_undegraded":"2024-03-18T00:25:25.359583+0000","last_fullsized":"2024-03-18T00:25:25.359583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360000+0000","last_change":"2024-03-18T00:25:23.532218+0000","last_active":"2024-03-18T00:25:25.360000+0000","last_peered":"2024-03-18T00:25:25.360000+0000","last_clean":"2024-03-18T00:25:25.360000+0000","last_became_active":"2024-03-18T00:25:23.531962+0000","last_became_peered":"2024-03-18T00:25:23.531962+0000","last_unstale":"2024-03-18T00:25:25.360000+0000","last_undegraded":"2024-03-18T00:25:25.360000+0000","last_fullsized":"2024-03-18T00:25:25.360000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359804+0000","last_change":"2024-03-18T00:25:23.531016+0000","last_active":"2024-03-18T00:25:25.359804+0000","last_peered":"2024-03-18T00:25:25.359804+0000","last_clean":"2024-03-18T00:25:25.359804+0000","last_became_active":"2024-03-18T00:25:23.530710+0000","last_became_peered":"2024-03-18T00:25:23.530710+0000","last_unstale":"2024-03-18T00:25:25.359804+0000","last_undegraded":"2024-03-18T00:25:25.359804+0000","last_fullsized":"2024-03-18T00:25:25.359804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360675+0000","last_change":"2024-03-18T00:25:23.532105+0000","last_active":"2024-03-18T00:25:25.360675+0000","last_peered":"2024-03-18T00:25:25.360675+0000","last_clean":"2024-03-18T00:25:25.360675+0000","last_became_active":"2024-03-18T00:25:23.531767+0000","last_became_peered":"2024-03-18T00:25:23.531767+0000","last_unstale":"2024-03-18T00:25:25.360675+0000","last_undegraded":"2024-03-18T00:25:25.360675+0000","last_fullsized":"2024-03-18T00:25:25.360675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:03.624129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525483+0000","last_change":"2024-03-18T00:25:23.535568+0000","last_active":"2024-03-18T00:25:24.525483+0000","last_peered":"2024-03-18T00:25:24.525483+0000","last_clean":"2024-03-18T00:25:24.525483+0000","last_became_active":"2024-03-18T00:25:23.535301+0000","last_became_peered":"2024-03-18T00:25:23.535301+0000","last_unstale":"2024-03-18T00:25:24.525483+0000","last_undegraded":"2024-03-18T00:25:24.525483+0000","last_fullsized":"2024-03-18T00:25:24.525483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.531923+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.531605+0000","last_became_peered":"2024-03-18T00:25:23.531605+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360278+0000","last_change":"2024-03-18T00:25:23.540875+0000","last_active":"2024-03-18T00:25:25.360278+0000","last_peered":"2024-03-18T00:25:25.360278+0000","last_clean":"2024-03-18T00:25:25.360278+0000","last_became_active":"2024-03-18T00:25:23.540621+0000","last_became_peered":"2024-03-18T00:25:23.540621+0000","last_unstale":"2024-03-18T00:25:25.360278+0000","last_undegraded":"2024-03-18T00:25:25.360278+0000","last_fullsized":"2024-03-18T00:25:25.360278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524925+0000","last_change":"2024-03-18T00:25:23.540944+0000","last_active":"2024-03-18T00:25:24.524925+0000","last_peered":"2024-03-18T00:25:24.524925+0000","last_clean":"2024-03-18T00:25:24.524925+0000","last_became_active":"2024-03-18T00:25:23.540662+0000","last_became_peered":"2024-03-18T00:25:23.540662+0000","last_unstale":"2024-03-18T00:25:24.524925+0000","last_undegraded":"2024-03-18T00:25:24.524925+0000","last_fullsized":"2024-03-18T00:25:24.524925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359780+0000","last_change":"2024-03-18T00:25:23.538366+0000","last_active":"2024-03-18T00:25:25.359780+0000","last_peered":"2024-03-18T00:25:25.359780+0000","last_clean":"2024-03-18T00:25:25.359780+0000","last_became_active":"2024-03-18T00:25:23.538091+0000","last_became_peered":"2024-03-18T00:25:23.538091+0000","last_unstale":"2024-03-18T00:25:25.359780+0000","last_undegraded":"2024-03-18T00:25:25.359780+0000","last_fullsized":"2024-03-18T00:25:25.359780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525286+0000","last_change":"2024-03-18T00:25:23.539971+0000","last_active":"2024-03-18T00:25:24.525286+0000","last_peered":"2024-03-18T00:25:24.525286+0000","last_clean":"2024-03-18T00:25:24.525286+0000","last_became_active":"2024-03-18T00:25:23.539703+0000","last_became_peered":"2024-03-18T00:25:23.539703+0000","last_unstale":"2024-03-18T00:25:24.525286+0000","last_undegraded":"2024-03-18T00:25:24.525286+0000","last_fullsized":"2024-03-18T00:25:24.525286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525354+0000","last_change":"2024-03-18T00:25:23.528213+0000","last_active":"2024-03-18T00:25:24.525354+0000","last_peered":"2024-03-18T00:25:24.525354+0000","last_clean":"2024-03-18T00:25:24.525354+0000","last_became_active":"2024-03-18T00:25:23.527957+0000","last_became_peered":"2024-03-18T00:25:23.527957+0000","last_unstale":"2024-03-18T00:25:24.525354+0000","last_undegraded":"2024-03-18T00:25:24.525354+0000","last_fullsized":"2024-03-18T00:25:24.525354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527277+0000","last_change":"2024-03-18T00:25:23.538220+0000","last_active":"2024-03-18T00:25:24.527277+0000","last_peered":"2024-03-18T00:25:24.527277+0000","last_clean":"2024-03-18T00:25:24.527277+0000","last_became_active":"2024-03-18T00:25:23.537965+0000","last_became_peered":"2024-03-18T00:25:23.537965+0000","last_unstale":"2024-03-18T00:25:24.527277+0000","last_undegraded":"2024-03-18T00:25:24.527277+0000","last_fullsized":"2024-03-18T00:25:24.527277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525245+0000","last_change":"2024-03-18T00:25:23.540936+0000","last_active":"2024-03-18T00:25:24.525245+0000","last_peered":"2024-03-18T00:25:24.525245+0000","last_clean":"2024-03-18T00:25:24.525245+0000","last_became_active":"2024-03-18T00:25:23.540679+0000","last_became_peered":"2024-03-18T00:25:23.540679+0000","last_unstale":"2024-03-18T00:25:24.525245+0000","last_undegraded":"2024-03-18T00:25:24.525245+0000","last_fullsized":"2024-03-18T00:25:24.525245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933579+0000","last_change":"2024-03-18T00:25:23.538218+0000","last_active":"2024-03-18T00:25:24.933579+0000","last_peered":"2024-03-18T00:25:24.933579+0000","last_clean":"2024-03-18T00:25:24.933579+0000","last_became_active":"2024-03-18T00:25:23.537892+0000","last_became_peered":"2024-03-18T00:25:23.537892+0000","last_unstale":"2024-03-18T00:25:24.933579+0000","last_undegraded":"2024-03-18T00:25:24.933579+0000","last_fullsized":"2024-03-18T00:25:24.933579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360411+0000","last_change":"2024-03-18T00:25:23.539202+0000","last_active":"2024-03-18T00:25:25.360411+0000","last_peered":"2024-03-18T00:25:25.360411+0000","last_clean":"2024-03-18T00:25:25.360411+0000","last_became_active":"2024-03-18T00:25:23.538922+0000","last_became_peered":"2024-03-18T00:25:23.538922+0000","last_unstale":"2024-03-18T00:25:25.360411+0000","last_undegraded":"2024-03-18T00:25:25.360411+0000","last_fullsized":"2024-03-18T00:25:25.360411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359685+0000","last_change":"2024-03-18T00:25:23.529487+0000","last_active":"2024-03-18T00:25:25.359685+0000","last_peered":"2024-03-18T00:25:25.359685+0000","last_clean":"2024-03-18T00:25:25.359685+0000","last_became_active":"2024-03-18T00:25:23.529211+0000","last_became_peered":"2024-03-18T00:25:23.529211+0000","last_unstale":"2024-03-18T00:25:25.359685+0000","last_undegraded":"2024-03-18T00:25:25.359685+0000","last_fullsized":"2024-03-18T00:25:25.359685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524820+0000","last_change":"2024-03-18T00:25:23.526131+0000","last_active":"2024-03-18T00:25:24.524820+0000","last_peered":"2024-03-18T00:25:24.524820+0000","last_clean":"2024-03-18T00:25:24.524820+0000","last_became_active":"2024-03-18T00:25:23.525869+0000","last_became_peered":"2024-03-18T00:25:23.525869+0000","last_unstale":"2024-03-18T00:25:24.524820+0000","last_undegraded":"2024-03-18T00:25:24.524820+0000","last_fullsized":"2024-03-18T00:25:24.524820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859267+0000","last_change":"2024-03-18T00:25:23.528904+0000","last_active":"2024-03-18T00:25:24.859267+0000","last_peered":"2024-03-18T00:25:24.859267+0000","last_clean":"2024-03-18T00:25:24.859267+0000","last_became_active":"2024-03-18T00:25:23.528637+0000","last_became_peered":"2024-03-18T00:25:23.528637+0000","last_unstale":"2024-03-18T00:25:24.859267+0000","last_undegraded":"2024-03-18T00:25:24.859267+0000","last_fullsized":"2024-03-18T00:25:24.859267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:50.372929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525171+0000","last_change":"2024-03-18T00:25:22.525633+0000","last_active":"2024-03-18T00:25:24.525171+0000","last_peered":"2024-03-18T00:25:24.525171+0000","last_clean":"2024-03-18T00:25:24.525171+0000","last_became_active":"2024-03-18T00:25:22.525293+0000","last_became_peered":"2024-03-18T00:25:22.525293+0000","last_unstale":"2024-03-18T00:25:24.525171+0000","last_undegraded":"2024-03-18T00:25:24.525171+0000","last_fullsized":"2024-03-18T00:25:24.525171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:29:02.213393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933633+0000","last_change":"2024-03-18T00:25:23.532009+0000","last_active":"2024-03-18T00:25:24.933633+0000","last_peered":"2024-03-18T00:25:24.933633+0000","last_clean":"2024-03-18T00:25:24.933633+0000","last_became_active":"2024-03-18T00:25:23.531736+0000","last_became_peered":"2024-03-18T00:25:23.531736+0000","last_unstale":"2024-03-18T00:25:24.933633+0000","last_undegraded":"2024-03-18T00:25:24.933633+0000","last_fullsized":"2024-03-18T00:25:24.933633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524921+0000","last_change":"2024-03-18T00:25:22.521332+0000","last_active":"2024-03-18T00:25:24.524921+0000","last_peered":"2024-03-18T00:25:24.524921+0000","last_clean":"2024-03-18T00:25:24.524921+0000","last_became_active":"2024-03-18T00:25:22.520113+0000","last_became_peered":"2024-03-18T00:25:22.520113+0000","last_unstale":"2024-03-18T00:25:24.524921+0000","last_undegraded":"2024-03-18T00:25:24.524921+0000","last_fullsized":"2024-03-18T00:25:24.524921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524901+0000","last_change":"2024-03-18T00:25:22.525936+0000","last_active":"2024-03-18T00:25:24.524901+0000","last_peered":"2024-03-18T00:25:24.524901+0000","last_clean":"2024-03-18T00:25:24.524901+0000","last_became_active":"2024-03-18T00:25:22.525688+0000","last_became_peered":"2024-03-18T00:25:22.525688+0000","last_unstale":"2024-03-18T00:25:24.524901+0000","last_undegraded":"2024-03-18T00:25:24.524901+0000","last_fullsized":"2024-03-18T00:25:24.524901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524904+0000","last_change":"2024-03-18T00:25:23.537268+0000","last_active":"2024-03-18T00:25:24.524904+0000","last_peered":"2024-03-18T00:25:24.524904+0000","last_clean":"2024-03-18T00:25:24.524904+0000","last_became_active":"2024-03-18T00:25:23.536747+0000","last_became_peered":"2024-03-18T00:25:23.536747+0000","last_unstale":"2024-03-18T00:25:24.524904+0000","last_undegraded":"2024-03-18T00:25:24.524904+0000","last_fullsized":"2024-03-18T00:25:24.524904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359815+0000","last_change":"2024-03-18T00:25:22.525372+0000","last_active":"2024-03-18T00:25:25.359815+0000","last_peered":"2024-03-18T00:25:25.359815+0000","last_clean":"2024-03-18T00:25:25.359815+0000","last_became_active":"2024-03-18T00:25:22.525058+0000","last_became_peered":"2024-03-18T00:25:22.525058+0000","last_unstale":"2024-03-18T00:25:25.359815+0000","last_undegraded":"2024-03-18T00:25:25.359815+0000","last_fullsized":"2024-03-18T00:25:25.359815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526925+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.526925+0000","last_peered":"2024-03-18T00:25:24.526925+0000","last_clean":"2024-03-18T00:25:24.526925+0000","last_became_active":"2024-03-18T00:25:23.538003+0000","last_became_peered":"2024-03-18T00:25:23.538003+0000","last_unstale":"2024-03-18T00:25:24.526925+0000","last_undegraded":"2024-03-18T00:25:24.526925+0000","last_fullsized":"2024-03-18T00:25:24.526925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525197+0000","last_change":"2024-03-18T00:25:22.512527+0000","last_active":"2024-03-18T00:25:24.525197+0000","last_peered":"2024-03-18T00:25:24.525197+0000","last_clean":"2024-03-18T00:25:24.525197+0000","last_became_active":"2024-03-18T00:25:22.512256+0000","last_became_peered":"2024-03-18T00:25:22.512256+0000","last_unstale":"2024-03-18T00:25:24.525197+0000","last_undegraded":"2024-03-18T00:25:24.525197+0000","last_fullsized":"2024-03-18T00:25:24.525197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360064+0000","last_change":"2024-03-18T00:25:23.536878+0000","last_active":"2024-03-18T00:25:25.360064+0000","last_peered":"2024-03-18T00:25:25.360064+0000","last_clean":"2024-03-18T00:25:25.360064+0000","last_became_active":"2024-03-18T00:25:23.536571+0000","last_became_peered":"2024-03-18T00:25:23.536571+0000","last_unstale":"2024-03-18T00:25:25.360064+0000","last_undegraded":"2024-03-18T00:25:25.360064+0000","last_fullsized":"2024-03-18T00:25:25.360064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360235+0000","last_change":"2024-03-18T00:25:22.516162+0000","last_active":"2024-03-18T00:25:25.360235+0000","last_peered":"2024-03-18T00:25:25.360235+0000","last_clean":"2024-03-18T00:25:25.360235+0000","last_became_active":"2024-03-18T00:25:22.515844+0000","last_became_peered":"2024-03-18T00:25:22.515844+0000","last_unstale":"2024-03-18T00:25:25.360235+0000","last_undegraded":"2024-03-18T00:25:25.360235+0000","last_fullsized":"2024-03-18T00:25:25.360235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.529085+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.528662+0000","last_became_peered":"2024-03-18T00:25:23.528662+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527254+0000","last_change":"2024-03-18T00:25:22.521602+0000","last_active":"2024-03-18T00:25:24.527254+0000","last_peered":"2024-03-18T00:25:24.527254+0000","last_clean":"2024-03-18T00:25:24.527254+0000","last_became_active":"2024-03-18T00:25:22.521328+0000","last_became_peered":"2024-03-18T00:25:22.521328+0000","last_unstale":"2024-03-18T00:25:24.527254+0000","last_undegraded":"2024-03-18T00:25:24.527254+0000","last_fullsized":"2024-03-18T00:25:24.527254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859580+0000","last_change":"2024-03-18T00:25:23.543862+0000","last_active":"2024-03-18T00:25:24.859580+0000","last_peered":"2024-03-18T00:25:24.859580+0000","last_clean":"2024-03-18T00:25:24.859580+0000","last_became_active":"2024-03-18T00:25:23.543558+0000","last_became_peered":"2024-03-18T00:25:23.543558+0000","last_unstale":"2024-03-18T00:25:24.859580+0000","last_undegraded":"2024-03-18T00:25:24.859580+0000","last_fullsized":"2024-03-18T00:25:24.859580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:14.829023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525576+0000","last_change":"2024-03-18T00:25:22.525827+0000","last_active":"2024-03-18T00:25:24.525576+0000","last_peered":"2024-03-18T00:25:24.525576+0000","last_clean":"2024-03-18T00:25:24.525576+0000","last_became_active":"2024-03-18T00:25:22.525551+0000","last_became_peered":"2024-03-18T00:25:22.525551+0000","last_unstale":"2024-03-18T00:25:24.525576+0000","last_undegraded":"2024-03-18T00:25:24.525576+0000","last_fullsized":"2024-03-18T00:25:24.525576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360412+0000","last_change":"2024-03-18T00:25:23.543586+0000","last_active":"2024-03-18T00:25:25.360412+0000","last_peered":"2024-03-18T00:25:25.360412+0000","last_clean":"2024-03-18T00:25:25.360412+0000","last_became_active":"2024-03-18T00:25:23.543343+0000","last_became_peered":"2024-03-18T00:25:23.543343+0000","last_unstale":"2024-03-18T00:25:25.360412+0000","last_undegraded":"2024-03-18T00:25:25.360412+0000","last_fullsized":"2024-03-18T00:25:25.360412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:39:37.708353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933641+0000","last_change":"2024-03-18T00:25:22.525005+0000","last_active":"2024-03-18T00:25:24.933641+0000","last_peered":"2024-03-18T00:25:24.933641+0000","last_clean":"2024-03-18T00:25:24.933641+0000","last_became_active":"2024-03-18T00:25:22.524742+0000","last_became_peered":"2024-03-18T00:25:22.524742+0000","last_unstale":"2024-03-18T00:25:24.933641+0000","last_undegraded":"2024-03-18T00:25:24.933641+0000","last_fullsized":"2024-03-18T00:25:24.933641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933361+0000","last_change":"2024-03-18T00:25:23.525230+0000","last_active":"2024-03-18T00:25:24.933361+0000","last_peered":"2024-03-18T00:25:24.933361+0000","last_clean":"2024-03-18T00:25:24.933361+0000","last_became_active":"2024-03-18T00:25:23.524978+0000","last_became_peered":"2024-03-18T00:25:23.524978+0000","last_unstale":"2024-03-18T00:25:24.933361+0000","last_undegraded":"2024-03-18T00:25:24.933361+0000","last_fullsized":"2024-03-18T00:25:24.933361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360495+0000","last_change":"2024-03-18T00:25:22.524729+0000","last_active":"2024-03-18T00:25:25.360495+0000","last_peered":"2024-03-18T00:25:25.360495+0000","last_clean":"2024-03-18T00:25:25.360495+0000","last_became_active":"2024-03-18T00:25:22.524455+0000","last_became_peered":"2024-03-18T00:25:22.524455+0000","last_unstale":"2024-03-18T00:25:25.360495+0000","last_undegraded":"2024-03-18T00:25:25.360495+0000","last_fullsized":"2024-03-18T00:25:25.360495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:23.541999+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:23.541593+0000","last_became_peered":"2024-03-18T00:25:23.541593+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524819+0000","last_change":"2024-03-18T00:25:22.519877+0000","last_active":"2024-03-18T00:25:24.524819+0000","last_peered":"2024-03-18T00:25:24.524819+0000","last_clean":"2024-03-18T00:25:24.524819+0000","last_became_active":"2024-03-18T00:25:22.519396+0000","last_became_peered":"2024-03-18T00:25:22.519396+0000","last_unstale":"2024-03-18T00:25:24.524819+0000","last_undegraded":"2024-03-18T00:25:24.524819+0000","last_fullsized":"2024-03-18T00:25:24.524819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.526752+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.526434+0000","last_became_peered":"2024-03-18T00:25:23.526434+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359803+0000","last_change":"2024-03-18T00:25:22.518260+0000","last_active":"2024-03-18T00:25:25.359803+0000","last_peered":"2024-03-18T00:25:25.359803+0000","last_clean":"2024-03-18T00:25:25.359803+0000","last_became_active":"2024-03-18T00:25:22.517930+0000","last_became_peered":"2024-03-18T00:25:22.517930+0000","last_unstale":"2024-03-18T00:25:25.359803+0000","last_undegraded":"2024-03-18T00:25:25.359803+0000","last_fullsized":"2024-03-18T00:25:25.359803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359692+0000","last_change":"2024-03-18T00:25:23.541873+0000","last_active":"2024-03-18T00:25:25.359692+0000","last_peered":"2024-03-18T00:25:25.359692+0000","last_clean":"2024-03-18T00:25:25.359692+0000","last_became_active":"2024-03-18T00:25:23.541574+0000","last_became_peered":"2024-03-18T00:25:23.541574+0000","last_unstale":"2024-03-18T00:25:25.359692+0000","last_undegraded":"2024-03-18T00:25:25.359692+0000","last_fullsized":"2024-03-18T00:25:25.359692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859586+0000","last_change":"2024-03-18T00:25:22.524063+0000","last_active":"2024-03-18T00:25:24.859586+0000","last_peered":"2024-03-18T00:25:24.859586+0000","last_clean":"2024-03-18T00:25:24.859586+0000","last_became_active":"2024-03-18T00:25:22.523714+0000","last_became_peered":"2024-03-18T00:25:22.523714+0000","last_unstale":"2024-03-18T00:25:24.859586+0000","last_undegraded":"2024-03-18T00:25:24.859586+0000","last_fullsized":"2024-03-18T00:25:24.859586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360141+0000","last_change":"2024-03-18T00:25:23.542168+0000","last_active":"2024-03-18T00:25:25.360141+0000","last_peered":"2024-03-18T00:25:25.360141+0000","last_clean":"2024-03-18T00:25:25.360141+0000","last_became_active":"2024-03-18T00:25:23.541579+0000","last_became_peered":"2024-03-18T00:25:23.541579+0000","last_unstale":"2024-03-18T00:25:25.360141+0000","last_undegraded":"2024-03-18T00:25:25.360141+0000","last_fullsized":"2024-03-18T00:25:25.360141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359774+0000","last_change":"2024-03-18T00:25:22.525864+0000","last_active":"2024-03-18T00:25:25.359774+0000","last_peered":"2024-03-18T00:25:25.359774+0000","last_clean":"2024-03-18T00:25:25.359774+0000","last_became_active":"2024-03-18T00:25:22.525582+0000","last_became_peered":"2024-03-18T00:25:22.525582+0000","last_unstale":"2024-03-18T00:25:25.359774+0000","last_undegraded":"2024-03-18T00:25:25.359774+0000","last_fullsized":"2024-03-18T00:25:25.359774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360294+0000","last_change":"2024-03-18T00:25:23.542371+0000","last_active":"2024-03-18T00:25:25.360294+0000","last_peered":"2024-03-18T00:25:25.360294+0000","last_clean":"2024-03-18T00:25:25.360294+0000","last_became_active":"2024-03-18T00:25:23.542030+0000","last_became_peered":"2024-03-18T00:25:23.542030+0000","last_unstale":"2024-03-18T00:25:25.360294+0000","last_undegraded":"2024-03-18T00:25:25.360294+0000","last_fullsized":"2024-03-18T00:25:25.360294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:34:40.152850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527312+0000","last_change":"2024-03-18T00:25:22.527178+0000","last_active":"2024-03-18T00:25:24.527312+0000","last_peered":"2024-03-18T00:25:24.527312+0000","last_clean":"2024-03-18T00:25:24.527312+0000","last_became_active":"2024-03-18T00:25:22.526891+0000","last_became_peered":"2024-03-18T00:25:22.526891+0000","last_unstale":"2024-03-18T00:25:24.527312+0000","last_undegraded":"2024-03-18T00:25:24.527312+0000","last_fullsized":"2024-03-18T00:25:24.527312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360509+0000","last_change":"2024-03-18T00:25:23.537093+0000","last_active":"2024-03-18T00:25:25.360509+0000","last_peered":"2024-03-18T00:25:25.360509+0000","last_clean":"2024-03-18T00:25:25.360509+0000","last_became_active":"2024-03-18T00:25:23.536816+0000","last_became_peered":"2024-03-18T00:25:23.536816+0000","last_unstale":"2024-03-18T00:25:25.360509+0000","last_undegraded":"2024-03-18T00:25:25.360509+0000","last_fullsized":"2024-03-18T00:25:25.360509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359667+0000","last_change":"2024-03-18T00:25:22.522241+0000","last_active":"2024-03-18T00:25:25.359667+0000","last_peered":"2024-03-18T00:25:25.359667+0000","last_clean":"2024-03-18T00:25:25.359667+0000","last_became_active":"2024-03-18T00:25:22.521959+0000","last_became_peered":"2024-03-18T00:25:22.521959+0000","last_unstale":"2024-03-18T00:25:25.359667+0000","last_undegraded":"2024-03-18T00:25:25.359667+0000","last_fullsized":"2024-03-18T00:25:25.359667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360544+0000","last_change":"2024-03-18T00:25:23.533012+0000","last_active":"2024-03-18T00:25:25.360544+0000","last_peered":"2024-03-18T00:25:25.360544+0000","last_clean":"2024-03-18T00:25:25.360544+0000","last_became_active":"2024-03-18T00:25:23.532746+0000","last_became_peered":"2024-03-18T00:25:23.532746+0000","last_unstale":"2024-03-18T00:25:25.360544+0000","last_undegraded":"2024-03-18T00:25:25.360544+0000","last_fullsized":"2024-03-18T00:25:25.360544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:06:47.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359515+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:25.359515+0000","last_peered":"2024-03-18T00:25:25.359515+0000","last_clean":"2024-03-18T00:25:25.359515+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:25.359515+0000","last_undegraded":"2024-03-18T00:25:25.359515+0000","last_fullsized":"2024-03-18T00:25:25.359515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:22.518151+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:22.517836+0000","last_became_peered":"2024-03-18T00:25:22.517836+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524976+0000","last_change":"2024-03-18T00:25:23.542819+0000","last_active":"2024-03-18T00:25:24.524976+0000","last_peered":"2024-03-18T00:25:24.524976+0000","last_clean":"2024-03-18T00:25:24.524976+0000","last_became_active":"2024-03-18T00:25:23.541993+0000","last_became_peered":"2024-03-18T00:25:23.541993+0000","last_unstale":"2024-03-18T00:25:24.524976+0000","last_undegraded":"2024-03-18T00:25:24.524976+0000","last_fullsized":"2024-03-18T00:25:24.524976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359453+0000","last_change":"2024-03-18T00:25:22.526454+0000","last_active":"2024-03-18T00:25:25.359453+0000","last_peered":"2024-03-18T00:25:25.359453+0000","last_clean":"2024-03-18T00:25:25.359453+0000","last_became_active":"2024-03-18T00:25:22.525824+0000","last_became_peered":"2024-03-18T00:25:22.525824+0000","last_unstale":"2024-03-18T00:25:25.359453+0000","last_undegraded":"2024-03-18T00:25:25.359453+0000","last_fullsized":"2024-03-18T00:25:25.359453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:36.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933234+0000","last_change":"2024-03-18T00:25:23.533610+0000","last_active":"2024-03-18T00:25:24.933234+0000","last_peered":"2024-03-18T00:25:24.933234+0000","last_clean":"2024-03-18T00:25:24.933234+0000","last_became_active":"2024-03-18T00:25:23.531816+0000","last_became_peered":"2024-03-18T00:25:23.531816+0000","last_unstale":"2024-03-18T00:25:24.933234+0000","last_undegraded":"2024-03-18T00:25:24.933234+0000","last_fullsized":"2024-03-18T00:25:24.933234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:51:00.174852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359686+0000","last_change":"2024-03-18T00:25:22.524836+0000","last_active":"2024-03-18T00:25:25.359686+0000","last_peered":"2024-03-18T00:25:25.359686+0000","last_clean":"2024-03-18T00:25:25.359686+0000","last_became_active":"2024-03-18T00:25:22.524559+0000","last_became_peered":"2024-03-18T00:25:22.524559+0000","last_unstale":"2024-03-18T00:25:25.359686+0000","last_undegraded":"2024-03-18T00:25:25.359686+0000","last_fullsized":"2024-03-18T00:25:25.359686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526935+0000","last_change":"2024-03-18T00:25:23.530154+0000","last_active":"2024-03-18T00:25:24.526935+0000","last_peered":"2024-03-18T00:25:24.526935+0000","last_clean":"2024-03-18T00:25:24.526935+0000","last_became_active":"2024-03-18T00:25:23.529909+0000","last_became_peered":"2024-03-18T00:25:23.529909+0000","last_unstale":"2024-03-18T00:25:24.526935+0000","last_undegraded":"2024-03-18T00:25:24.526935+0000","last_fullsized":"2024-03-18T00:25:24.526935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360581+0000","last_change":"2024-03-18T00:25:22.522580+0000","last_active":"2024-03-18T00:25:25.360581+0000","last_peered":"2024-03-18T00:25:25.360581+0000","last_clean":"2024-03-18T00:25:25.360581+0000","last_became_active":"2024-03-18T00:25:22.522157+0000","last_became_peered":"2024-03-18T00:25:22.522157+0000","last_unstale":"2024-03-18T00:25:25.360581+0000","last_undegraded":"2024-03-18T00:25:25.360581+0000","last_fullsized":"2024-03-18T00:25:25.360581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859361+0000","last_change":"2024-03-18T00:25:23.539763+0000","last_active":"2024-03-18T00:25:24.859361+0000","last_peered":"2024-03-18T00:25:24.859361+0000","last_clean":"2024-03-18T00:25:24.859361+0000","last_became_active":"2024-03-18T00:25:23.539502+0000","last_became_peered":"2024-03-18T00:25:23.539502+0000","last_unstale":"2024-03-18T00:25:24.859361+0000","last_undegraded":"2024-03-18T00:25:24.859361+0000","last_fullsized":"2024-03-18T00:25:24.859361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527211+0000","last_change":"2024-03-18T00:25:22.520229+0000","last_active":"2024-03-18T00:25:24.527211+0000","last_peered":"2024-03-18T00:25:24.527211+0000","last_clean":"2024-03-18T00:25:24.527211+0000","last_became_active":"2024-03-18T00:25:22.519955+0000","last_became_peered":"2024-03-18T00:25:22.519955+0000","last_unstale":"2024-03-18T00:25:24.527211+0000","last_undegraded":"2024-03-18T00:25:24.527211+0000","last_fullsized":"2024-03-18T00:25:24.527211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360629+0000","last_change":"2024-03-18T00:25:23.538375+0000","last_active":"2024-03-18T00:25:25.360629+0000","last_peered":"2024-03-18T00:25:25.360629+0000","last_clean":"2024-03-18T00:25:25.360629+0000","last_became_active":"2024-03-18T00:25:23.538114+0000","last_became_peered":"2024-03-18T00:25:23.538114+0000","last_unstale":"2024-03-18T00:25:25.360629+0000","last_undegraded":"2024-03-18T00:25:25.360629+0000","last_fullsized":"2024-03-18T00:25:25.360629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360706+0000","last_change":"2024-03-18T00:25:22.527522+0000","last_active":"2024-03-18T00:25:25.360706+0000","last_peered":"2024-03-18T00:25:25.360706+0000","last_clean":"2024-03-18T00:25:25.360706+0000","last_became_active":"2024-03-18T00:25:22.527170+0000","last_became_peered":"2024-03-18T00:25:22.527170+0000","last_unstale":"2024-03-18T00:25:25.360706+0000","last_undegraded":"2024-03-18T00:25:25.360706+0000","last_fullsized":"2024-03-18T00:25:25.360706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:50:59.169893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527236+0000","last_change":"2024-03-18T00:25:23.529557+0000","last_active":"2024-03-18T00:25:24.527236+0000","last_peered":"2024-03-18T00:25:24.527236+0000","last_clean":"2024-03-18T00:25:24.527236+0000","last_became_active":"2024-03-18T00:25:23.529316+0000","last_became_peered":"2024-03-18T00:25:23.529316+0000","last_unstale":"2024-03-18T00:25:24.527236+0000","last_undegraded":"2024-03-18T00:25:24.527236+0000","last_fullsized":"2024-03-18T00:25:24.527236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.528528+0000","last_change":"2024-03-18T00:25:22.520956+0000","last_active":"2024-03-18T00:25:24.528528+0000","last_peered":"2024-03-18T00:25:24.528528+0000","last_clean":"2024-03-18T00:25:24.528528+0000","last_became_active":"2024-03-18T00:25:22.520708+0000","last_became_peered":"2024-03-18T00:25:22.520708+0000","last_unstale":"2024-03-18T00:25:24.528528+0000","last_undegraded":"2024-03-18T00:25:24.528528+0000","last_fullsized":"2024-03-18T00:25:24.528528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525346+0000","last_change":"2024-03-18T00:25:23.543671+0000","last_active":"2024-03-18T00:25:24.525346+0000","last_peered":"2024-03-18T00:25:24.525346+0000","last_clean":"2024-03-18T00:25:24.525346+0000","last_became_active":"2024-03-18T00:25:23.543393+0000","last_became_peered":"2024-03-18T00:25:23.543393+0000","last_unstale":"2024-03-18T00:25:24.525346+0000","last_undegraded":"2024-03-18T00:25:24.525346+0000","last_fullsized":"2024-03-18T00:25:24.525346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525281+0000","last_change":"2024-03-18T00:25:22.521876+0000","last_active":"2024-03-18T00:25:24.525281+0000","last_peered":"2024-03-18T00:25:24.525281+0000","last_clean":"2024-03-18T00:25:24.525281+0000","last_became_active":"2024-03-18T00:25:22.521555+0000","last_became_peered":"2024-03-18T00:25:22.521555+0000","last_unstale":"2024-03-18T00:25:24.525281+0000","last_undegraded":"2024-03-18T00:25:24.525281+0000","last_fullsized":"2024-03-18T00:25:24.525281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933490+0000","last_change":"2024-03-18T00:25:23.528031+0000","last_active":"2024-03-18T00:25:24.933490+0000","last_peered":"2024-03-18T00:25:24.933490+0000","last_clean":"2024-03-18T00:25:24.933490+0000","last_became_active":"2024-03-18T00:25:23.527711+0000","last_became_peered":"2024-03-18T00:25:23.527711+0000","last_unstale":"2024-03-18T00:25:24.933490+0000","last_undegraded":"2024-03-18T00:25:24.933490+0000","last_fullsized":"2024-03-18T00:25:24.933490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359454+0000","last_change":"2024-03-18T00:25:22.526660+0000","last_active":"2024-03-18T00:25:25.359454+0000","last_peered":"2024-03-18T00:25:25.359454+0000","last_clean":"2024-03-18T00:25:25.359454+0000","last_became_active":"2024-03-18T00:25:22.526187+0000","last_became_peered":"2024-03-18T00:25:22.526187+0000","last_unstale":"2024-03-18T00:25:25.359454+0000","last_undegraded":"2024-03-18T00:25:25.359454+0000","last_fullsized":"2024-03-18T00:25:25.359454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859319+0000","last_change":"2024-03-18T00:25:23.532831+0000","last_active":"2024-03-18T00:25:24.859319+0000","last_peered":"2024-03-18T00:25:24.859319+0000","last_clean":"2024-03-18T00:25:24.859319+0000","last_became_active":"2024-03-18T00:25:23.532560+0000","last_became_peered":"2024-03-18T00:25:23.532560+0000","last_unstale":"2024-03-18T00:25:24.859319+0000","last_undegraded":"2024-03-18T00:25:24.859319+0000","last_fullsized":"2024-03-18T00:25:24.859319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:53.916378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527047+0000","last_change":"2024-03-18T00:25:22.519545+0000","last_active":"2024-03-18T00:25:24.527047+0000","last_peered":"2024-03-18T00:25:24.527047+0000","last_clean":"2024-03-18T00:25:24.527047+0000","last_became_active":"2024-03-18T00:25:22.519310+0000","last_became_peered":"2024-03-18T00:25:22.519310+0000","last_unstale":"2024-03-18T00:25:24.527047+0000","last_undegraded":"2024-03-18T00:25:24.527047+0000","last_fullsized":"2024-03-18T00:25:24.527047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524965+0000","last_change":"2024-03-18T00:25:23.537154+0000","last_active":"2024-03-18T00:25:24.524965+0000","last_peered":"2024-03-18T00:25:24.524965+0000","last_clean":"2024-03-18T00:25:24.524965+0000","last_became_active":"2024-03-18T00:25:23.536652+0000","last_became_peered":"2024-03-18T00:25:23.536652+0000","last_unstale":"2024-03-18T00:25:24.524965+0000","last_undegraded":"2024-03-18T00:25:24.524965+0000","last_fullsized":"2024-03-18T00:25:24.524965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527167+0000","last_change":"2024-03-18T00:25:22.526658+0000","last_active":"2024-03-18T00:25:24.527167+0000","last_peered":"2024-03-18T00:25:24.527167+0000","last_clean":"2024-03-18T00:25:24.527167+0000","last_became_active":"2024-03-18T00:25:22.526284+0000","last_became_peered":"2024-03-18T00:25:22.526284+0000","last_unstale":"2024-03-18T00:25:24.527167+0000","last_undegraded":"2024-03-18T00:25:24.527167+0000","last_fullsized":"2024-03-18T00:25:24.527167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525137+0000","last_change":"2024-03-18T00:25:23.537415+0000","last_active":"2024-03-18T00:25:24.525137+0000","last_peered":"2024-03-18T00:25:24.525137+0000","last_clean":"2024-03-18T00:25:24.525137+0000","last_became_active":"2024-03-18T00:25:23.537145+0000","last_became_peered":"2024-03-18T00:25:23.537145+0000","last_unstale":"2024-03-18T00:25:24.525137+0000","last_undegraded":"2024-03-18T00:25:24.525137+0000","last_fullsized":"2024-03-18T00:25:24.525137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359988+0000","last_change":"2024-03-18T00:25:22.525503+0000","last_active":"2024-03-18T00:25:25.359988+0000","last_peered":"2024-03-18T00:25:25.359988+0000","last_clean":"2024-03-18T00:25:25.359988+0000","last_became_active":"2024-03-18T00:25:22.525243+0000","last_became_peered":"2024-03-18T00:25:22.525243+0000","last_unstale":"2024-03-18T00:25:25.359988+0000","last_undegraded":"2024-03-18T00:25:25.359988+0000","last_fullsized":"2024-03-18T00:25:25.359988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:47.316817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.530235+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.529957+0000","last_became_peered":"2024-03-18T00:25:23.529957+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360510+0000","last_change":"2024-03-18T00:25:23.542945+0000","last_active":"2024-03-18T00:25:25.360510+0000","last_peered":"2024-03-18T00:25:25.360510+0000","last_clean":"2024-03-18T00:25:25.360510+0000","last_became_active":"2024-03-18T00:25:23.541198+0000","last_became_peered":"2024-03-18T00:25:23.541198+0000","last_unstale":"2024-03-18T00:25:25.360510+0000","last_undegraded":"2024-03-18T00:25:25.360510+0000","last_fullsized":"2024-03-18T00:25:25.360510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359960+0000","last_change":"2024-03-18T00:25:22.524744+0000","last_active":"2024-03-18T00:25:25.359960+0000","last_peered":"2024-03-18T00:25:25.359960+0000","last_clean":"2024-03-18T00:25:25.359960+0000","last_became_active":"2024-03-18T00:25:22.524471+0000","last_became_peered":"2024-03-18T00:25:22.524471+0000","last_unstale":"2024-03-18T00:25:25.359960+0000","last_undegraded":"2024-03-18T00:25:25.359960+0000","last_fullsized":"2024-03-18T00:25:25.359960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:13.824065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360483+0000","last_change":"2024-03-18T00:25:23.535099+0000","last_active":"2024-03-18T00:25:25.360483+0000","last_peered":"2024-03-18T00:25:25.360483+0000","last_clean":"2024-03-18T00:25:25.360483+0000","last_became_active":"2024-03-18T00:25:23.534782+0000","last_became_peered":"2024-03-18T00:25:23.534782+0000","last_unstale":"2024-03-18T00:25:25.360483+0000","last_undegraded":"2024-03-18T00:25:25.360483+0000","last_fullsized":"2024-03-18T00:25:25.360483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360610+0000","last_change":"2024-03-18T00:25:22.524438+0000","last_active":"2024-03-18T00:25:25.360610+0000","last_peered":"2024-03-18T00:25:25.360610+0000","last_clean":"2024-03-18T00:25:25.360610+0000","last_became_active":"2024-03-18T00:25:22.524084+0000","last_became_peered":"2024-03-18T00:25:22.524084+0000","last_unstale":"2024-03-18T00:25:25.360610+0000","last_undegraded":"2024-03-18T00:25:25.360610+0000","last_fullsized":"2024-03-18T00:25:25.360610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:28:12.762540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933449+0000","last_change":"2024-03-18T00:25:23.529284+0000","last_active":"2024-03-18T00:25:24.933449+0000","last_peered":"2024-03-18T00:25:24.933449+0000","last_clean":"2024-03-18T00:25:24.933449+0000","last_became_active":"2024-03-18T00:25:23.529022+0000","last_became_peered":"2024-03-18T00:25:23.529022+0000","last_unstale":"2024-03-18T00:25:24.933449+0000","last_undegraded":"2024-03-18T00:25:24.933449+0000","last_fullsized":"2024-03-18T00:25:24.933449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525414+0000","last_change":"2024-03-18T00:25:22.524838+0000","last_active":"2024-03-18T00:25:24.525414+0000","last_peered":"2024-03-18T00:25:24.525414+0000","last_clean":"2024-03-18T00:25:24.525414+0000","last_became_active":"2024-03-18T00:25:22.524532+0000","last_became_peered":"2024-03-18T00:25:22.524532+0000","last_unstale":"2024-03-18T00:25:24.525414+0000","last_undegraded":"2024-03-18T00:25:24.525414+0000","last_fullsized":"2024-03-18T00:25:24.525414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525427+0000","last_change":"2024-03-18T00:25:23.541815+0000","last_active":"2024-03-18T00:25:24.525427+0000","last_peered":"2024-03-18T00:25:24.525427+0000","last_clean":"2024-03-18T00:25:24.525427+0000","last_became_active":"2024-03-18T00:25:23.541486+0000","last_became_peered":"2024-03-18T00:25:23.541486+0000","last_unstale":"2024-03-18T00:25:24.525427+0000","last_undegraded":"2024-03-18T00:25:24.525427+0000","last_fullsized":"2024-03-18T00:25:24.525427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933609+0000","last_change":"2024-03-18T00:25:22.520313+0000","last_active":"2024-03-18T00:25:24.933609+0000","last_peered":"2024-03-18T00:25:24.933609+0000","last_clean":"2024-03-18T00:25:24.933609+0000","last_became_active":"2024-03-18T00:25:22.520019+0000","last_became_peered":"2024-03-18T00:25:22.520019+0000","last_unstale":"2024-03-18T00:25:24.933609+0000","last_undegraded":"2024-03-18T00:25:24.933609+0000","last_fullsized":"2024-03-18T00:25:24.933609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:27.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-18T00:25:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 Processor -- start 2024-03-18T00:25:27.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 -- start start 2024-03-18T00:25:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d4015f7f0 0x7f6d400d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d4015fbd0 con 0x7f6d400d13a0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6d400d2ab0 con 0x7f6d4015f7f0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d4556f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400d3070 con 0x7f6d400d48b0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d3effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6d4015f7f0 0x7f6d400d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d3f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6d400d13a0 0x7f6d40162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55678/0 (socket says 172.21.15.81:55678) 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.719+0000 7f6d3f7fe640 1 -- 172.21.15.81:0/1434164562 learned_addr learned my addr 172.21.15.81:0/1434164562 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3e7fc640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3effd640 1 -- 172.21.15.81:0/1434164562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 msgr2=0x7f6d400d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3effd640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3effd640 1 -- 172.21.15.81:0/1434164562 >> v1:172.21.15.81:6789/0 conn(0x7f6d400d13a0 legacy=0x7f6d40162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3effd640 1 -- 172.21.15.81:0/1434164562 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400d4f20 con 0x7f6d4015f7f0 2024-03-18T00:25:27.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3dffb640 1 -- 172.21.15.81:0/1434164562 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171783857 0 0) 0x7f6d4015fbd0 con 0x7f6d400d13a0 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.720+0000 7f6d3effd640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4015f7f0 0x7f6d400d0920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009d90 tx=0x7f6d3002be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c4430cef0c664e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d3dffb640 1 -- 172.21.15.81:0/1434164562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30039070 con 0x7f6d4015f7f0 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d3dffb640 1 -- 172.21.15.81:0/1434164562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3002cbc0 con 0x7f6d4015f7f0 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d3dffb640 1 -- 172.21.15.81:0/1434164562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30034440 con 0x7f6d4015f7f0 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 -- 172.21.15.81:0/1434164562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4015f7f0 msgr2=0x7f6d400d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4015f7f0 0x7f6d400d0920 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009d90 tx=0x7f6d3002be10 comp rx=0 tx=0).stop 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 -- 172.21.15.81:0/1434164562 shutdown_connections 2024-03-18T00:25:27.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1434164562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d4015f7f0 0x7f6d400d0920 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 -- 172.21.15.81:0/1434164562 >> 172.21.15.81:0/1434164562 conn(0x7f6d4009d4d0 msgr2=0x7f6d400d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 -- 172.21.15.81:0/1434164562 shutdown_connections 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.721+0000 7f6d4556f640 1 -- 172.21.15.81:0/1434164562 wait complete. 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.722+0000 7f6d4556f640 1 Processor -- start 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 -- start start 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 0x7f6d4015d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400cffa0 con 0x7f6d400d13a0 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6d400c7830 con 0x7f6d4015f7f0 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d4556f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6d400d0120 con 0x7f6d400d48b0 2024-03-18T00:25:27.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59184/0 (socket says 172.21.15.81:59184) 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d3effd640 1 -- 172.21.15.81:0/1468648487 learned_addr learned my addr 172.21.15.81:0/1468648487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d3e7fc640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.723+0000 7f6d3f7fe640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 0x7f6d4015d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 -- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 msgr2=0x7f6d400c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 -- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 msgr2=0x7f6d4015d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 0x7f6d4015d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 -- 172.21.15.81:0/1468648487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d400ca5b0 con 0x7f6d400d13a0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3e7fc640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3f7fe640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 0x7f6d4015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d3effd640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009d90 tx=0x7f6d30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30039050 con 0x7f6d400d13a0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3003a040 con 0x7f6d400d13a0 2024-03-18T00:25:27.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d400c7d50 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3003e610 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.724+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d400c8310 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.725+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d40069050 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.725+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6d30047020 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.726+0000 7f6d277fe640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 0x7f6d2c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.726+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6d300accd0 con 0x7f6d400d13a0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.726+0000 7f6d3e7fc640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 0x7f6d2c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:27.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.726+0000 7f6d3e7fc640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 0x7f6d2c06e0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d401eae20 tx=0x7f6d34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:27.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.731+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6d3004e020 con 0x7f6d400d13a0 2024-03-18T00:25:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.972+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f6d40074890 con 0x7f6d400d13a0 2024-03-18T00:25:27.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.973+0000 7f6d277fe640 1 -- 172.21.15.81:0/1468648487 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1011 (secure 0 0 0) 0x7f6d3007b850 con 0x7f6d400d13a0 2024-03-18T00:25:27.974 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:27.974 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":28,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1710721509,"num_in_osds":8,"osd_in_since":1710721501,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":224215040,"bytes_avail":772869898240,"bytes_total":773094113280,"write_bytes_sec":2447,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4278}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-18T00:24:59.174082+0000","services":{}},"progress_events":{}} 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 msgr2=0x7f6d2c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 0x7f6d2c06e0c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6d401eae20 tx=0x7f6d34008040 comp rx=0 tx=0).stop 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 msgr2=0x7f6d4015e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009d90 tx=0x7f6d30004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 shutdown_connections 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6d4015f7f0 0x7f6d4015d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6d400d48b0 0x7f6d400c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6d2c06bc00 0x7f6d2c06e0c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 --2- 172.21.15.81:0/1468648487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d400d13a0 0x7f6d4015e390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 >> 172.21.15.81:0/1468648487 conn(0x7f6d4009d4d0 msgr2=0x7f6d400b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 shutdown_connections 2024-03-18T00:25:27.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:27.974+0000 7f6d4556f640 1 -- 172.21.15.81:0/1468648487 wait complete. 2024-03-18T00:25:27.985 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-18T00:25:27.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:27.997 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T00:25:27.997+0000 7f838a209640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T00:25:28.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 Processor -- start 2024-03-18T00:25:28.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 -- start start 2024-03-18T00:25:28.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 0x7f77980d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 0x7f77980cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980b1750 con 0x7f779806fab0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f77981629b0 con 0x7f77980d1300 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.085+0000 7f779e910640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7798162ee0 con 0x7f779806f2b0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f779cead640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 0x7f77980cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f77977fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 0x7f77980d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f7797fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f779806fab0 0x7f779806fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48490/0 (socket says 172.21.15.81:48490) 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f7797fff640 1 -- 172.21.15.81:0/2954519494 learned_addr learned my addr 172.21.15.81:0/2954519494 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f77977fe640 1 -- 172.21.15.81:0/2954519494 >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 msgr2=0x7f77980cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f77977fe640 1 --2- 172.21.15.81:0/2954519494 >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 0x7f77980cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f77977fe640 1 -- 172.21.15.81:0/2954519494 >> v1:172.21.15.136:6789/0 conn(0x7f779806fab0 legacy=0x7f779806fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f7796ffd640 1 -- 172.21.15.81:0/2954519494 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701274560 0 0) 0x7f77980b1750 con 0x7f779806fab0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f77977fe640 1 -- 172.21.15.81:0/2954519494 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7798162c00 con 0x7f779806f2b0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.086+0000 7f779cead640 1 --2- 172.21.15.81:0/2954519494 >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 0x7f77980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f77977fe640 1 --2- 172.21.15.81:0/2954519494 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 0x7f77980d0dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f778c0097a0 tx=0x7f778c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd6bc6c8e7e32097 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:28.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f7796ffd640 1 -- 172.21.15.81:0/2954519494 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c035020 con 0x7f779806f2b0 2024-03-18T00:25:28.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f7796ffd640 1 -- 172.21.15.81:0/2954519494 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c031830 con 0x7f779806f2b0 2024-03-18T00:25:28.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f7796ffd640 1 -- 172.21.15.81:0/2954519494 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c031c00 con 0x7f779806f2b0 2024-03-18T00:25:28.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 -- 172.21.15.81:0/2954519494 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 msgr2=0x7f77980d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 --2- 172.21.15.81:0/2954519494 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 0x7f77980d0dc0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f778c0097a0 tx=0x7f778c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 -- 172.21.15.81:0/2954519494 shutdown_connections 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 --2- 172.21.15.81:0/2954519494 >> v2:172.21.15.136:3300/0 conn(0x7f77980d1300 0x7f77980cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 --2- 172.21.15.81:0/2954519494 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806f2b0 0x7f77980d0dc0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 -- 172.21.15.81:0/2954519494 >> 172.21.15.81:0/2954519494 conn(0x7f77980d1ee0 msgr2=0x7f77980d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 -- 172.21.15.81:0/2954519494 shutdown_connections 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.087+0000 7f779e910640 1 -- 172.21.15.81:0/2954519494 wait complete. 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 Processor -- start 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 -- start start 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779814e210 0x7f779815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77980d05c0 con 0x7f779806f2b0 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7798161d70 con 0x7f779814e210 2024-03-18T00:25:28.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.089+0000 7f779e910640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f77980d08a0 con 0x7f779806fab0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7797fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47540/0 (socket says 172.21.15.81:47540) 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f779cead640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779814e210 0x7f779815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7797fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59198/0 (socket says 172.21.15.81:59198) 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 -- 172.21.15.81:0/1518854011 learned_addr learned my addr 172.21.15.81:0/1518854011 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 -- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779814e210 msgr2=0x7f779815cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779814e210 0x7f779815cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 -- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 msgr2=0x7f779809c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 -- 172.21.15.81:0/1518854011 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779809cee0 con 0x7f779806fab0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7797fff640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f77977fe640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f778c0097a0 tx=0x7f778c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:28.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c035040 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c004230 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779809d1c0 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c03a640 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.090+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f779809d780 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.091+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f779804f5b0 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.092+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f778c038020 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.092+0000 7f7794ff9640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 0x7f778406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.092+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f778c0ac800 con 0x7f779806fab0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.092+0000 7f7797fff640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 0x7f778406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:28.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.093+0000 7f7797fff640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 0x7f778406e0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7788000f60 tx=0x7f7788007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:28.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.101+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f778c07b2e0 con 0x7f779806fab0 2024-03-18T00:25:28.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.271+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f779806f890 con 0x7f778406bc00 2024-03-18T00:25:28.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.277+0000 7f7794ff9640 1 -- 172.21.15.81:0/1518854011 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f779806f890 con 0x7f778406bc00 2024-03-18T00:25:28.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:28.281 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 msgr2=0x7f778406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 0x7f778406e0c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7788000f60 tx=0x7f7788007d50 comp rx=0 tx=0).stop 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 msgr2=0x7f779809ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f778c0097a0 tx=0x7f778c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 shutdown_connections 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f779814e210 0x7f779815cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f779806fab0 0x7f779809ec20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778406bc00 0x7f778406e0c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 --2- 172.21.15.81:0/1518854011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f779806f2b0 0x7f779809c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 >> 172.21.15.81:0/1518854011 conn(0x7f77980d1ee0 msgr2=0x7f779815fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 shutdown_connections 2024-03-18T00:25:28.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:28.281+0000 7f779e910640 1 -- 172.21.15.81:0/1518854011 wait complete. 2024-03-18T00:25:28.291 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-03-18T00:25:27.359401+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218960,"kb_used_data":2764,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755760,"statfs":{"total":773094113280,"available":772869898240,"internally_reserved":0,"allocated":2830336,"data_stored":1721528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.856340"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360165+0000","last_change":"2024-03-18T00:25:23.535915+0000","last_active":"2024-03-18T00:25:25.360165+0000","last_peered":"2024-03-18T00:25:25.360165+0000","last_clean":"2024-03-18T00:25:25.360165+0000","last_became_active":"2024-03-18T00:25:23.535620+0000","last_became_peered":"2024-03-18T00:25:23.535620+0000","last_unstale":"2024-03-18T00:25:25.360165+0000","last_undegraded":"2024-03-18T00:25:25.360165+0000","last_fullsized":"2024-03-18T00:25:25.360165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527350+0000","last_change":"2024-03-18T00:25:23.526470+0000","last_active":"2024-03-18T00:25:24.527350+0000","last_peered":"2024-03-18T00:25:24.527350+0000","last_clean":"2024-03-18T00:25:24.527350+0000","last_became_active":"2024-03-18T00:25:23.526181+0000","last_became_peered":"2024-03-18T00:25:23.526181+0000","last_unstale":"2024-03-18T00:25:24.527350+0000","last_undegraded":"2024-03-18T00:25:24.527350+0000","last_fullsized":"2024-03-18T00:25:24.527350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933336+0000","last_change":"2024-03-18T00:25:23.529914+0000","last_active":"2024-03-18T00:25:24.933336+0000","last_peered":"2024-03-18T00:25:24.933336+0000","last_clean":"2024-03-18T00:25:24.933336+0000","last_became_active":"2024-03-18T00:25:23.529601+0000","last_became_peered":"2024-03-18T00:25:23.529601+0000","last_unstale":"2024-03-18T00:25:24.933336+0000","last_undegraded":"2024-03-18T00:25:24.933336+0000","last_fullsized":"2024-03-18T00:25:24.933336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:42:59.751721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360378+0000","last_change":"2024-03-18T00:25:23.543302+0000","last_active":"2024-03-18T00:25:25.360378+0000","last_peered":"2024-03-18T00:25:25.360378+0000","last_clean":"2024-03-18T00:25:25.360378+0000","last_became_active":"2024-03-18T00:25:23.542926+0000","last_became_peered":"2024-03-18T00:25:23.542926+0000","last_unstale":"2024-03-18T00:25:25.360378+0000","last_undegraded":"2024-03-18T00:25:25.360378+0000","last_fullsized":"2024-03-18T00:25:25.360378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360045+0000","last_change":"2024-03-18T00:25:23.539758+0000","last_active":"2024-03-18T00:25:25.360045+0000","last_peered":"2024-03-18T00:25:25.360045+0000","last_clean":"2024-03-18T00:25:25.360045+0000","last_became_active":"2024-03-18T00:25:23.537575+0000","last_became_peered":"2024-03-18T00:25:23.537575+0000","last_unstale":"2024-03-18T00:25:25.360045+0000","last_undegraded":"2024-03-18T00:25:25.360045+0000","last_fullsized":"2024-03-18T00:25:25.360045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360144+0000","last_change":"2024-03-18T00:25:23.528725+0000","last_active":"2024-03-18T00:25:25.360144+0000","last_peered":"2024-03-18T00:25:25.360144+0000","last_clean":"2024-03-18T00:25:25.360144+0000","last_became_active":"2024-03-18T00:25:23.528456+0000","last_became_peered":"2024-03-18T00:25:23.528456+0000","last_unstale":"2024-03-18T00:25:25.360144+0000","last_undegraded":"2024-03-18T00:25:25.360144+0000","last_fullsized":"2024-03-18T00:25:25.360144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359549+0000","last_change":"2024-03-18T00:25:23.532811+0000","last_active":"2024-03-18T00:25:25.359549+0000","last_peered":"2024-03-18T00:25:25.359549+0000","last_clean":"2024-03-18T00:25:25.359549+0000","last_became_active":"2024-03-18T00:25:23.530841+0000","last_became_peered":"2024-03-18T00:25:23.530841+0000","last_unstale":"2024-03-18T00:25:25.359549+0000","last_undegraded":"2024-03-18T00:25:25.359549+0000","last_fullsized":"2024-03-18T00:25:25.359549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524831+0000","last_change":"2024-03-18T00:25:23.536908+0000","last_active":"2024-03-18T00:25:24.524831+0000","last_peered":"2024-03-18T00:25:24.524831+0000","last_clean":"2024-03-18T00:25:24.524831+0000","last_became_active":"2024-03-18T00:25:23.536369+0000","last_became_peered":"2024-03-18T00:25:23.536369+0000","last_unstale":"2024-03-18T00:25:24.524831+0000","last_undegraded":"2024-03-18T00:25:24.524831+0000","last_fullsized":"2024-03-18T00:25:24.524831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360205+0000","last_change":"2024-03-18T00:25:23.535358+0000","last_active":"2024-03-18T00:25:25.360205+0000","last_peered":"2024-03-18T00:25:25.360205+0000","last_clean":"2024-03-18T00:25:25.360205+0000","last_became_active":"2024-03-18T00:25:23.535099+0000","last_became_peered":"2024-03-18T00:25:23.535099+0000","last_unstale":"2024-03-18T00:25:25.360205+0000","last_undegraded":"2024-03-18T00:25:25.360205+0000","last_fullsized":"2024-03-18T00:25:25.360205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525233+0000","last_change":"2024-03-18T00:25:23.524721+0000","last_active":"2024-03-18T00:25:24.525233+0000","last_peered":"2024-03-18T00:25:24.525233+0000","last_clean":"2024-03-18T00:25:24.525233+0000","last_became_active":"2024-03-18T00:25:23.524434+0000","last_became_peered":"2024-03-18T00:25:23.524434+0000","last_unstale":"2024-03-18T00:25:24.525233+0000","last_undegraded":"2024-03-18T00:25:24.525233+0000","last_fullsized":"2024-03-18T00:25:24.525233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525031+0000","last_change":"2024-03-18T00:25:23.525372+0000","last_active":"2024-03-18T00:25:24.525031+0000","last_peered":"2024-03-18T00:25:24.525031+0000","last_clean":"2024-03-18T00:25:24.525031+0000","last_became_active":"2024-03-18T00:25:23.524989+0000","last_became_peered":"2024-03-18T00:25:23.524989+0000","last_unstale":"2024-03-18T00:25:24.525031+0000","last_undegraded":"2024-03-18T00:25:24.525031+0000","last_fullsized":"2024-03-18T00:25:24.525031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859513+0000","last_change":"2024-03-18T00:25:23.536156+0000","last_active":"2024-03-18T00:25:24.859513+0000","last_peered":"2024-03-18T00:25:24.859513+0000","last_clean":"2024-03-18T00:25:24.859513+0000","last_became_active":"2024-03-18T00:25:23.535858+0000","last_became_peered":"2024-03-18T00:25:23.535858+0000","last_unstale":"2024-03-18T00:25:24.859513+0000","last_undegraded":"2024-03-18T00:25:24.859513+0000","last_fullsized":"2024-03-18T00:25:24.859513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524955+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.524955+0000","last_peered":"2024-03-18T00:25:24.524955+0000","last_clean":"2024-03-18T00:25:24.524955+0000","last_became_active":"2024-03-18T00:25:23.537444+0000","last_became_peered":"2024-03-18T00:25:23.537444+0000","last_unstale":"2024-03-18T00:25:24.524955+0000","last_undegraded":"2024-03-18T00:25:24.524955+0000","last_fullsized":"2024-03-18T00:25:24.524955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933313+0000","last_change":"2024-03-18T00:25:23.528214+0000","last_active":"2024-03-18T00:25:24.933313+0000","last_peered":"2024-03-18T00:25:24.933313+0000","last_clean":"2024-03-18T00:25:24.933313+0000","last_became_active":"2024-03-18T00:25:23.527939+0000","last_became_peered":"2024-03-18T00:25:23.527939+0000","last_unstale":"2024-03-18T00:25:24.933313+0000","last_undegraded":"2024-03-18T00:25:24.933313+0000","last_fullsized":"2024-03-18T00:25:24.933313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:48.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527062+0000","last_change":"2024-03-18T00:25:23.539451+0000","last_active":"2024-03-18T00:25:24.527062+0000","last_peered":"2024-03-18T00:25:24.527062+0000","last_clean":"2024-03-18T00:25:24.527062+0000","last_became_active":"2024-03-18T00:25:23.539183+0000","last_became_peered":"2024-03-18T00:25:23.539183+0000","last_unstale":"2024-03-18T00:25:24.527062+0000","last_undegraded":"2024-03-18T00:25:24.527062+0000","last_fullsized":"2024-03-18T00:25:24.527062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359583+0000","last_change":"2024-03-18T00:25:23.529121+0000","last_active":"2024-03-18T00:25:25.359583+0000","last_peered":"2024-03-18T00:25:25.359583+0000","last_clean":"2024-03-18T00:25:25.359583+0000","last_became_active":"2024-03-18T00:25:23.528826+0000","last_became_peered":"2024-03-18T00:25:23.528826+0000","last_unstale":"2024-03-18T00:25:25.359583+0000","last_undegraded":"2024-03-18T00:25:25.359583+0000","last_fullsized":"2024-03-18T00:25:25.359583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360000+0000","last_change":"2024-03-18T00:25:23.532218+0000","last_active":"2024-03-18T00:25:25.360000+0000","last_peered":"2024-03-18T00:25:25.360000+0000","last_clean":"2024-03-18T00:25:25.360000+0000","last_became_active":"2024-03-18T00:25:23.531962+0000","last_became_peered":"2024-03-18T00:25:23.531962+0000","last_unstale":"2024-03-18T00:25:25.360000+0000","last_undegraded":"2024-03-18T00:25:25.360000+0000","last_fullsized":"2024-03-18T00:25:25.360000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359804+0000","last_change":"2024-03-18T00:25:23.531016+0000","last_active":"2024-03-18T00:25:25.359804+0000","last_peered":"2024-03-18T00:25:25.359804+0000","last_clean":"2024-03-18T00:25:25.359804+0000","last_became_active":"2024-03-18T00:25:23.530710+0000","last_became_peered":"2024-03-18T00:25:23.530710+0000","last_unstale":"2024-03-18T00:25:25.359804+0000","last_undegraded":"2024-03-18T00:25:25.359804+0000","last_fullsized":"2024-03-18T00:25:25.359804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360675+0000","last_change":"2024-03-18T00:25:23.532105+0000","last_active":"2024-03-18T00:25:25.360675+0000","last_peered":"2024-03-18T00:25:25.360675+0000","last_clean":"2024-03-18T00:25:25.360675+0000","last_became_active":"2024-03-18T00:25:23.531767+0000","last_became_peered":"2024-03-18T00:25:23.531767+0000","last_unstale":"2024-03-18T00:25:25.360675+0000","last_undegraded":"2024-03-18T00:25:25.360675+0000","last_fullsized":"2024-03-18T00:25:25.360675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:03.624129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525483+0000","last_change":"2024-03-18T00:25:23.535568+0000","last_active":"2024-03-18T00:25:24.525483+0000","last_peered":"2024-03-18T00:25:24.525483+0000","last_clean":"2024-03-18T00:25:24.525483+0000","last_became_active":"2024-03-18T00:25:23.535301+0000","last_became_peered":"2024-03-18T00:25:23.535301+0000","last_unstale":"2024-03-18T00:25:24.525483+0000","last_undegraded":"2024-03-18T00:25:24.525483+0000","last_fullsized":"2024-03-18T00:25:24.525483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.531923+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.531605+0000","last_became_peered":"2024-03-18T00:25:23.531605+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360278+0000","last_change":"2024-03-18T00:25:23.540875+0000","last_active":"2024-03-18T00:25:25.360278+0000","last_peered":"2024-03-18T00:25:25.360278+0000","last_clean":"2024-03-18T00:25:25.360278+0000","last_became_active":"2024-03-18T00:25:23.540621+0000","last_became_peered":"2024-03-18T00:25:23.540621+0000","last_unstale":"2024-03-18T00:25:25.360278+0000","last_undegraded":"2024-03-18T00:25:25.360278+0000","last_fullsized":"2024-03-18T00:25:25.360278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524925+0000","last_change":"2024-03-18T00:25:23.540944+0000","last_active":"2024-03-18T00:25:24.524925+0000","last_peered":"2024-03-18T00:25:24.524925+0000","last_clean":"2024-03-18T00:25:24.524925+0000","last_became_active":"2024-03-18T00:25:23.540662+0000","last_became_peered":"2024-03-18T00:25:23.540662+0000","last_unstale":"2024-03-18T00:25:24.524925+0000","last_undegraded":"2024-03-18T00:25:24.524925+0000","last_fullsized":"2024-03-18T00:25:24.524925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359780+0000","last_change":"2024-03-18T00:25:23.538366+0000","last_active":"2024-03-18T00:25:25.359780+0000","last_peered":"2024-03-18T00:25:25.359780+0000","last_clean":"2024-03-18T00:25:25.359780+0000","last_became_active":"2024-03-18T00:25:23.538091+0000","last_became_peered":"2024-03-18T00:25:23.538091+0000","last_unstale":"2024-03-18T00:25:25.359780+0000","last_undegraded":"2024-03-18T00:25:25.359780+0000","last_fullsized":"2024-03-18T00:25:25.359780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525286+0000","last_change":"2024-03-18T00:25:23.539971+0000","last_active":"2024-03-18T00:25:24.525286+0000","last_peered":"2024-03-18T00:25:24.525286+0000","last_clean":"2024-03-18T00:25:24.525286+0000","last_became_active":"2024-03-18T00:25:23.539703+0000","last_became_peered":"2024-03-18T00:25:23.539703+0000","last_unstale":"2024-03-18T00:25:24.525286+0000","last_undegraded":"2024-03-18T00:25:24.525286+0000","last_fullsized":"2024-03-18T00:25:24.525286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525354+0000","last_change":"2024-03-18T00:25:23.528213+0000","last_active":"2024-03-18T00:25:24.525354+0000","last_peered":"2024-03-18T00:25:24.525354+0000","last_clean":"2024-03-18T00:25:24.525354+0000","last_became_active":"2024-03-18T00:25:23.527957+0000","last_became_peered":"2024-03-18T00:25:23.527957+0000","last_unstale":"2024-03-18T00:25:24.525354+0000","last_undegraded":"2024-03-18T00:25:24.525354+0000","last_fullsized":"2024-03-18T00:25:24.525354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527277+0000","last_change":"2024-03-18T00:25:23.538220+0000","last_active":"2024-03-18T00:25:24.527277+0000","last_peered":"2024-03-18T00:25:24.527277+0000","last_clean":"2024-03-18T00:25:24.527277+0000","last_became_active":"2024-03-18T00:25:23.537965+0000","last_became_peered":"2024-03-18T00:25:23.537965+0000","last_unstale":"2024-03-18T00:25:24.527277+0000","last_undegraded":"2024-03-18T00:25:24.527277+0000","last_fullsized":"2024-03-18T00:25:24.527277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525245+0000","last_change":"2024-03-18T00:25:23.540936+0000","last_active":"2024-03-18T00:25:24.525245+0000","last_peered":"2024-03-18T00:25:24.525245+0000","last_clean":"2024-03-18T00:25:24.525245+0000","last_became_active":"2024-03-18T00:25:23.540679+0000","last_became_peered":"2024-03-18T00:25:23.540679+0000","last_unstale":"2024-03-18T00:25:24.525245+0000","last_undegraded":"2024-03-18T00:25:24.525245+0000","last_fullsized":"2024-03-18T00:25:24.525245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933579+0000","last_change":"2024-03-18T00:25:23.538218+0000","last_active":"2024-03-18T00:25:24.933579+0000","last_peered":"2024-03-18T00:25:24.933579+0000","last_clean":"2024-03-18T00:25:24.933579+0000","last_became_active":"2024-03-18T00:25:23.537892+0000","last_became_peered":"2024-03-18T00:25:23.537892+0000","last_unstale":"2024-03-18T00:25:24.933579+0000","last_undegraded":"2024-03-18T00:25:24.933579+0000","last_fullsized":"2024-03-18T00:25:24.933579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360411+0000","last_change":"2024-03-18T00:25:23.539202+0000","last_active":"2024-03-18T00:25:25.360411+0000","last_peered":"2024-03-18T00:25:25.360411+0000","last_clean":"2024-03-18T00:25:25.360411+0000","last_became_active":"2024-03-18T00:25:23.538922+0000","last_became_peered":"2024-03-18T00:25:23.538922+0000","last_unstale":"2024-03-18T00:25:25.360411+0000","last_undegraded":"2024-03-18T00:25:25.360411+0000","last_fullsized":"2024-03-18T00:25:25.360411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359685+0000","last_change":"2024-03-18T00:25:23.529487+0000","last_active":"2024-03-18T00:25:25.359685+0000","last_peered":"2024-03-18T00:25:25.359685+0000","last_clean":"2024-03-18T00:25:25.359685+0000","last_became_active":"2024-03-18T00:25:23.529211+0000","last_became_peered":"2024-03-18T00:25:23.529211+0000","last_unstale":"2024-03-18T00:25:25.359685+0000","last_undegraded":"2024-03-18T00:25:25.359685+0000","last_fullsized":"2024-03-18T00:25:25.359685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524820+0000","last_change":"2024-03-18T00:25:23.526131+0000","last_active":"2024-03-18T00:25:24.524820+0000","last_peered":"2024-03-18T00:25:24.524820+0000","last_clean":"2024-03-18T00:25:24.524820+0000","last_became_active":"2024-03-18T00:25:23.525869+0000","last_became_peered":"2024-03-18T00:25:23.525869+0000","last_unstale":"2024-03-18T00:25:24.524820+0000","last_undegraded":"2024-03-18T00:25:24.524820+0000","last_fullsized":"2024-03-18T00:25:24.524820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859267+0000","last_change":"2024-03-18T00:25:23.528904+0000","last_active":"2024-03-18T00:25:24.859267+0000","last_peered":"2024-03-18T00:25:24.859267+0000","last_clean":"2024-03-18T00:25:24.859267+0000","last_became_active":"2024-03-18T00:25:23.528637+0000","last_became_peered":"2024-03-18T00:25:23.528637+0000","last_unstale":"2024-03-18T00:25:24.859267+0000","last_undegraded":"2024-03-18T00:25:24.859267+0000","last_fullsized":"2024-03-18T00:25:24.859267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:50.372929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525171+0000","last_change":"2024-03-18T00:25:22.525633+0000","last_active":"2024-03-18T00:25:24.525171+0000","last_peered":"2024-03-18T00:25:24.525171+0000","last_clean":"2024-03-18T00:25:24.525171+0000","last_became_active":"2024-03-18T00:25:22.525293+0000","last_became_peered":"2024-03-18T00:25:22.525293+0000","last_unstale":"2024-03-18T00:25:24.525171+0000","last_undegraded":"2024-03-18T00:25:24.525171+0000","last_fullsized":"2024-03-18T00:25:24.525171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:29:02.213393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933633+0000","last_change":"2024-03-18T00:25:23.532009+0000","last_active":"2024-03-18T00:25:24.933633+0000","last_peered":"2024-03-18T00:25:24.933633+0000","last_clean":"2024-03-18T00:25:24.933633+0000","last_became_active":"2024-03-18T00:25:23.531736+0000","last_became_peered":"2024-03-18T00:25:23.531736+0000","last_unstale":"2024-03-18T00:25:24.933633+0000","last_undegraded":"2024-03-18T00:25:24.933633+0000","last_fullsized":"2024-03-18T00:25:24.933633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524921+0000","last_change":"2024-03-18T00:25:22.521332+0000","last_active":"2024-03-18T00:25:24.524921+0000","last_peered":"2024-03-18T00:25:24.524921+0000","last_clean":"2024-03-18T00:25:24.524921+0000","last_became_active":"2024-03-18T00:25:22.520113+0000","last_became_peered":"2024-03-18T00:25:22.520113+0000","last_unstale":"2024-03-18T00:25:24.524921+0000","last_undegraded":"2024-03-18T00:25:24.524921+0000","last_fullsized":"2024-03-18T00:25:24.524921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524901+0000","last_change":"2024-03-18T00:25:22.525936+0000","last_active":"2024-03-18T00:25:24.524901+0000","last_peered":"2024-03-18T00:25:24.524901+0000","last_clean":"2024-03-18T00:25:24.524901+0000","last_became_active":"2024-03-18T00:25:22.525688+0000","last_became_peered":"2024-03-18T00:25:22.525688+0000","last_unstale":"2024-03-18T00:25:24.524901+0000","last_undegraded":"2024-03-18T00:25:24.524901+0000","last_fullsized":"2024-03-18T00:25:24.524901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524904+0000","last_change":"2024-03-18T00:25:23.537268+0000","last_active":"2024-03-18T00:25:24.524904+0000","last_peered":"2024-03-18T00:25:24.524904+0000","last_clean":"2024-03-18T00:25:24.524904+0000","last_became_active":"2024-03-18T00:25:23.536747+0000","last_became_peered":"2024-03-18T00:25:23.536747+0000","last_unstale":"2024-03-18T00:25:24.524904+0000","last_undegraded":"2024-03-18T00:25:24.524904+0000","last_fullsized":"2024-03-18T00:25:24.524904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359815+0000","last_change":"2024-03-18T00:25:22.525372+0000","last_active":"2024-03-18T00:25:25.359815+0000","last_peered":"2024-03-18T00:25:25.359815+0000","last_clean":"2024-03-18T00:25:25.359815+0000","last_became_active":"2024-03-18T00:25:22.525058+0000","last_became_peered":"2024-03-18T00:25:22.525058+0000","last_unstale":"2024-03-18T00:25:25.359815+0000","last_undegraded":"2024-03-18T00:25:25.359815+0000","last_fullsized":"2024-03-18T00:25:25.359815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526925+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.526925+0000","last_peered":"2024-03-18T00:25:24.526925+0000","last_clean":"2024-03-18T00:25:24.526925+0000","last_became_active":"2024-03-18T00:25:23.538003+0000","last_became_peered":"2024-03-18T00:25:23.538003+0000","last_unstale":"2024-03-18T00:25:24.526925+0000","last_undegraded":"2024-03-18T00:25:24.526925+0000","last_fullsized":"2024-03-18T00:25:24.526925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525197+0000","last_change":"2024-03-18T00:25:22.512527+0000","last_active":"2024-03-18T00:25:24.525197+0000","last_peered":"2024-03-18T00:25:24.525197+0000","last_clean":"2024-03-18T00:25:24.525197+0000","last_became_active":"2024-03-18T00:25:22.512256+0000","last_became_peered":"2024-03-18T00:25:22.512256+0000","last_unstale":"2024-03-18T00:25:24.525197+0000","last_undegraded":"2024-03-18T00:25:24.525197+0000","last_fullsized":"2024-03-18T00:25:24.525197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360064+0000","last_change":"2024-03-18T00:25:23.536878+0000","last_active":"2024-03-18T00:25:25.360064+0000","last_peered":"2024-03-18T00:25:25.360064+0000","last_clean":"2024-03-18T00:25:25.360064+0000","last_became_active":"2024-03-18T00:25:23.536571+0000","last_became_peered":"2024-03-18T00:25:23.536571+0000","last_unstale":"2024-03-18T00:25:25.360064+0000","last_undegraded":"2024-03-18T00:25:25.360064+0000","last_fullsized":"2024-03-18T00:25:25.360064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360235+0000","last_change":"2024-03-18T00:25:22.516162+0000","last_active":"2024-03-18T00:25:25.360235+0000","last_peered":"2024-03-18T00:25:25.360235+0000","last_clean":"2024-03-18T00:25:25.360235+0000","last_became_active":"2024-03-18T00:25:22.515844+0000","last_became_peered":"2024-03-18T00:25:22.515844+0000","last_unstale":"2024-03-18T00:25:25.360235+0000","last_undegraded":"2024-03-18T00:25:25.360235+0000","last_fullsized":"2024-03-18T00:25:25.360235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.529085+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.528662+0000","last_became_peered":"2024-03-18T00:25:23.528662+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527254+0000","last_change":"2024-03-18T00:25:22.521602+0000","last_active":"2024-03-18T00:25:24.527254+0000","last_peered":"2024-03-18T00:25:24.527254+0000","last_clean":"2024-03-18T00:25:24.527254+0000","last_became_active":"2024-03-18T00:25:22.521328+0000","last_became_peered":"2024-03-18T00:25:22.521328+0000","last_unstale":"2024-03-18T00:25:24.527254+0000","last_undegraded":"2024-03-18T00:25:24.527254+0000","last_fullsized":"2024-03-18T00:25:24.527254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859580+0000","last_change":"2024-03-18T00:25:23.543862+0000","last_active":"2024-03-18T00:25:24.859580+0000","last_peered":"2024-03-18T00:25:24.859580+0000","last_clean":"2024-03-18T00:25:24.859580+0000","last_became_active":"2024-03-18T00:25:23.543558+0000","last_became_peered":"2024-03-18T00:25:23.543558+0000","last_unstale":"2024-03-18T00:25:24.859580+0000","last_undegraded":"2024-03-18T00:25:24.859580+0000","last_fullsized":"2024-03-18T00:25:24.859580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:14.829023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525576+0000","last_change":"2024-03-18T00:25:22.525827+0000","last_active":"2024-03-18T00:25:24.525576+0000","last_peered":"2024-03-18T00:25:24.525576+0000","last_clean":"2024-03-18T00:25:24.525576+0000","last_became_active":"2024-03-18T00:25:22.525551+0000","last_became_peered":"2024-03-18T00:25:22.525551+0000","last_unstale":"2024-03-18T00:25:24.525576+0000","last_undegraded":"2024-03-18T00:25:24.525576+0000","last_fullsized":"2024-03-18T00:25:24.525576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360412+0000","last_change":"2024-03-18T00:25:23.543586+0000","last_active":"2024-03-18T00:25:25.360412+0000","last_peered":"2024-03-18T00:25:25.360412+0000","last_clean":"2024-03-18T00:25:25.360412+0000","last_became_active":"2024-03-18T00:25:23.543343+0000","last_became_peered":"2024-03-18T00:25:23.543343+0000","last_unstale":"2024-03-18T00:25:25.360412+0000","last_undegraded":"2024-03-18T00:25:25.360412+0000","last_fullsized":"2024-03-18T00:25:25.360412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:39:37.708353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933641+0000","last_change":"2024-03-18T00:25:22.525005+0000","last_active":"2024-03-18T00:25:24.933641+0000","last_peered":"2024-03-18T00:25:24.933641+0000","last_clean":"2024-03-18T00:25:24.933641+0000","last_became_active":"2024-03-18T00:25:22.524742+0000","last_became_peered":"2024-03-18T00:25:22.524742+0000","last_unstale":"2024-03-18T00:25:24.933641+0000","last_undegraded":"2024-03-18T00:25:24.933641+0000","last_fullsized":"2024-03-18T00:25:24.933641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933361+0000","last_change":"2024-03-18T00:25:23.525230+0000","last_active":"2024-03-18T00:25:24.933361+0000","last_peered":"2024-03-18T00:25:24.933361+0000","last_clean":"2024-03-18T00:25:24.933361+0000","last_became_active":"2024-03-18T00:25:23.524978+0000","last_became_peered":"2024-03-18T00:25:23.524978+0000","last_unstale":"2024-03-18T00:25:24.933361+0000","last_undegraded":"2024-03-18T00:25:24.933361+0000","last_fullsized":"2024-03-18T00:25:24.933361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360495+0000","last_change":"2024-03-18T00:25:22.524729+0000","last_active":"2024-03-18T00:25:25.360495+0000","last_peered":"2024-03-18T00:25:25.360495+0000","last_clean":"2024-03-18T00:25:25.360495+0000","last_became_active":"2024-03-18T00:25:22.524455+0000","last_became_peered":"2024-03-18T00:25:22.524455+0000","last_unstale":"2024-03-18T00:25:25.360495+0000","last_undegraded":"2024-03-18T00:25:25.360495+0000","last_fullsized":"2024-03-18T00:25:25.360495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:23.541999+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:23.541593+0000","last_became_peered":"2024-03-18T00:25:23.541593+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524819+0000","last_change":"2024-03-18T00:25:22.519877+0000","last_active":"2024-03-18T00:25:24.524819+0000","last_peered":"2024-03-18T00:25:24.524819+0000","last_clean":"2024-03-18T00:25:24.524819+0000","last_became_active":"2024-03-18T00:25:22.519396+0000","last_became_peered":"2024-03-18T00:25:22.519396+0000","last_unstale":"2024-03-18T00:25:24.524819+0000","last_undegraded":"2024-03-18T00:25:24.524819+0000","last_fullsized":"2024-03-18T00:25:24.524819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.526752+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.526434+0000","last_became_peered":"2024-03-18T00:25:23.526434+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359803+0000","last_change":"2024-03-18T00:25:22.518260+0000","last_active":"2024-03-18T00:25:25.359803+0000","last_peered":"2024-03-18T00:25:25.359803+0000","last_clean":"2024-03-18T00:25:25.359803+0000","last_became_active":"2024-03-18T00:25:22.517930+0000","last_became_peered":"2024-03-18T00:25:22.517930+0000","last_unstale":"2024-03-18T00:25:25.359803+0000","last_undegraded":"2024-03-18T00:25:25.359803+0000","last_fullsized":"2024-03-18T00:25:25.359803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359692+0000","last_change":"2024-03-18T00:25:23.541873+0000","last_active":"2024-03-18T00:25:25.359692+0000","last_peered":"2024-03-18T00:25:25.359692+0000","last_clean":"2024-03-18T00:25:25.359692+0000","last_became_active":"2024-03-18T00:25:23.541574+0000","last_became_peered":"2024-03-18T00:25:23.541574+0000","last_unstale":"2024-03-18T00:25:25.359692+0000","last_undegraded":"2024-03-18T00:25:25.359692+0000","last_fullsized":"2024-03-18T00:25:25.359692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859586+0000","last_change":"2024-03-18T00:25:22.524063+0000","last_active":"2024-03-18T00:25:24.859586+0000","last_peered":"2024-03-18T00:25:24.859586+0000","last_clean":"2024-03-18T00:25:24.859586+0000","last_became_active":"2024-03-18T00:25:22.523714+0000","last_became_peered":"2024-03-18T00:25:22.523714+0000","last_unstale":"2024-03-18T00:25:24.859586+0000","last_undegraded":"2024-03-18T00:25:24.859586+0000","last_fullsized":"2024-03-18T00:25:24.859586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360141+0000","last_change":"2024-03-18T00:25:23.542168+0000","last_active":"2024-03-18T00:25:25.360141+0000","last_peered":"2024-03-18T00:25:25.360141+0000","last_clean":"2024-03-18T00:25:25.360141+0000","last_became_active":"2024-03-18T00:25:23.541579+0000","last_became_peered":"2024-03-18T00:25:23.541579+0000","last_unstale":"2024-03-18T00:25:25.360141+0000","last_undegraded":"2024-03-18T00:25:25.360141+0000","last_fullsized":"2024-03-18T00:25:25.360141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359774+0000","last_change":"2024-03-18T00:25:22.525864+0000","last_active":"2024-03-18T00:25:25.359774+0000","last_peered":"2024-03-18T00:25:25.359774+0000","last_clean":"2024-03-18T00:25:25.359774+0000","last_became_active":"2024-03-18T00:25:22.525582+0000","last_became_peered":"2024-03-18T00:25:22.525582+0000","last_unstale":"2024-03-18T00:25:25.359774+0000","last_undegraded":"2024-03-18T00:25:25.359774+0000","last_fullsized":"2024-03-18T00:25:25.359774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360294+0000","last_change":"2024-03-18T00:25:23.542371+0000","last_active":"2024-03-18T00:25:25.360294+0000","last_peered":"2024-03-18T00:25:25.360294+0000","last_clean":"2024-03-18T00:25:25.360294+0000","last_became_active":"2024-03-18T00:25:23.542030+0000","last_became_peered":"2024-03-18T00:25:23.542030+0000","last_unstale":"2024-03-18T00:25:25.360294+0000","last_undegraded":"2024-03-18T00:25:25.360294+0000","last_fullsized":"2024-03-18T00:25:25.360294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:34:40.152850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527312+0000","last_change":"2024-03-18T00:25:22.527178+0000","last_active":"2024-03-18T00:25:24.527312+0000","last_peered":"2024-03-18T00:25:24.527312+0000","last_clean":"2024-03-18T00:25:24.527312+0000","last_became_active":"2024-03-18T00:25:22.526891+0000","last_became_peered":"2024-03-18T00:25:22.526891+0000","last_unstale":"2024-03-18T00:25:24.527312+0000","last_undegraded":"2024-03-18T00:25:24.527312+0000","last_fullsized":"2024-03-18T00:25:24.527312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360509+0000","last_change":"2024-03-18T00:25:23.537093+0000","last_active":"2024-03-18T00:25:25.360509+0000","last_peered":"2024-03-18T00:25:25.360509+0000","last_clean":"2024-03-18T00:25:25.360509+0000","last_became_active":"2024-03-18T00:25:23.536816+0000","last_became_peered":"2024-03-18T00:25:23.536816+0000","last_unstale":"2024-03-18T00:25:25.360509+0000","last_undegraded":"2024-03-18T00:25:25.360509+0000","last_fullsized":"2024-03-18T00:25:25.360509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359667+0000","last_change":"2024-03-18T00:25:22.522241+0000","last_active":"2024-03-18T00:25:25.359667+0000","last_peered":"2024-03-18T00:25:25.359667+0000","last_clean":"2024-03-18T00:25:25.359667+0000","last_became_active":"2024-03-18T00:25:22.521959+0000","last_became_peered":"2024-03-18T00:25:22.521959+0000","last_unstale":"2024-03-18T00:25:25.359667+0000","last_undegraded":"2024-03-18T00:25:25.359667+0000","last_fullsized":"2024-03-18T00:25:25.359667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360544+0000","last_change":"2024-03-18T00:25:23.533012+0000","last_active":"2024-03-18T00:25:25.360544+0000","last_peered":"2024-03-18T00:25:25.360544+0000","last_clean":"2024-03-18T00:25:25.360544+0000","last_became_active":"2024-03-18T00:25:23.532746+0000","last_became_peered":"2024-03-18T00:25:23.532746+0000","last_unstale":"2024-03-18T00:25:25.360544+0000","last_undegraded":"2024-03-18T00:25:25.360544+0000","last_fullsized":"2024-03-18T00:25:25.360544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:06:47.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359515+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:25.359515+0000","last_peered":"2024-03-18T00:25:25.359515+0000","last_clean":"2024-03-18T00:25:25.359515+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:25.359515+0000","last_undegraded":"2024-03-18T00:25:25.359515+0000","last_fullsized":"2024-03-18T00:25:25.359515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:22.518151+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:22.517836+0000","last_became_peered":"2024-03-18T00:25:22.517836+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524976+0000","last_change":"2024-03-18T00:25:23.542819+0000","last_active":"2024-03-18T00:25:24.524976+0000","last_peered":"2024-03-18T00:25:24.524976+0000","last_clean":"2024-03-18T00:25:24.524976+0000","last_became_active":"2024-03-18T00:25:23.541993+0000","last_became_peered":"2024-03-18T00:25:23.541993+0000","last_unstale":"2024-03-18T00:25:24.524976+0000","last_undegraded":"2024-03-18T00:25:24.524976+0000","last_fullsized":"2024-03-18T00:25:24.524976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359453+0000","last_change":"2024-03-18T00:25:22.526454+0000","last_active":"2024-03-18T00:25:25.359453+0000","last_peered":"2024-03-18T00:25:25.359453+0000","last_clean":"2024-03-18T00:25:25.359453+0000","last_became_active":"2024-03-18T00:25:22.525824+0000","last_became_peered":"2024-03-18T00:25:22.525824+0000","last_unstale":"2024-03-18T00:25:25.359453+0000","last_undegraded":"2024-03-18T00:25:25.359453+0000","last_fullsized":"2024-03-18T00:25:25.359453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:36.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933234+0000","last_change":"2024-03-18T00:25:23.533610+0000","last_active":"2024-03-18T00:25:24.933234+0000","last_peered":"2024-03-18T00:25:24.933234+0000","last_clean":"2024-03-18T00:25:24.933234+0000","last_became_active":"2024-03-18T00:25:23.531816+0000","last_became_peered":"2024-03-18T00:25:23.531816+0000","last_unstale":"2024-03-18T00:25:24.933234+0000","last_undegraded":"2024-03-18T00:25:24.933234+0000","last_fullsized":"2024-03-18T00:25:24.933234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:51:00.174852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359686+0000","last_change":"2024-03-18T00:25:22.524836+0000","last_active":"2024-03-18T00:25:25.359686+0000","last_peered":"2024-03-18T00:25:25.359686+0000","last_clean":"2024-03-18T00:25:25.359686+0000","last_became_active":"2024-03-18T00:25:22.524559+0000","last_became_peered":"2024-03-18T00:25:22.524559+0000","last_unstale":"2024-03-18T00:25:25.359686+0000","last_undegraded":"2024-03-18T00:25:25.359686+0000","last_fullsized":"2024-03-18T00:25:25.359686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526935+0000","last_change":"2024-03-18T00:25:23.530154+0000","last_active":"2024-03-18T00:25:24.526935+0000","last_peered":"2024-03-18T00:25:24.526935+0000","last_clean":"2024-03-18T00:25:24.526935+0000","last_became_active":"2024-03-18T00:25:23.529909+0000","last_became_peered":"2024-03-18T00:25:23.529909+0000","last_unstale":"2024-03-18T00:25:24.526935+0000","last_undegraded":"2024-03-18T00:25:24.526935+0000","last_fullsized":"2024-03-18T00:25:24.526935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360581+0000","last_change":"2024-03-18T00:25:22.522580+0000","last_active":"2024-03-18T00:25:25.360581+0000","last_peered":"2024-03-18T00:25:25.360581+0000","last_clean":"2024-03-18T00:25:25.360581+0000","last_became_active":"2024-03-18T00:25:22.522157+0000","last_became_peered":"2024-03-18T00:25:22.522157+0000","last_unstale":"2024-03-18T00:25:25.360581+0000","last_undegraded":"2024-03-18T00:25:25.360581+0000","last_fullsized":"2024-03-18T00:25:25.360581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859361+0000","last_change":"2024-03-18T00:25:23.539763+0000","last_active":"2024-03-18T00:25:24.859361+0000","last_peered":"2024-03-18T00:25:24.859361+0000","last_clean":"2024-03-18T00:25:24.859361+0000","last_became_active":"2024-03-18T00:25:23.539502+0000","last_became_peered":"2024-03-18T00:25:23.539502+0000","last_unstale":"2024-03-18T00:25:24.859361+0000","last_undegraded":"2024-03-18T00:25:24.859361+0000","last_fullsized":"2024-03-18T00:25:24.859361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527211+0000","last_change":"2024-03-18T00:25:22.520229+0000","last_active":"2024-03-18T00:25:24.527211+0000","last_peered":"2024-03-18T00:25:24.527211+0000","last_clean":"2024-03-18T00:25:24.527211+0000","last_became_active":"2024-03-18T00:25:22.519955+0000","last_became_peered":"2024-03-18T00:25:22.519955+0000","last_unstale":"2024-03-18T00:25:24.527211+0000","last_undegraded":"2024-03-18T00:25:24.527211+0000","last_fullsized":"2024-03-18T00:25:24.527211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360629+0000","last_change":"2024-03-18T00:25:23.538375+0000","last_active":"2024-03-18T00:25:25.360629+0000","last_peered":"2024-03-18T00:25:25.360629+0000","last_clean":"2024-03-18T00:25:25.360629+0000","last_became_active":"2024-03-18T00:25:23.538114+0000","last_became_peered":"2024-03-18T00:25:23.538114+0000","last_unstale":"2024-03-18T00:25:25.360629+0000","last_undegraded":"2024-03-18T00:25:25.360629+0000","last_fullsized":"2024-03-18T00:25:25.360629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360706+0000","last_change":"2024-03-18T00:25:22.527522+0000","last_active":"2024-03-18T00:25:25.360706+0000","last_peered":"2024-03-18T00:25:25.360706+0000","last_clean":"2024-03-18T00:25:25.360706+0000","last_became_active":"2024-03-18T00:25:22.527170+0000","last_became_peered":"2024-03-18T00:25:22.527170+0000","last_unstale":"2024-03-18T00:25:25.360706+0000","last_undegraded":"2024-03-18T00:25:25.360706+0000","last_fullsized":"2024-03-18T00:25:25.360706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:50:59.169893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527236+0000","last_change":"2024-03-18T00:25:23.529557+0000","last_active":"2024-03-18T00:25:24.527236+0000","last_peered":"2024-03-18T00:25:24.527236+0000","last_clean":"2024-03-18T00:25:24.527236+0000","last_became_active":"2024-03-18T00:25:23.529316+0000","last_became_peered":"2024-03-18T00:25:23.529316+0000","last_unstale":"2024-03-18T00:25:24.527236+0000","last_undegraded":"2024-03-18T00:25:24.527236+0000","last_fullsized":"2024-03-18T00:25:24.527236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.528528+0000","last_change":"2024-03-18T00:25:22.520956+0000","last_active":"2024-03-18T00:25:24.528528+0000","last_peered":"2024-03-18T00:25:24.528528+0000","last_clean":"2024-03-18T00:25:24.528528+0000","last_became_active":"2024-03-18T00:25:22.520708+0000","last_became_peered":"2024-03-18T00:25:22.520708+0000","last_unstale":"2024-03-18T00:25:24.528528+0000","last_undegraded":"2024-03-18T00:25:24.528528+0000","last_fullsized":"2024-03-18T00:25:24.528528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525346+0000","last_change":"2024-03-18T00:25:23.543671+0000","last_active":"2024-03-18T00:25:24.525346+0000","last_peered":"2024-03-18T00:25:24.525346+0000","last_clean":"2024-03-18T00:25:24.525346+0000","last_became_active":"2024-03-18T00:25:23.543393+0000","last_became_peered":"2024-03-18T00:25:23.543393+0000","last_unstale":"2024-03-18T00:25:24.525346+0000","last_undegraded":"2024-03-18T00:25:24.525346+0000","last_fullsized":"2024-03-18T00:25:24.525346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525281+0000","last_change":"2024-03-18T00:25:22.521876+0000","last_active":"2024-03-18T00:25:24.525281+0000","last_peered":"2024-03-18T00:25:24.525281+0000","last_clean":"2024-03-18T00:25:24.525281+0000","last_became_active":"2024-03-18T00:25:22.521555+0000","last_became_peered":"2024-03-18T00:25:22.521555+0000","last_unstale":"2024-03-18T00:25:24.525281+0000","last_undegraded":"2024-03-18T00:25:24.525281+0000","last_fullsized":"2024-03-18T00:25:24.525281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933490+0000","last_change":"2024-03-18T00:25:23.528031+0000","last_active":"2024-03-18T00:25:24.933490+0000","last_peered":"2024-03-18T00:25:24.933490+0000","last_clean":"2024-03-18T00:25:24.933490+0000","last_became_active":"2024-03-18T00:25:23.527711+0000","last_became_peered":"2024-03-18T00:25:23.527711+0000","last_unstale":"2024-03-18T00:25:24.933490+0000","last_undegraded":"2024-03-18T00:25:24.933490+0000","last_fullsized":"2024-03-18T00:25:24.933490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359454+0000","last_change":"2024-03-18T00:25:22.526660+0000","last_active":"2024-03-18T00:25:25.359454+0000","last_peered":"2024-03-18T00:25:25.359454+0000","last_clean":"2024-03-18T00:25:25.359454+0000","last_became_active":"2024-03-18T00:25:22.526187+0000","last_became_peered":"2024-03-18T00:25:22.526187+0000","last_unstale":"2024-03-18T00:25:25.359454+0000","last_undegraded":"2024-03-18T00:25:25.359454+0000","last_fullsized":"2024-03-18T00:25:25.359454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859319+0000","last_change":"2024-03-18T00:25:23.532831+0000","last_active":"2024-03-18T00:25:24.859319+0000","last_peered":"2024-03-18T00:25:24.859319+0000","last_clean":"2024-03-18T00:25:24.859319+0000","last_became_active":"2024-03-18T00:25:23.532560+0000","last_became_peered":"2024-03-18T00:25:23.532560+0000","last_unstale":"2024-03-18T00:25:24.859319+0000","last_undegraded":"2024-03-18T00:25:24.859319+0000","last_fullsized":"2024-03-18T00:25:24.859319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:53.916378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527047+0000","last_change":"2024-03-18T00:25:22.519545+0000","last_active":"2024-03-18T00:25:24.527047+0000","last_peered":"2024-03-18T00:25:24.527047+0000","last_clean":"2024-03-18T00:25:24.527047+0000","last_became_active":"2024-03-18T00:25:22.519310+0000","last_became_peered":"2024-03-18T00:25:22.519310+0000","last_unstale":"2024-03-18T00:25:24.527047+0000","last_undegraded":"2024-03-18T00:25:24.527047+0000","last_fullsized":"2024-03-18T00:25:24.527047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524965+0000","last_change":"2024-03-18T00:25:23.537154+0000","last_active":"2024-03-18T00:25:24.524965+0000","last_peered":"2024-03-18T00:25:24.524965+0000","last_clean":"2024-03-18T00:25:24.524965+0000","last_became_active":"2024-03-18T00:25:23.536652+0000","last_became_peered":"2024-03-18T00:25:23.536652+0000","last_unstale":"2024-03-18T00:25:24.524965+0000","last_undegraded":"2024-03-18T00:25:24.524965+0000","last_fullsized":"2024-03-18T00:25:24.524965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527167+0000","last_change":"2024-03-18T00:25:22.526658+0000","last_active":"2024-03-18T00:25:24.527167+0000","last_peered":"2024-03-18T00:25:24.527167+0000","last_clean":"2024-03-18T00:25:24.527167+0000","last_became_active":"2024-03-18T00:25:22.526284+0000","last_became_peered":"2024-03-18T00:25:22.526284+0000","last_unstale":"2024-03-18T00:25:24.527167+0000","last_undegraded":"2024-03-18T00:25:24.527167+0000","last_fullsized":"2024-03-18T00:25:24.527167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525137+0000","last_change":"2024-03-18T00:25:23.537415+0000","last_active":"2024-03-18T00:25:24.525137+0000","last_peered":"2024-03-18T00:25:24.525137+0000","last_clean":"2024-03-18T00:25:24.525137+0000","last_became_active":"2024-03-18T00:25:23.537145+0000","last_became_peered":"2024-03-18T00:25:23.537145+0000","last_unstale":"2024-03-18T00:25:24.525137+0000","last_undegraded":"2024-03-18T00:25:24.525137+0000","last_fullsized":"2024-03-18T00:25:24.525137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359988+0000","last_change":"2024-03-18T00:25:22.525503+0000","last_active":"2024-03-18T00:25:25.359988+0000","last_peered":"2024-03-18T00:25:25.359988+0000","last_clean":"2024-03-18T00:25:25.359988+0000","last_became_active":"2024-03-18T00:25:22.525243+0000","last_became_peered":"2024-03-18T00:25:22.525243+0000","last_unstale":"2024-03-18T00:25:25.359988+0000","last_undegraded":"2024-03-18T00:25:25.359988+0000","last_fullsized":"2024-03-18T00:25:25.359988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:47.316817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.530235+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.529957+0000","last_became_peered":"2024-03-18T00:25:23.529957+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360510+0000","last_change":"2024-03-18T00:25:23.542945+0000","last_active":"2024-03-18T00:25:25.360510+0000","last_peered":"2024-03-18T00:25:25.360510+0000","last_clean":"2024-03-18T00:25:25.360510+0000","last_became_active":"2024-03-18T00:25:23.541198+0000","last_became_peered":"2024-03-18T00:25:23.541198+0000","last_unstale":"2024-03-18T00:25:25.360510+0000","last_undegraded":"2024-03-18T00:25:25.360510+0000","last_fullsized":"2024-03-18T00:25:25.360510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359960+0000","last_change":"2024-03-18T00:25:22.524744+0000","last_active":"2024-03-18T00:25:25.359960+0000","last_peered":"2024-03-18T00:25:25.359960+0000","last_clean":"2024-03-18T00:25:25.359960+0000","last_became_active":"2024-03-18T00:25:22.524471+0000","last_became_peered":"2024-03-18T00:25:22.524471+0000","last_unstale":"2024-03-18T00:25:25.359960+0000","last_undegraded":"2024-03-18T00:25:25.359960+0000","last_fullsized":"2024-03-18T00:25:25.359960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:13.824065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360483+0000","last_change":"2024-03-18T00:25:23.535099+0000","last_active":"2024-03-18T00:25:25.360483+0000","last_peered":"2024-03-18T00:25:25.360483+0000","last_clean":"2024-03-18T00:25:25.360483+0000","last_became_active":"2024-03-18T00:25:23.534782+0000","last_became_peered":"2024-03-18T00:25:23.534782+0000","last_unstale":"2024-03-18T00:25:25.360483+0000","last_undegraded":"2024-03-18T00:25:25.360483+0000","last_fullsized":"2024-03-18T00:25:25.360483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360610+0000","last_change":"2024-03-18T00:25:22.524438+0000","last_active":"2024-03-18T00:25:25.360610+0000","last_peered":"2024-03-18T00:25:25.360610+0000","last_clean":"2024-03-18T00:25:25.360610+0000","last_became_active":"2024-03-18T00:25:22.524084+0000","last_became_peered":"2024-03-18T00:25:22.524084+0000","last_unstale":"2024-03-18T00:25:25.360610+0000","last_undegraded":"2024-03-18T00:25:25.360610+0000","last_fullsized":"2024-03-18T00:25:25.360610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:28:12.762540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933449+0000","last_change":"2024-03-18T00:25:23.529284+0000","last_active":"2024-03-18T00:25:24.933449+0000","last_peered":"2024-03-18T00:25:24.933449+0000","last_clean":"2024-03-18T00:25:24.933449+0000","last_became_active":"2024-03-18T00:25:23.529022+0000","last_became_peered":"2024-03-18T00:25:23.529022+0000","last_unstale":"2024-03-18T00:25:24.933449+0000","last_undegraded":"2024-03-18T00:25:24.933449+0000","last_fullsized":"2024-03-18T00:25:24.933449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525414+0000","last_change":"2024-03-18T00:25:22.524838+0000","last_active":"2024-03-18T00:25:24.525414+0000","last_peered":"2024-03-18T00:25:24.525414+0000","last_clean":"2024-03-18T00:25:24.525414+0000","last_became_active":"2024-03-18T00:25:22.524532+0000","last_became_peered":"2024-03-18T00:25:22.524532+0000","last_unstale":"2024-03-18T00:25:24.525414+0000","last_undegraded":"2024-03-18T00:25:24.525414+0000","last_fullsized":"2024-03-18T00:25:24.525414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525427+0000","last_change":"2024-03-18T00:25:23.541815+0000","last_active":"2024-03-18T00:25:24.525427+0000","last_peered":"2024-03-18T00:25:24.525427+0000","last_clean":"2024-03-18T00:25:24.525427+0000","last_became_active":"2024-03-18T00:25:23.541486+0000","last_became_peered":"2024-03-18T00:25:23.541486+0000","last_unstale":"2024-03-18T00:25:24.525427+0000","last_undegraded":"2024-03-18T00:25:24.525427+0000","last_fullsized":"2024-03-18T00:25:24.525427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933609+0000","last_change":"2024-03-18T00:25:22.520313+0000","last_active":"2024-03-18T00:25:24.933609+0000","last_peered":"2024-03-18T00:25:24.933609+0000","last_clean":"2024-03-18T00:25:24.933609+0000","last_became_active":"2024-03-18T00:25:22.520019+0000","last_became_peered":"2024-03-18T00:25:22.520019+0000","last_unstale":"2024-03-18T00:25:24.933609+0000","last_undegraded":"2024-03-18T00:25:24.933609+0000","last_fullsized":"2024-03-18T00:25:24.933609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":655584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":64724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":64760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":64634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":780,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":798720,"data_stored":655640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:31.296 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:31.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.408+0000 7fe47b35b640 1 Processor -- start 2024-03-18T00:25:31.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.408+0000 7fe47b35b640 1 -- start start 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe47406fab0 0x7fe47406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406f2b0 0x7fe4740d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe4741629b0 con 0x7fe4740d1300 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe474162ee0 con 0x7fe47406fab0 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe47b35b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe474161d70 con 0x7fe47406f2b0 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4798f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe47406fab0 0x7fe47406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4798f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59214/0 (socket says 172.21.15.81:59214) 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4798f8640 1 -- 172.21.15.81:0/970156885 learned_addr learned my addr 172.21.15.81:0/970156885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:31.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4788f6640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406f2b0 0x7fe4740d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 -- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406f2b0 msgr2=0x7fe4740d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406f2b0 0x7fe4740d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 -- 172.21.15.81:0/970156885 >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 msgr2=0x7fe4740cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 --2- 172.21.15.81:0/970156885 >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4790f7640 1 -- 172.21.15.81:0/970156885 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4740b1750 con 0x7fe47406fab0 2024-03-18T00:25:31.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.409+0000 7fe4798f8640 1 --2- 172.21.15.81:0/970156885 >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:31.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.410+0000 7fe4790f7640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406fab0 0x7fe47406fe90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe47409ba60 tx=0x7fe47002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5218753ebf127c05 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.410+0000 7fe46bfff640 1 -- 172.21.15.81:0/970156885 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4700315a0 con 0x7fe47406fab0 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.410+0000 7fe46bfff640 1 -- 172.21.15.81:0/970156885 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe470037070 con 0x7fe47406fab0 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.410+0000 7fe46bfff640 1 -- 172.21.15.81:0/970156885 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe470031960 con 0x7fe47406fab0 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 -- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406fab0 msgr2=0x7fe47406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406fab0 0x7fe47406fe90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe47409ba60 tx=0x7fe47002b840 comp rx=0 tx=0).stop 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 -- 172.21.15.81:0/970156885 shutdown_connections 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 --2- 172.21.15.81:0/970156885 >> v2:172.21.15.81:3300/0 conn(0x7fe4740d1300 0x7fe4740cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406f2b0 0x7fe4740d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 --2- 172.21.15.81:0/970156885 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406fab0 0x7fe47406fe90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 -- 172.21.15.81:0/970156885 >> 172.21.15.81:0/970156885 conn(0x7fe4740d1ee0 msgr2=0x7fe4740d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 -- 172.21.15.81:0/970156885 shutdown_connections 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.411+0000 7fe47b35b640 1 -- 172.21.15.81:0/970156885 wait complete. 2024-03-18T00:25:31.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.412+0000 7fe47b35b640 1 Processor -- start 2024-03-18T00:25:31.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.412+0000 7fe47b35b640 1 -- start start 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406f2b0 0x7fe474160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406fab0 0x7fe474156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4740d02e0 con 0x7fe4741490c0 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe474162c00 con 0x7fe47406f2b0 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe4740d05c0 con 0x7fe47406fab0 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59216/0 (socket says 172.21.15.81:59216) 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 -- 172.21.15.81:0/866163560 learned_addr learned my addr 172.21.15.81:0/866163560 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:31.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4788f6640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406fab0 0x7fe474156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4790f7640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406f2b0 0x7fe474160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 -- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406fab0 msgr2=0x7fe474156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406fab0 0x7fe474156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 -- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406f2b0 msgr2=0x7fe474160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406f2b0 0x7fe474160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 -- 172.21.15.81:0/866163560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe47415fd20 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe4798f8640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ef90 tx=0x7fe46c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c00cbe0 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe46c00cd80 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe474160000 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.413+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003bd0 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.414+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4741605c0 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.415+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe47404f5b0 con 0x7fe4741490c0 2024-03-18T00:25:31.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.415+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe46c01b030 con 0x7fe4741490c0 2024-03-18T00:25:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.415+0000 7fe469ffb640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 0x7fe45806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.415+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe46c08ac70 con 0x7fe4741490c0 2024-03-18T00:25:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.415+0000 7fe4790f7640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 0x7fe45806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.416+0000 7fe4790f7640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 0x7fe45806e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe470036000 tx=0x7fe47003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.420+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe46c022020 con 0x7fe4741490c0 2024-03-18T00:25:31.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.592+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe47406f890 con 0x7fe45806bbd0 2024-03-18T00:25:31.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.598+0000 7fe469ffb640 1 -- 172.21.15.81:0/866163560 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7fe47406f890 con 0x7fe45806bbd0 2024-03-18T00:25:31.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:31.602 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:31.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 msgr2=0x7fe45806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 0x7fe45806e090 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe470036000 tx=0x7fe47003d040 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 msgr2=0x7fe4741e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe46c00ef90 tx=0x7fe46c00c490 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 shutdown_connections 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe45806bbd0 0x7fe45806e090 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4741490c0 0x7fe4741e9f40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe47406fab0 0x7fe474156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 --2- 172.21.15.81:0/866163560 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe47406f2b0 0x7fe474160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 >> 172.21.15.81:0/866163560 conn(0x7fe4740d1ee0 msgr2=0x7fe4740b0600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 shutdown_connections 2024-03-18T00:25:31.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.601+0000 7fe47b35b640 1 -- 172.21.15.81:0/866163560 wait complete. 2024-03-18T00:25:31.612 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-18T00:25:31.360298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001604"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360165+0000","last_change":"2024-03-18T00:25:23.535915+0000","last_active":"2024-03-18T00:25:25.360165+0000","last_peered":"2024-03-18T00:25:25.360165+0000","last_clean":"2024-03-18T00:25:25.360165+0000","last_became_active":"2024-03-18T00:25:23.535620+0000","last_became_peered":"2024-03-18T00:25:23.535620+0000","last_unstale":"2024-03-18T00:25:25.360165+0000","last_undegraded":"2024-03-18T00:25:25.360165+0000","last_fullsized":"2024-03-18T00:25:25.360165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527350+0000","last_change":"2024-03-18T00:25:23.526470+0000","last_active":"2024-03-18T00:25:24.527350+0000","last_peered":"2024-03-18T00:25:24.527350+0000","last_clean":"2024-03-18T00:25:24.527350+0000","last_became_active":"2024-03-18T00:25:23.526181+0000","last_became_peered":"2024-03-18T00:25:23.526181+0000","last_unstale":"2024-03-18T00:25:24.527350+0000","last_undegraded":"2024-03-18T00:25:24.527350+0000","last_fullsized":"2024-03-18T00:25:24.527350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933336+0000","last_change":"2024-03-18T00:25:23.529914+0000","last_active":"2024-03-18T00:25:24.933336+0000","last_peered":"2024-03-18T00:25:24.933336+0000","last_clean":"2024-03-18T00:25:24.933336+0000","last_became_active":"2024-03-18T00:25:23.529601+0000","last_became_peered":"2024-03-18T00:25:23.529601+0000","last_unstale":"2024-03-18T00:25:24.933336+0000","last_undegraded":"2024-03-18T00:25:24.933336+0000","last_fullsized":"2024-03-18T00:25:24.933336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:42:59.751721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360378+0000","last_change":"2024-03-18T00:25:23.543302+0000","last_active":"2024-03-18T00:25:25.360378+0000","last_peered":"2024-03-18T00:25:25.360378+0000","last_clean":"2024-03-18T00:25:25.360378+0000","last_became_active":"2024-03-18T00:25:23.542926+0000","last_became_peered":"2024-03-18T00:25:23.542926+0000","last_unstale":"2024-03-18T00:25:25.360378+0000","last_undegraded":"2024-03-18T00:25:25.360378+0000","last_fullsized":"2024-03-18T00:25:25.360378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360045+0000","last_change":"2024-03-18T00:25:23.539758+0000","last_active":"2024-03-18T00:25:25.360045+0000","last_peered":"2024-03-18T00:25:25.360045+0000","last_clean":"2024-03-18T00:25:25.360045+0000","last_became_active":"2024-03-18T00:25:23.537575+0000","last_became_peered":"2024-03-18T00:25:23.537575+0000","last_unstale":"2024-03-18T00:25:25.360045+0000","last_undegraded":"2024-03-18T00:25:25.360045+0000","last_fullsized":"2024-03-18T00:25:25.360045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360144+0000","last_change":"2024-03-18T00:25:23.528725+0000","last_active":"2024-03-18T00:25:25.360144+0000","last_peered":"2024-03-18T00:25:25.360144+0000","last_clean":"2024-03-18T00:25:25.360144+0000","last_became_active":"2024-03-18T00:25:23.528456+0000","last_became_peered":"2024-03-18T00:25:23.528456+0000","last_unstale":"2024-03-18T00:25:25.360144+0000","last_undegraded":"2024-03-18T00:25:25.360144+0000","last_fullsized":"2024-03-18T00:25:25.360144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359549+0000","last_change":"2024-03-18T00:25:23.532811+0000","last_active":"2024-03-18T00:25:25.359549+0000","last_peered":"2024-03-18T00:25:25.359549+0000","last_clean":"2024-03-18T00:25:25.359549+0000","last_became_active":"2024-03-18T00:25:23.530841+0000","last_became_peered":"2024-03-18T00:25:23.530841+0000","last_unstale":"2024-03-18T00:25:25.359549+0000","last_undegraded":"2024-03-18T00:25:25.359549+0000","last_fullsized":"2024-03-18T00:25:25.359549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524831+0000","last_change":"2024-03-18T00:25:23.536908+0000","last_active":"2024-03-18T00:25:24.524831+0000","last_peered":"2024-03-18T00:25:24.524831+0000","last_clean":"2024-03-18T00:25:24.524831+0000","last_became_active":"2024-03-18T00:25:23.536369+0000","last_became_peered":"2024-03-18T00:25:23.536369+0000","last_unstale":"2024-03-18T00:25:24.524831+0000","last_undegraded":"2024-03-18T00:25:24.524831+0000","last_fullsized":"2024-03-18T00:25:24.524831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360205+0000","last_change":"2024-03-18T00:25:23.535358+0000","last_active":"2024-03-18T00:25:25.360205+0000","last_peered":"2024-03-18T00:25:25.360205+0000","last_clean":"2024-03-18T00:25:25.360205+0000","last_became_active":"2024-03-18T00:25:23.535099+0000","last_became_peered":"2024-03-18T00:25:23.535099+0000","last_unstale":"2024-03-18T00:25:25.360205+0000","last_undegraded":"2024-03-18T00:25:25.360205+0000","last_fullsized":"2024-03-18T00:25:25.360205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525233+0000","last_change":"2024-03-18T00:25:23.524721+0000","last_active":"2024-03-18T00:25:24.525233+0000","last_peered":"2024-03-18T00:25:24.525233+0000","last_clean":"2024-03-18T00:25:24.525233+0000","last_became_active":"2024-03-18T00:25:23.524434+0000","last_became_peered":"2024-03-18T00:25:23.524434+0000","last_unstale":"2024-03-18T00:25:24.525233+0000","last_undegraded":"2024-03-18T00:25:24.525233+0000","last_fullsized":"2024-03-18T00:25:24.525233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525031+0000","last_change":"2024-03-18T00:25:23.525372+0000","last_active":"2024-03-18T00:25:24.525031+0000","last_peered":"2024-03-18T00:25:24.525031+0000","last_clean":"2024-03-18T00:25:24.525031+0000","last_became_active":"2024-03-18T00:25:23.524989+0000","last_became_peered":"2024-03-18T00:25:23.524989+0000","last_unstale":"2024-03-18T00:25:24.525031+0000","last_undegraded":"2024-03-18T00:25:24.525031+0000","last_fullsized":"2024-03-18T00:25:24.525031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859513+0000","last_change":"2024-03-18T00:25:23.536156+0000","last_active":"2024-03-18T00:25:24.859513+0000","last_peered":"2024-03-18T00:25:24.859513+0000","last_clean":"2024-03-18T00:25:24.859513+0000","last_became_active":"2024-03-18T00:25:23.535858+0000","last_became_peered":"2024-03-18T00:25:23.535858+0000","last_unstale":"2024-03-18T00:25:24.859513+0000","last_undegraded":"2024-03-18T00:25:24.859513+0000","last_fullsized":"2024-03-18T00:25:24.859513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524955+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.524955+0000","last_peered":"2024-03-18T00:25:24.524955+0000","last_clean":"2024-03-18T00:25:24.524955+0000","last_became_active":"2024-03-18T00:25:23.537444+0000","last_became_peered":"2024-03-18T00:25:23.537444+0000","last_unstale":"2024-03-18T00:25:24.524955+0000","last_undegraded":"2024-03-18T00:25:24.524955+0000","last_fullsized":"2024-03-18T00:25:24.524955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933313+0000","last_change":"2024-03-18T00:25:23.528214+0000","last_active":"2024-03-18T00:25:24.933313+0000","last_peered":"2024-03-18T00:25:24.933313+0000","last_clean":"2024-03-18T00:25:24.933313+0000","last_became_active":"2024-03-18T00:25:23.527939+0000","last_became_peered":"2024-03-18T00:25:23.527939+0000","last_unstale":"2024-03-18T00:25:24.933313+0000","last_undegraded":"2024-03-18T00:25:24.933313+0000","last_fullsized":"2024-03-18T00:25:24.933313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:48.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527062+0000","last_change":"2024-03-18T00:25:23.539451+0000","last_active":"2024-03-18T00:25:24.527062+0000","last_peered":"2024-03-18T00:25:24.527062+0000","last_clean":"2024-03-18T00:25:24.527062+0000","last_became_active":"2024-03-18T00:25:23.539183+0000","last_became_peered":"2024-03-18T00:25:23.539183+0000","last_unstale":"2024-03-18T00:25:24.527062+0000","last_undegraded":"2024-03-18T00:25:24.527062+0000","last_fullsized":"2024-03-18T00:25:24.527062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359583+0000","last_change":"2024-03-18T00:25:23.529121+0000","last_active":"2024-03-18T00:25:25.359583+0000","last_peered":"2024-03-18T00:25:25.359583+0000","last_clean":"2024-03-18T00:25:25.359583+0000","last_became_active":"2024-03-18T00:25:23.528826+0000","last_became_peered":"2024-03-18T00:25:23.528826+0000","last_unstale":"2024-03-18T00:25:25.359583+0000","last_undegraded":"2024-03-18T00:25:25.359583+0000","last_fullsized":"2024-03-18T00:25:25.359583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360000+0000","last_change":"2024-03-18T00:25:23.532218+0000","last_active":"2024-03-18T00:25:25.360000+0000","last_peered":"2024-03-18T00:25:25.360000+0000","last_clean":"2024-03-18T00:25:25.360000+0000","last_became_active":"2024-03-18T00:25:23.531962+0000","last_became_peered":"2024-03-18T00:25:23.531962+0000","last_unstale":"2024-03-18T00:25:25.360000+0000","last_undegraded":"2024-03-18T00:25:25.360000+0000","last_fullsized":"2024-03-18T00:25:25.360000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359804+0000","last_change":"2024-03-18T00:25:23.531016+0000","last_active":"2024-03-18T00:25:25.359804+0000","last_peered":"2024-03-18T00:25:25.359804+0000","last_clean":"2024-03-18T00:25:25.359804+0000","last_became_active":"2024-03-18T00:25:23.530710+0000","last_became_peered":"2024-03-18T00:25:23.530710+0000","last_unstale":"2024-03-18T00:25:25.359804+0000","last_undegraded":"2024-03-18T00:25:25.359804+0000","last_fullsized":"2024-03-18T00:25:25.359804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360675+0000","last_change":"2024-03-18T00:25:23.532105+0000","last_active":"2024-03-18T00:25:25.360675+0000","last_peered":"2024-03-18T00:25:25.360675+0000","last_clean":"2024-03-18T00:25:25.360675+0000","last_became_active":"2024-03-18T00:25:23.531767+0000","last_became_peered":"2024-03-18T00:25:23.531767+0000","last_unstale":"2024-03-18T00:25:25.360675+0000","last_undegraded":"2024-03-18T00:25:25.360675+0000","last_fullsized":"2024-03-18T00:25:25.360675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:03.624129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525483+0000","last_change":"2024-03-18T00:25:23.535568+0000","last_active":"2024-03-18T00:25:24.525483+0000","last_peered":"2024-03-18T00:25:24.525483+0000","last_clean":"2024-03-18T00:25:24.525483+0000","last_became_active":"2024-03-18T00:25:23.535301+0000","last_became_peered":"2024-03-18T00:25:23.535301+0000","last_unstale":"2024-03-18T00:25:24.525483+0000","last_undegraded":"2024-03-18T00:25:24.525483+0000","last_fullsized":"2024-03-18T00:25:24.525483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.531923+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.531605+0000","last_became_peered":"2024-03-18T00:25:23.531605+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360278+0000","last_change":"2024-03-18T00:25:23.540875+0000","last_active":"2024-03-18T00:25:25.360278+0000","last_peered":"2024-03-18T00:25:25.360278+0000","last_clean":"2024-03-18T00:25:25.360278+0000","last_became_active":"2024-03-18T00:25:23.540621+0000","last_became_peered":"2024-03-18T00:25:23.540621+0000","last_unstale":"2024-03-18T00:25:25.360278+0000","last_undegraded":"2024-03-18T00:25:25.360278+0000","last_fullsized":"2024-03-18T00:25:25.360278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524925+0000","last_change":"2024-03-18T00:25:23.540944+0000","last_active":"2024-03-18T00:25:24.524925+0000","last_peered":"2024-03-18T00:25:24.524925+0000","last_clean":"2024-03-18T00:25:24.524925+0000","last_became_active":"2024-03-18T00:25:23.540662+0000","last_became_peered":"2024-03-18T00:25:23.540662+0000","last_unstale":"2024-03-18T00:25:24.524925+0000","last_undegraded":"2024-03-18T00:25:24.524925+0000","last_fullsized":"2024-03-18T00:25:24.524925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359780+0000","last_change":"2024-03-18T00:25:23.538366+0000","last_active":"2024-03-18T00:25:25.359780+0000","last_peered":"2024-03-18T00:25:25.359780+0000","last_clean":"2024-03-18T00:25:25.359780+0000","last_became_active":"2024-03-18T00:25:23.538091+0000","last_became_peered":"2024-03-18T00:25:23.538091+0000","last_unstale":"2024-03-18T00:25:25.359780+0000","last_undegraded":"2024-03-18T00:25:25.359780+0000","last_fullsized":"2024-03-18T00:25:25.359780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525286+0000","last_change":"2024-03-18T00:25:23.539971+0000","last_active":"2024-03-18T00:25:24.525286+0000","last_peered":"2024-03-18T00:25:24.525286+0000","last_clean":"2024-03-18T00:25:24.525286+0000","last_became_active":"2024-03-18T00:25:23.539703+0000","last_became_peered":"2024-03-18T00:25:23.539703+0000","last_unstale":"2024-03-18T00:25:24.525286+0000","last_undegraded":"2024-03-18T00:25:24.525286+0000","last_fullsized":"2024-03-18T00:25:24.525286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525354+0000","last_change":"2024-03-18T00:25:23.528213+0000","last_active":"2024-03-18T00:25:24.525354+0000","last_peered":"2024-03-18T00:25:24.525354+0000","last_clean":"2024-03-18T00:25:24.525354+0000","last_became_active":"2024-03-18T00:25:23.527957+0000","last_became_peered":"2024-03-18T00:25:23.527957+0000","last_unstale":"2024-03-18T00:25:24.525354+0000","last_undegraded":"2024-03-18T00:25:24.525354+0000","last_fullsized":"2024-03-18T00:25:24.525354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527277+0000","last_change":"2024-03-18T00:25:23.538220+0000","last_active":"2024-03-18T00:25:24.527277+0000","last_peered":"2024-03-18T00:25:24.527277+0000","last_clean":"2024-03-18T00:25:24.527277+0000","last_became_active":"2024-03-18T00:25:23.537965+0000","last_became_peered":"2024-03-18T00:25:23.537965+0000","last_unstale":"2024-03-18T00:25:24.527277+0000","last_undegraded":"2024-03-18T00:25:24.527277+0000","last_fullsized":"2024-03-18T00:25:24.527277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525245+0000","last_change":"2024-03-18T00:25:23.540936+0000","last_active":"2024-03-18T00:25:24.525245+0000","last_peered":"2024-03-18T00:25:24.525245+0000","last_clean":"2024-03-18T00:25:24.525245+0000","last_became_active":"2024-03-18T00:25:23.540679+0000","last_became_peered":"2024-03-18T00:25:23.540679+0000","last_unstale":"2024-03-18T00:25:24.525245+0000","last_undegraded":"2024-03-18T00:25:24.525245+0000","last_fullsized":"2024-03-18T00:25:24.525245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933579+0000","last_change":"2024-03-18T00:25:23.538218+0000","last_active":"2024-03-18T00:25:24.933579+0000","last_peered":"2024-03-18T00:25:24.933579+0000","last_clean":"2024-03-18T00:25:24.933579+0000","last_became_active":"2024-03-18T00:25:23.537892+0000","last_became_peered":"2024-03-18T00:25:23.537892+0000","last_unstale":"2024-03-18T00:25:24.933579+0000","last_undegraded":"2024-03-18T00:25:24.933579+0000","last_fullsized":"2024-03-18T00:25:24.933579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360411+0000","last_change":"2024-03-18T00:25:23.539202+0000","last_active":"2024-03-18T00:25:25.360411+0000","last_peered":"2024-03-18T00:25:25.360411+0000","last_clean":"2024-03-18T00:25:25.360411+0000","last_became_active":"2024-03-18T00:25:23.538922+0000","last_became_peered":"2024-03-18T00:25:23.538922+0000","last_unstale":"2024-03-18T00:25:25.360411+0000","last_undegraded":"2024-03-18T00:25:25.360411+0000","last_fullsized":"2024-03-18T00:25:25.360411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359685+0000","last_change":"2024-03-18T00:25:23.529487+0000","last_active":"2024-03-18T00:25:25.359685+0000","last_peered":"2024-03-18T00:25:25.359685+0000","last_clean":"2024-03-18T00:25:25.359685+0000","last_became_active":"2024-03-18T00:25:23.529211+0000","last_became_peered":"2024-03-18T00:25:23.529211+0000","last_unstale":"2024-03-18T00:25:25.359685+0000","last_undegraded":"2024-03-18T00:25:25.359685+0000","last_fullsized":"2024-03-18T00:25:25.359685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524820+0000","last_change":"2024-03-18T00:25:23.526131+0000","last_active":"2024-03-18T00:25:24.524820+0000","last_peered":"2024-03-18T00:25:24.524820+0000","last_clean":"2024-03-18T00:25:24.524820+0000","last_became_active":"2024-03-18T00:25:23.525869+0000","last_became_peered":"2024-03-18T00:25:23.525869+0000","last_unstale":"2024-03-18T00:25:24.524820+0000","last_undegraded":"2024-03-18T00:25:24.524820+0000","last_fullsized":"2024-03-18T00:25:24.524820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859267+0000","last_change":"2024-03-18T00:25:23.528904+0000","last_active":"2024-03-18T00:25:24.859267+0000","last_peered":"2024-03-18T00:25:24.859267+0000","last_clean":"2024-03-18T00:25:24.859267+0000","last_became_active":"2024-03-18T00:25:23.528637+0000","last_became_peered":"2024-03-18T00:25:23.528637+0000","last_unstale":"2024-03-18T00:25:24.859267+0000","last_undegraded":"2024-03-18T00:25:24.859267+0000","last_fullsized":"2024-03-18T00:25:24.859267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:50.372929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525171+0000","last_change":"2024-03-18T00:25:22.525633+0000","last_active":"2024-03-18T00:25:24.525171+0000","last_peered":"2024-03-18T00:25:24.525171+0000","last_clean":"2024-03-18T00:25:24.525171+0000","last_became_active":"2024-03-18T00:25:22.525293+0000","last_became_peered":"2024-03-18T00:25:22.525293+0000","last_unstale":"2024-03-18T00:25:24.525171+0000","last_undegraded":"2024-03-18T00:25:24.525171+0000","last_fullsized":"2024-03-18T00:25:24.525171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:29:02.213393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933633+0000","last_change":"2024-03-18T00:25:23.532009+0000","last_active":"2024-03-18T00:25:24.933633+0000","last_peered":"2024-03-18T00:25:24.933633+0000","last_clean":"2024-03-18T00:25:24.933633+0000","last_became_active":"2024-03-18T00:25:23.531736+0000","last_became_peered":"2024-03-18T00:25:23.531736+0000","last_unstale":"2024-03-18T00:25:24.933633+0000","last_undegraded":"2024-03-18T00:25:24.933633+0000","last_fullsized":"2024-03-18T00:25:24.933633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524921+0000","last_change":"2024-03-18T00:25:22.521332+0000","last_active":"2024-03-18T00:25:24.524921+0000","last_peered":"2024-03-18T00:25:24.524921+0000","last_clean":"2024-03-18T00:25:24.524921+0000","last_became_active":"2024-03-18T00:25:22.520113+0000","last_became_peered":"2024-03-18T00:25:22.520113+0000","last_unstale":"2024-03-18T00:25:24.524921+0000","last_undegraded":"2024-03-18T00:25:24.524921+0000","last_fullsized":"2024-03-18T00:25:24.524921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524901+0000","last_change":"2024-03-18T00:25:22.525936+0000","last_active":"2024-03-18T00:25:24.524901+0000","last_peered":"2024-03-18T00:25:24.524901+0000","last_clean":"2024-03-18T00:25:24.524901+0000","last_became_active":"2024-03-18T00:25:22.525688+0000","last_became_peered":"2024-03-18T00:25:22.525688+0000","last_unstale":"2024-03-18T00:25:24.524901+0000","last_undegraded":"2024-03-18T00:25:24.524901+0000","last_fullsized":"2024-03-18T00:25:24.524901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524904+0000","last_change":"2024-03-18T00:25:23.537268+0000","last_active":"2024-03-18T00:25:24.524904+0000","last_peered":"2024-03-18T00:25:24.524904+0000","last_clean":"2024-03-18T00:25:24.524904+0000","last_became_active":"2024-03-18T00:25:23.536747+0000","last_became_peered":"2024-03-18T00:25:23.536747+0000","last_unstale":"2024-03-18T00:25:24.524904+0000","last_undegraded":"2024-03-18T00:25:24.524904+0000","last_fullsized":"2024-03-18T00:25:24.524904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359815+0000","last_change":"2024-03-18T00:25:22.525372+0000","last_active":"2024-03-18T00:25:25.359815+0000","last_peered":"2024-03-18T00:25:25.359815+0000","last_clean":"2024-03-18T00:25:25.359815+0000","last_became_active":"2024-03-18T00:25:22.525058+0000","last_became_peered":"2024-03-18T00:25:22.525058+0000","last_unstale":"2024-03-18T00:25:25.359815+0000","last_undegraded":"2024-03-18T00:25:25.359815+0000","last_fullsized":"2024-03-18T00:25:25.359815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526925+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.526925+0000","last_peered":"2024-03-18T00:25:24.526925+0000","last_clean":"2024-03-18T00:25:24.526925+0000","last_became_active":"2024-03-18T00:25:23.538003+0000","last_became_peered":"2024-03-18T00:25:23.538003+0000","last_unstale":"2024-03-18T00:25:24.526925+0000","last_undegraded":"2024-03-18T00:25:24.526925+0000","last_fullsized":"2024-03-18T00:25:24.526925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525197+0000","last_change":"2024-03-18T00:25:22.512527+0000","last_active":"2024-03-18T00:25:24.525197+0000","last_peered":"2024-03-18T00:25:24.525197+0000","last_clean":"2024-03-18T00:25:24.525197+0000","last_became_active":"2024-03-18T00:25:22.512256+0000","last_became_peered":"2024-03-18T00:25:22.512256+0000","last_unstale":"2024-03-18T00:25:24.525197+0000","last_undegraded":"2024-03-18T00:25:24.525197+0000","last_fullsized":"2024-03-18T00:25:24.525197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360064+0000","last_change":"2024-03-18T00:25:23.536878+0000","last_active":"2024-03-18T00:25:25.360064+0000","last_peered":"2024-03-18T00:25:25.360064+0000","last_clean":"2024-03-18T00:25:25.360064+0000","last_became_active":"2024-03-18T00:25:23.536571+0000","last_became_peered":"2024-03-18T00:25:23.536571+0000","last_unstale":"2024-03-18T00:25:25.360064+0000","last_undegraded":"2024-03-18T00:25:25.360064+0000","last_fullsized":"2024-03-18T00:25:25.360064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360235+0000","last_change":"2024-03-18T00:25:22.516162+0000","last_active":"2024-03-18T00:25:25.360235+0000","last_peered":"2024-03-18T00:25:25.360235+0000","last_clean":"2024-03-18T00:25:25.360235+0000","last_became_active":"2024-03-18T00:25:22.515844+0000","last_became_peered":"2024-03-18T00:25:22.515844+0000","last_unstale":"2024-03-18T00:25:25.360235+0000","last_undegraded":"2024-03-18T00:25:25.360235+0000","last_fullsized":"2024-03-18T00:25:25.360235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.529085+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.528662+0000","last_became_peered":"2024-03-18T00:25:23.528662+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527254+0000","last_change":"2024-03-18T00:25:22.521602+0000","last_active":"2024-03-18T00:25:24.527254+0000","last_peered":"2024-03-18T00:25:24.527254+0000","last_clean":"2024-03-18T00:25:24.527254+0000","last_became_active":"2024-03-18T00:25:22.521328+0000","last_became_peered":"2024-03-18T00:25:22.521328+0000","last_unstale":"2024-03-18T00:25:24.527254+0000","last_undegraded":"2024-03-18T00:25:24.527254+0000","last_fullsized":"2024-03-18T00:25:24.527254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859580+0000","last_change":"2024-03-18T00:25:23.543862+0000","last_active":"2024-03-18T00:25:24.859580+0000","last_peered":"2024-03-18T00:25:24.859580+0000","last_clean":"2024-03-18T00:25:24.859580+0000","last_became_active":"2024-03-18T00:25:23.543558+0000","last_became_peered":"2024-03-18T00:25:23.543558+0000","last_unstale":"2024-03-18T00:25:24.859580+0000","last_undegraded":"2024-03-18T00:25:24.859580+0000","last_fullsized":"2024-03-18T00:25:24.859580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:14.829023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525576+0000","last_change":"2024-03-18T00:25:22.525827+0000","last_active":"2024-03-18T00:25:24.525576+0000","last_peered":"2024-03-18T00:25:24.525576+0000","last_clean":"2024-03-18T00:25:24.525576+0000","last_became_active":"2024-03-18T00:25:22.525551+0000","last_became_peered":"2024-03-18T00:25:22.525551+0000","last_unstale":"2024-03-18T00:25:24.525576+0000","last_undegraded":"2024-03-18T00:25:24.525576+0000","last_fullsized":"2024-03-18T00:25:24.525576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360412+0000","last_change":"2024-03-18T00:25:23.543586+0000","last_active":"2024-03-18T00:25:25.360412+0000","last_peered":"2024-03-18T00:25:25.360412+0000","last_clean":"2024-03-18T00:25:25.360412+0000","last_became_active":"2024-03-18T00:25:23.543343+0000","last_became_peered":"2024-03-18T00:25:23.543343+0000","last_unstale":"2024-03-18T00:25:25.360412+0000","last_undegraded":"2024-03-18T00:25:25.360412+0000","last_fullsized":"2024-03-18T00:25:25.360412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:39:37.708353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933641+0000","last_change":"2024-03-18T00:25:22.525005+0000","last_active":"2024-03-18T00:25:24.933641+0000","last_peered":"2024-03-18T00:25:24.933641+0000","last_clean":"2024-03-18T00:25:24.933641+0000","last_became_active":"2024-03-18T00:25:22.524742+0000","last_became_peered":"2024-03-18T00:25:22.524742+0000","last_unstale":"2024-03-18T00:25:24.933641+0000","last_undegraded":"2024-03-18T00:25:24.933641+0000","last_fullsized":"2024-03-18T00:25:24.933641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933361+0000","last_change":"2024-03-18T00:25:23.525230+0000","last_active":"2024-03-18T00:25:24.933361+0000","last_peered":"2024-03-18T00:25:24.933361+0000","last_clean":"2024-03-18T00:25:24.933361+0000","last_became_active":"2024-03-18T00:25:23.524978+0000","last_became_peered":"2024-03-18T00:25:23.524978+0000","last_unstale":"2024-03-18T00:25:24.933361+0000","last_undegraded":"2024-03-18T00:25:24.933361+0000","last_fullsized":"2024-03-18T00:25:24.933361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360495+0000","last_change":"2024-03-18T00:25:22.524729+0000","last_active":"2024-03-18T00:25:25.360495+0000","last_peered":"2024-03-18T00:25:25.360495+0000","last_clean":"2024-03-18T00:25:25.360495+0000","last_became_active":"2024-03-18T00:25:22.524455+0000","last_became_peered":"2024-03-18T00:25:22.524455+0000","last_unstale":"2024-03-18T00:25:25.360495+0000","last_undegraded":"2024-03-18T00:25:25.360495+0000","last_fullsized":"2024-03-18T00:25:25.360495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:23.541999+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:23.541593+0000","last_became_peered":"2024-03-18T00:25:23.541593+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524819+0000","last_change":"2024-03-18T00:25:22.519877+0000","last_active":"2024-03-18T00:25:24.524819+0000","last_peered":"2024-03-18T00:25:24.524819+0000","last_clean":"2024-03-18T00:25:24.524819+0000","last_became_active":"2024-03-18T00:25:22.519396+0000","last_became_peered":"2024-03-18T00:25:22.519396+0000","last_unstale":"2024-03-18T00:25:24.524819+0000","last_undegraded":"2024-03-18T00:25:24.524819+0000","last_fullsized":"2024-03-18T00:25:24.524819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.526752+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.526434+0000","last_became_peered":"2024-03-18T00:25:23.526434+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359803+0000","last_change":"2024-03-18T00:25:22.518260+0000","last_active":"2024-03-18T00:25:25.359803+0000","last_peered":"2024-03-18T00:25:25.359803+0000","last_clean":"2024-03-18T00:25:25.359803+0000","last_became_active":"2024-03-18T00:25:22.517930+0000","last_became_peered":"2024-03-18T00:25:22.517930+0000","last_unstale":"2024-03-18T00:25:25.359803+0000","last_undegraded":"2024-03-18T00:25:25.359803+0000","last_fullsized":"2024-03-18T00:25:25.359803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359692+0000","last_change":"2024-03-18T00:25:23.541873+0000","last_active":"2024-03-18T00:25:25.359692+0000","last_peered":"2024-03-18T00:25:25.359692+0000","last_clean":"2024-03-18T00:25:25.359692+0000","last_became_active":"2024-03-18T00:25:23.541574+0000","last_became_peered":"2024-03-18T00:25:23.541574+0000","last_unstale":"2024-03-18T00:25:25.359692+0000","last_undegraded":"2024-03-18T00:25:25.359692+0000","last_fullsized":"2024-03-18T00:25:25.359692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859586+0000","last_change":"2024-03-18T00:25:22.524063+0000","last_active":"2024-03-18T00:25:24.859586+0000","last_peered":"2024-03-18T00:25:24.859586+0000","last_clean":"2024-03-18T00:25:24.859586+0000","last_became_active":"2024-03-18T00:25:22.523714+0000","last_became_peered":"2024-03-18T00:25:22.523714+0000","last_unstale":"2024-03-18T00:25:24.859586+0000","last_undegraded":"2024-03-18T00:25:24.859586+0000","last_fullsized":"2024-03-18T00:25:24.859586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360141+0000","last_change":"2024-03-18T00:25:23.542168+0000","last_active":"2024-03-18T00:25:25.360141+0000","last_peered":"2024-03-18T00:25:25.360141+0000","last_clean":"2024-03-18T00:25:25.360141+0000","last_became_active":"2024-03-18T00:25:23.541579+0000","last_became_peered":"2024-03-18T00:25:23.541579+0000","last_unstale":"2024-03-18T00:25:25.360141+0000","last_undegraded":"2024-03-18T00:25:25.360141+0000","last_fullsized":"2024-03-18T00:25:25.360141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359774+0000","last_change":"2024-03-18T00:25:22.525864+0000","last_active":"2024-03-18T00:25:25.359774+0000","last_peered":"2024-03-18T00:25:25.359774+0000","last_clean":"2024-03-18T00:25:25.359774+0000","last_became_active":"2024-03-18T00:25:22.525582+0000","last_became_peered":"2024-03-18T00:25:22.525582+0000","last_unstale":"2024-03-18T00:25:25.359774+0000","last_undegraded":"2024-03-18T00:25:25.359774+0000","last_fullsized":"2024-03-18T00:25:25.359774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360294+0000","last_change":"2024-03-18T00:25:23.542371+0000","last_active":"2024-03-18T00:25:25.360294+0000","last_peered":"2024-03-18T00:25:25.360294+0000","last_clean":"2024-03-18T00:25:25.360294+0000","last_became_active":"2024-03-18T00:25:23.542030+0000","last_became_peered":"2024-03-18T00:25:23.542030+0000","last_unstale":"2024-03-18T00:25:25.360294+0000","last_undegraded":"2024-03-18T00:25:25.360294+0000","last_fullsized":"2024-03-18T00:25:25.360294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:34:40.152850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527312+0000","last_change":"2024-03-18T00:25:22.527178+0000","last_active":"2024-03-18T00:25:24.527312+0000","last_peered":"2024-03-18T00:25:24.527312+0000","last_clean":"2024-03-18T00:25:24.527312+0000","last_became_active":"2024-03-18T00:25:22.526891+0000","last_became_peered":"2024-03-18T00:25:22.526891+0000","last_unstale":"2024-03-18T00:25:24.527312+0000","last_undegraded":"2024-03-18T00:25:24.527312+0000","last_fullsized":"2024-03-18T00:25:24.527312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360509+0000","last_change":"2024-03-18T00:25:23.537093+0000","last_active":"2024-03-18T00:25:25.360509+0000","last_peered":"2024-03-18T00:25:25.360509+0000","last_clean":"2024-03-18T00:25:25.360509+0000","last_became_active":"2024-03-18T00:25:23.536816+0000","last_became_peered":"2024-03-18T00:25:23.536816+0000","last_unstale":"2024-03-18T00:25:25.360509+0000","last_undegraded":"2024-03-18T00:25:25.360509+0000","last_fullsized":"2024-03-18T00:25:25.360509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359667+0000","last_change":"2024-03-18T00:25:22.522241+0000","last_active":"2024-03-18T00:25:25.359667+0000","last_peered":"2024-03-18T00:25:25.359667+0000","last_clean":"2024-03-18T00:25:25.359667+0000","last_became_active":"2024-03-18T00:25:22.521959+0000","last_became_peered":"2024-03-18T00:25:22.521959+0000","last_unstale":"2024-03-18T00:25:25.359667+0000","last_undegraded":"2024-03-18T00:25:25.359667+0000","last_fullsized":"2024-03-18T00:25:25.359667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360544+0000","last_change":"2024-03-18T00:25:23.533012+0000","last_active":"2024-03-18T00:25:25.360544+0000","last_peered":"2024-03-18T00:25:25.360544+0000","last_clean":"2024-03-18T00:25:25.360544+0000","last_became_active":"2024-03-18T00:25:23.532746+0000","last_became_peered":"2024-03-18T00:25:23.532746+0000","last_unstale":"2024-03-18T00:25:25.360544+0000","last_undegraded":"2024-03-18T00:25:25.360544+0000","last_fullsized":"2024-03-18T00:25:25.360544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:06:47.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359515+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:25.359515+0000","last_peered":"2024-03-18T00:25:25.359515+0000","last_clean":"2024-03-18T00:25:25.359515+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:25.359515+0000","last_undegraded":"2024-03-18T00:25:25.359515+0000","last_fullsized":"2024-03-18T00:25:25.359515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:22.518151+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:22.517836+0000","last_became_peered":"2024-03-18T00:25:22.517836+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524976+0000","last_change":"2024-03-18T00:25:23.542819+0000","last_active":"2024-03-18T00:25:24.524976+0000","last_peered":"2024-03-18T00:25:24.524976+0000","last_clean":"2024-03-18T00:25:24.524976+0000","last_became_active":"2024-03-18T00:25:23.541993+0000","last_became_peered":"2024-03-18T00:25:23.541993+0000","last_unstale":"2024-03-18T00:25:24.524976+0000","last_undegraded":"2024-03-18T00:25:24.524976+0000","last_fullsized":"2024-03-18T00:25:24.524976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359453+0000","last_change":"2024-03-18T00:25:22.526454+0000","last_active":"2024-03-18T00:25:25.359453+0000","last_peered":"2024-03-18T00:25:25.359453+0000","last_clean":"2024-03-18T00:25:25.359453+0000","last_became_active":"2024-03-18T00:25:22.525824+0000","last_became_peered":"2024-03-18T00:25:22.525824+0000","last_unstale":"2024-03-18T00:25:25.359453+0000","last_undegraded":"2024-03-18T00:25:25.359453+0000","last_fullsized":"2024-03-18T00:25:25.359453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:36.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933234+0000","last_change":"2024-03-18T00:25:23.533610+0000","last_active":"2024-03-18T00:25:24.933234+0000","last_peered":"2024-03-18T00:25:24.933234+0000","last_clean":"2024-03-18T00:25:24.933234+0000","last_became_active":"2024-03-18T00:25:23.531816+0000","last_became_peered":"2024-03-18T00:25:23.531816+0000","last_unstale":"2024-03-18T00:25:24.933234+0000","last_undegraded":"2024-03-18T00:25:24.933234+0000","last_fullsized":"2024-03-18T00:25:24.933234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:51:00.174852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359686+0000","last_change":"2024-03-18T00:25:22.524836+0000","last_active":"2024-03-18T00:25:25.359686+0000","last_peered":"2024-03-18T00:25:25.359686+0000","last_clean":"2024-03-18T00:25:25.359686+0000","last_became_active":"2024-03-18T00:25:22.524559+0000","last_became_peered":"2024-03-18T00:25:22.524559+0000","last_unstale":"2024-03-18T00:25:25.359686+0000","last_undegraded":"2024-03-18T00:25:25.359686+0000","last_fullsized":"2024-03-18T00:25:25.359686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526935+0000","last_change":"2024-03-18T00:25:23.530154+0000","last_active":"2024-03-18T00:25:24.526935+0000","last_peered":"2024-03-18T00:25:24.526935+0000","last_clean":"2024-03-18T00:25:24.526935+0000","last_became_active":"2024-03-18T00:25:23.529909+0000","last_became_peered":"2024-03-18T00:25:23.529909+0000","last_unstale":"2024-03-18T00:25:24.526935+0000","last_undegraded":"2024-03-18T00:25:24.526935+0000","last_fullsized":"2024-03-18T00:25:24.526935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360581+0000","last_change":"2024-03-18T00:25:22.522580+0000","last_active":"2024-03-18T00:25:25.360581+0000","last_peered":"2024-03-18T00:25:25.360581+0000","last_clean":"2024-03-18T00:25:25.360581+0000","last_became_active":"2024-03-18T00:25:22.522157+0000","last_became_peered":"2024-03-18T00:25:22.522157+0000","last_unstale":"2024-03-18T00:25:25.360581+0000","last_undegraded":"2024-03-18T00:25:25.360581+0000","last_fullsized":"2024-03-18T00:25:25.360581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859361+0000","last_change":"2024-03-18T00:25:23.539763+0000","last_active":"2024-03-18T00:25:24.859361+0000","last_peered":"2024-03-18T00:25:24.859361+0000","last_clean":"2024-03-18T00:25:24.859361+0000","last_became_active":"2024-03-18T00:25:23.539502+0000","last_became_peered":"2024-03-18T00:25:23.539502+0000","last_unstale":"2024-03-18T00:25:24.859361+0000","last_undegraded":"2024-03-18T00:25:24.859361+0000","last_fullsized":"2024-03-18T00:25:24.859361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527211+0000","last_change":"2024-03-18T00:25:22.520229+0000","last_active":"2024-03-18T00:25:24.527211+0000","last_peered":"2024-03-18T00:25:24.527211+0000","last_clean":"2024-03-18T00:25:24.527211+0000","last_became_active":"2024-03-18T00:25:22.519955+0000","last_became_peered":"2024-03-18T00:25:22.519955+0000","last_unstale":"2024-03-18T00:25:24.527211+0000","last_undegraded":"2024-03-18T00:25:24.527211+0000","last_fullsized":"2024-03-18T00:25:24.527211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360629+0000","last_change":"2024-03-18T00:25:23.538375+0000","last_active":"2024-03-18T00:25:25.360629+0000","last_peered":"2024-03-18T00:25:25.360629+0000","last_clean":"2024-03-18T00:25:25.360629+0000","last_became_active":"2024-03-18T00:25:23.538114+0000","last_became_peered":"2024-03-18T00:25:23.538114+0000","last_unstale":"2024-03-18T00:25:25.360629+0000","last_undegraded":"2024-03-18T00:25:25.360629+0000","last_fullsized":"2024-03-18T00:25:25.360629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360706+0000","last_change":"2024-03-18T00:25:22.527522+0000","last_active":"2024-03-18T00:25:25.360706+0000","last_peered":"2024-03-18T00:25:25.360706+0000","last_clean":"2024-03-18T00:25:25.360706+0000","last_became_active":"2024-03-18T00:25:22.527170+0000","last_became_peered":"2024-03-18T00:25:22.527170+0000","last_unstale":"2024-03-18T00:25:25.360706+0000","last_undegraded":"2024-03-18T00:25:25.360706+0000","last_fullsized":"2024-03-18T00:25:25.360706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:50:59.169893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527236+0000","last_change":"2024-03-18T00:25:23.529557+0000","last_active":"2024-03-18T00:25:24.527236+0000","last_peered":"2024-03-18T00:25:24.527236+0000","last_clean":"2024-03-18T00:25:24.527236+0000","last_became_active":"2024-03-18T00:25:23.529316+0000","last_became_peered":"2024-03-18T00:25:23.529316+0000","last_unstale":"2024-03-18T00:25:24.527236+0000","last_undegraded":"2024-03-18T00:25:24.527236+0000","last_fullsized":"2024-03-18T00:25:24.527236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.528528+0000","last_change":"2024-03-18T00:25:22.520956+0000","last_active":"2024-03-18T00:25:24.528528+0000","last_peered":"2024-03-18T00:25:24.528528+0000","last_clean":"2024-03-18T00:25:24.528528+0000","last_became_active":"2024-03-18T00:25:22.520708+0000","last_became_peered":"2024-03-18T00:25:22.520708+0000","last_unstale":"2024-03-18T00:25:24.528528+0000","last_undegraded":"2024-03-18T00:25:24.528528+0000","last_fullsized":"2024-03-18T00:25:24.528528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525346+0000","last_change":"2024-03-18T00:25:23.543671+0000","last_active":"2024-03-18T00:25:24.525346+0000","last_peered":"2024-03-18T00:25:24.525346+0000","last_clean":"2024-03-18T00:25:24.525346+0000","last_became_active":"2024-03-18T00:25:23.543393+0000","last_became_peered":"2024-03-18T00:25:23.543393+0000","last_unstale":"2024-03-18T00:25:24.525346+0000","last_undegraded":"2024-03-18T00:25:24.525346+0000","last_fullsized":"2024-03-18T00:25:24.525346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525281+0000","last_change":"2024-03-18T00:25:22.521876+0000","last_active":"2024-03-18T00:25:24.525281+0000","last_peered":"2024-03-18T00:25:24.525281+0000","last_clean":"2024-03-18T00:25:24.525281+0000","last_became_active":"2024-03-18T00:25:22.521555+0000","last_became_peered":"2024-03-18T00:25:22.521555+0000","last_unstale":"2024-03-18T00:25:24.525281+0000","last_undegraded":"2024-03-18T00:25:24.525281+0000","last_fullsized":"2024-03-18T00:25:24.525281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933490+0000","last_change":"2024-03-18T00:25:23.528031+0000","last_active":"2024-03-18T00:25:24.933490+0000","last_peered":"2024-03-18T00:25:24.933490+0000","last_clean":"2024-03-18T00:25:24.933490+0000","last_became_active":"2024-03-18T00:25:23.527711+0000","last_became_peered":"2024-03-18T00:25:23.527711+0000","last_unstale":"2024-03-18T00:25:24.933490+0000","last_undegraded":"2024-03-18T00:25:24.933490+0000","last_fullsized":"2024-03-18T00:25:24.933490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359454+0000","last_change":"2024-03-18T00:25:22.526660+0000","last_active":"2024-03-18T00:25:25.359454+0000","last_peered":"2024-03-18T00:25:25.359454+0000","last_clean":"2024-03-18T00:25:25.359454+0000","last_became_active":"2024-03-18T00:25:22.526187+0000","last_became_peered":"2024-03-18T00:25:22.526187+0000","last_unstale":"2024-03-18T00:25:25.359454+0000","last_undegraded":"2024-03-18T00:25:25.359454+0000","last_fullsized":"2024-03-18T00:25:25.359454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859319+0000","last_change":"2024-03-18T00:25:23.532831+0000","last_active":"2024-03-18T00:25:24.859319+0000","last_peered":"2024-03-18T00:25:24.859319+0000","last_clean":"2024-03-18T00:25:24.859319+0000","last_became_active":"2024-03-18T00:25:23.532560+0000","last_became_peered":"2024-03-18T00:25:23.532560+0000","last_unstale":"2024-03-18T00:25:24.859319+0000","last_undegraded":"2024-03-18T00:25:24.859319+0000","last_fullsized":"2024-03-18T00:25:24.859319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:53.916378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527047+0000","last_change":"2024-03-18T00:25:22.519545+0000","last_active":"2024-03-18T00:25:24.527047+0000","last_peered":"2024-03-18T00:25:24.527047+0000","last_clean":"2024-03-18T00:25:24.527047+0000","last_became_active":"2024-03-18T00:25:22.519310+0000","last_became_peered":"2024-03-18T00:25:22.519310+0000","last_unstale":"2024-03-18T00:25:24.527047+0000","last_undegraded":"2024-03-18T00:25:24.527047+0000","last_fullsized":"2024-03-18T00:25:24.527047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524965+0000","last_change":"2024-03-18T00:25:23.537154+0000","last_active":"2024-03-18T00:25:24.524965+0000","last_peered":"2024-03-18T00:25:24.524965+0000","last_clean":"2024-03-18T00:25:24.524965+0000","last_became_active":"2024-03-18T00:25:23.536652+0000","last_became_peered":"2024-03-18T00:25:23.536652+0000","last_unstale":"2024-03-18T00:25:24.524965+0000","last_undegraded":"2024-03-18T00:25:24.524965+0000","last_fullsized":"2024-03-18T00:25:24.524965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527167+0000","last_change":"2024-03-18T00:25:22.526658+0000","last_active":"2024-03-18T00:25:24.527167+0000","last_peered":"2024-03-18T00:25:24.527167+0000","last_clean":"2024-03-18T00:25:24.527167+0000","last_became_active":"2024-03-18T00:25:22.526284+0000","last_became_peered":"2024-03-18T00:25:22.526284+0000","last_unstale":"2024-03-18T00:25:24.527167+0000","last_undegraded":"2024-03-18T00:25:24.527167+0000","last_fullsized":"2024-03-18T00:25:24.527167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525137+0000","last_change":"2024-03-18T00:25:23.537415+0000","last_active":"2024-03-18T00:25:24.525137+0000","last_peered":"2024-03-18T00:25:24.525137+0000","last_clean":"2024-03-18T00:25:24.525137+0000","last_became_active":"2024-03-18T00:25:23.537145+0000","last_became_peered":"2024-03-18T00:25:23.537145+0000","last_unstale":"2024-03-18T00:25:24.525137+0000","last_undegraded":"2024-03-18T00:25:24.525137+0000","last_fullsized":"2024-03-18T00:25:24.525137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359988+0000","last_change":"2024-03-18T00:25:22.525503+0000","last_active":"2024-03-18T00:25:25.359988+0000","last_peered":"2024-03-18T00:25:25.359988+0000","last_clean":"2024-03-18T00:25:25.359988+0000","last_became_active":"2024-03-18T00:25:22.525243+0000","last_became_peered":"2024-03-18T00:25:22.525243+0000","last_unstale":"2024-03-18T00:25:25.359988+0000","last_undegraded":"2024-03-18T00:25:25.359988+0000","last_fullsized":"2024-03-18T00:25:25.359988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:47.316817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.530235+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.529957+0000","last_became_peered":"2024-03-18T00:25:23.529957+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360510+0000","last_change":"2024-03-18T00:25:23.542945+0000","last_active":"2024-03-18T00:25:25.360510+0000","last_peered":"2024-03-18T00:25:25.360510+0000","last_clean":"2024-03-18T00:25:25.360510+0000","last_became_active":"2024-03-18T00:25:23.541198+0000","last_became_peered":"2024-03-18T00:25:23.541198+0000","last_unstale":"2024-03-18T00:25:25.360510+0000","last_undegraded":"2024-03-18T00:25:25.360510+0000","last_fullsized":"2024-03-18T00:25:25.360510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359960+0000","last_change":"2024-03-18T00:25:22.524744+0000","last_active":"2024-03-18T00:25:25.359960+0000","last_peered":"2024-03-18T00:25:25.359960+0000","last_clean":"2024-03-18T00:25:25.359960+0000","last_became_active":"2024-03-18T00:25:22.524471+0000","last_became_peered":"2024-03-18T00:25:22.524471+0000","last_unstale":"2024-03-18T00:25:25.359960+0000","last_undegraded":"2024-03-18T00:25:25.359960+0000","last_fullsized":"2024-03-18T00:25:25.359960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:13.824065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360483+0000","last_change":"2024-03-18T00:25:23.535099+0000","last_active":"2024-03-18T00:25:25.360483+0000","last_peered":"2024-03-18T00:25:25.360483+0000","last_clean":"2024-03-18T00:25:25.360483+0000","last_became_active":"2024-03-18T00:25:23.534782+0000","last_became_peered":"2024-03-18T00:25:23.534782+0000","last_unstale":"2024-03-18T00:25:25.360483+0000","last_undegraded":"2024-03-18T00:25:25.360483+0000","last_fullsized":"2024-03-18T00:25:25.360483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360610+0000","last_change":"2024-03-18T00:25:22.524438+0000","last_active":"2024-03-18T00:25:25.360610+0000","last_peered":"2024-03-18T00:25:25.360610+0000","last_clean":"2024-03-18T00:25:25.360610+0000","last_became_active":"2024-03-18T00:25:22.524084+0000","last_became_peered":"2024-03-18T00:25:22.524084+0000","last_unstale":"2024-03-18T00:25:25.360610+0000","last_undegraded":"2024-03-18T00:25:25.360610+0000","last_fullsized":"2024-03-18T00:25:25.360610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:28:12.762540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933449+0000","last_change":"2024-03-18T00:25:23.529284+0000","last_active":"2024-03-18T00:25:24.933449+0000","last_peered":"2024-03-18T00:25:24.933449+0000","last_clean":"2024-03-18T00:25:24.933449+0000","last_became_active":"2024-03-18T00:25:23.529022+0000","last_became_peered":"2024-03-18T00:25:23.529022+0000","last_unstale":"2024-03-18T00:25:24.933449+0000","last_undegraded":"2024-03-18T00:25:24.933449+0000","last_fullsized":"2024-03-18T00:25:24.933449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525414+0000","last_change":"2024-03-18T00:25:22.524838+0000","last_active":"2024-03-18T00:25:24.525414+0000","last_peered":"2024-03-18T00:25:24.525414+0000","last_clean":"2024-03-18T00:25:24.525414+0000","last_became_active":"2024-03-18T00:25:22.524532+0000","last_became_peered":"2024-03-18T00:25:22.524532+0000","last_unstale":"2024-03-18T00:25:24.525414+0000","last_undegraded":"2024-03-18T00:25:24.525414+0000","last_fullsized":"2024-03-18T00:25:24.525414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525427+0000","last_change":"2024-03-18T00:25:23.541815+0000","last_active":"2024-03-18T00:25:24.525427+0000","last_peered":"2024-03-18T00:25:24.525427+0000","last_clean":"2024-03-18T00:25:24.525427+0000","last_became_active":"2024-03-18T00:25:23.541486+0000","last_became_peered":"2024-03-18T00:25:23.541486+0000","last_unstale":"2024-03-18T00:25:24.525427+0000","last_undegraded":"2024-03-18T00:25:24.525427+0000","last_fullsized":"2024-03-18T00:25:24.525427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933609+0000","last_change":"2024-03-18T00:25:22.520313+0000","last_active":"2024-03-18T00:25:24.933609+0000","last_peered":"2024-03-18T00:25:24.933609+0000","last_clean":"2024-03-18T00:25:24.933609+0000","last_became_active":"2024-03-18T00:25:22.520019+0000","last_became_peered":"2024-03-18T00:25:22.520019+0000","last_unstale":"2024-03-18T00:25:24.933609+0000","last_undegraded":"2024-03-18T00:25:24.933609+0000","last_fullsized":"2024-03-18T00:25:24.933609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:31.616 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T00:25:31.616 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T00:25:31.616 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T00:25:31.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T00:25:31.617 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-18T00:25:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.751+0000 7ff66b762640 1 Processor -- start 2024-03-18T00:25:31.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.752+0000 7ff66b762640 1 -- start start 2024-03-18T00:25:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.752+0000 7ff66b762640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6640d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.752+0000 7ff66b762640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6640cd510 con 0x7ff66415c780 2024-03-18T00:25:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.752+0000 7ff66b762640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6640cd7f0 con 0x7ff6640cef80 2024-03-18T00:25:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.752+0000 7ff66b762640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff6640cdad0 con 0x7ff66415c3a0 2024-03-18T00:25:31.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff668cfd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff66415c780 0x7ff6640ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55692/0 (socket says 172.21.15.81:55692) 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff668cfd640 1 -- 172.21.15.81:0/1309095991 learned_addr learned my addr 172.21.15.81:0/1309095991 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff6694fe640 1 --2- 172.21.15.81:0/1309095991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6640d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345025853 0 0) 0x7ff6640cd510 con 0x7ff66415c780 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c003520 con 0x7ff66415c780 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723982374 0 0) 0x7ff6640cd7f0 con 0x7ff6640cef80 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6640cd510 con 0x7ff6640cef80 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff6694fe640 1 -- 172.21.15.81:0/1309095991 >> v1:172.21.15.136:6789/0 conn(0x7ff6640cef80 legacy=0x7ff6640af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff6694fe640 1 -- 172.21.15.81:0/1309095991 >> v1:172.21.15.81:6789/0 conn(0x7ff66415c780 legacy=0x7ff6640ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.753+0000 7ff6694fe640 1 -- 172.21.15.81:0/1309095991 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6640cddb0 con 0x7ff66415c3a0 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff6694fe640 1 --2- 172.21.15.81:0/1309095991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6640d2980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009dc0 tx=0x7ff65c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d27b6accff572ea6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c039070 con 0x7ff66415c3a0 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff65c02ccd0 con 0x7ff66415c3a0 2024-03-18T00:25:31.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff663fff640 1 -- 172.21.15.81:0/1309095991 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff65c034640 con 0x7ff66415c3a0 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 -- 172.21.15.81:0/1309095991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 msgr2=0x7ff6640d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 --2- 172.21.15.81:0/1309095991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6640d2980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff65c009dc0 tx=0x7ff65c02bf20 comp rx=0 tx=0).stop 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 -- 172.21.15.81:0/1309095991 shutdown_connections 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 --2- 172.21.15.81:0/1309095991 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6640d2980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 -- 172.21.15.81:0/1309095991 >> 172.21.15.81:0/1309095991 conn(0x7ff6640d1e60 msgr2=0x7ff6640d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.754+0000 7ff66b762640 1 -- 172.21.15.81:0/1309095991 shutdown_connections 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.755+0000 7ff66b762640 1 -- 172.21.15.81:0/1309095991 wait complete. 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 Processor -- start 2024-03-18T00:25:31.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 -- start start 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 0x7ff664159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6641f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6640cf590 con 0x7ff66415c780 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff6640cf410 con 0x7ff6640cef80 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff66b762640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff6640af710 con 0x7ff66415c3a0 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff669cff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff669cff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59222/0 (socket says 172.21.15.81:59222) 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff6694fe640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 0x7ff664159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff668cfd640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6641f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.756+0000 7ff669cff640 1 -- 172.21.15.81:0/3762655019 learned_addr learned my addr 172.21.15.81:0/3762655019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 -- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 msgr2=0x7ff6641f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6641f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 -- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 msgr2=0x7ff664159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 0x7ff664159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 -- 172.21.15.81:0/3762655019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6641586b0 con 0x7ff66415c780 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff6694fe640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 0x7ff664159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff669cff640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c400 tx=0x7ff65400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff654017070 con 0x7ff66415c780 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6540052d0 con 0x7ff66415c780 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff664158990 con 0x7ff66415c780 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6540037f0 con 0x7ff66415c780 2024-03-18T00:25:31.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.757+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff664158f50 con 0x7ff66415c780 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.758+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff66404f5b0 con 0x7ff66415c780 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.758+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff65401a070 con 0x7ff66415c780 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.759+0000 7ff661ffb640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 0x7ff65006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.759+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff654089d60 con 0x7ff66415c780 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.759+0000 7ff6694fe640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 0x7ff65006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:31.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.759+0000 7ff6694fe640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 0x7ff65006e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:31.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.763+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff654058200 con 0x7ff66415c780 2024-03-18T00:25:31.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.984+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7ff664073190 con 0x7ff66415c780 2024-03-18T00:25:31.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.987+0000 7ff661ffb640 1 -- 172.21.15.81:0/3762655019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172578 (secure 0 0 0) 0x7ff65405c2a0 con 0x7ff66415c780 2024-03-18T00:25:31.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 msgr2=0x7ff65006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 0x7ff65006e090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff65c036000 tx=0x7ff65c030000 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 msgr2=0x7ff6641f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c400 tx=0x7ff65400c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 shutdown_connections 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff65006bbd0 0x7ff65006e090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff66415c780 0x7ff6641f28e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff66415c3a0 0x7ff6641f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 --2- 172.21.15.81:0/3762655019 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff6640cef80 0x7ff664159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.989+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 >> 172.21.15.81:0/3762655019 conn(0x7ff6640d1e60 msgr2=0x7ff6640c7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.990+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 shutdown_connections 2024-03-18T00:25:31.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:31.990+0000 7ff66b762640 1 -- 172.21.15.81:0/3762655019 wait complete. 2024-03-18T00:25:32.000 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3852051639},{"type":"v1","addr":"172.21.15.81:6833","nonce":3852051639}]},"active_addr":"172.21.15.81:6833/3852051639","active_change":"2024-03-18T00:25:03.350904+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":406150478}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1116317731}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":1672873119}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.81:0","nonce":2404978184}]}]} 2024-03-18T00:25:32.004 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T00:25:32.004 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T00:25:32.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:32.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.103+0000 7f3e7cf5b640 1 Processor -- start 2024-03-18T00:25:32.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.103+0000 7f3e7cf5b640 1 -- start start 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7cf5b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3e78154a90 0x7f3e7806cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7cf5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e7815e880 0x7f3e78071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7cf5b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7806e6f0 con 0x7f3e7806d1b0 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7cf5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7806d650 con 0x7f3e7815e880 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7cf5b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7806d930 con 0x7f3e78154a90 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e7815e880 0x7f3e78071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e7815e880 0x7f3e78071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59236/0 (socket says 172.21.15.81:59236) 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e6ffff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3e7806d1b0 0x7f3e7815e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48498/0 (socket says 172.21.15.81:48498) 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 -- 172.21.15.81:0/2537734922 learned_addr learned my addr 172.21.15.81:0/2537734922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e7659c640 1 --2- 172.21.15.81:0/2537734922 >> v2:172.21.15.136:3300/0 conn(0x7f3e78154a90 0x7f3e7806cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 -- 172.21.15.81:0/2537734922 >> v2:172.21.15.136:3300/0 conn(0x7f3e78154a90 msgr2=0x7f3e7806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 --2- 172.21.15.81:0/2537734922 >> v2:172.21.15.136:3300/0 conn(0x7f3e78154a90 0x7f3e7806cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 -- 172.21.15.81:0/2537734922 >> v1:172.21.15.136:6789/0 conn(0x7f3e7806d1b0 legacy=0x7f3e7815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e76d9d640 1 -- 172.21.15.81:0/2537734922 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7806dc10 con 0x7f3e7815e880 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.104+0000 7f3e75d9b640 1 -- 172.21.15.81:0/2537734922 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827313003 0 0) 0x7f3e7806e6f0 con 0x7f3e7806d1b0 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e76d9d640 1 --2- 172.21.15.81:0/2537734922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e78071010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806f240 tx=0x7f3e7002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15d1cc8eaa8f6d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e75d9b640 1 -- 172.21.15.81:0/2537734922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e7002ca80 con 0x7f3e7815e880 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e75d9b640 1 -- 172.21.15.81:0/2537734922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7002cc20 con 0x7f3e7815e880 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e75d9b640 1 -- 172.21.15.81:0/2537734922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e700343f0 con 0x7f3e7815e880 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/2537734922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 msgr2=0x7f3e78071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.105+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/2537734922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e78071010 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3e7806f240 tx=0x7f3e7002bee0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/2537734922 shutdown_connections 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/2537734922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e78071010 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/2537734922 >> v2:172.21.15.136:3300/0 conn(0x7f3e78154a90 0x7f3e7806cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/2537734922 >> 172.21.15.81:0/2537734922 conn(0x7f3e7806b5e0 msgr2=0x7f3e7806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/2537734922 shutdown_connections 2024-03-18T00:25:32.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.106+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/2537734922 wait complete. 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.107+0000 7f3e7cf5b640 1 Processor -- start 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.107+0000 7f3e7cf5b640 1 -- start start 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7806d1b0 0x7f3e781401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e78154a90 0x7f3e781461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e78154e70 con 0x7f3e7815e880 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e7806e1d0 con 0x7f3e78154a90 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e78154ff0 con 0x7f3e7806d1b0 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59250/0 (socket says 172.21.15.81:59250) 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 -- 172.21.15.81:0/1756399237 learned_addr learned my addr 172.21.15.81:0/1756399237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7659c640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7806d1b0 0x7f3e781401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e6ffff640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e78154a90 0x7f3e781461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 -- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7806d1b0 msgr2=0x7f3e781401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7806d1b0 0x7f3e781401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 -- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e78154a90 msgr2=0x7f3e781461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e78154a90 0x7f3e781461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 -- 172.21.15.81:0/1756399237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e78145640 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e76d9d640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009f40 tx=0x7f3e70004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70043020 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e7003e450 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e78145920 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e70009510 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.108+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e78142520 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.109+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e7804f5b0 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.110+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3e70046020 con 0x7f3e7815e880 2024-03-18T00:25:32.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.110+0000 7f3e6effd640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 0x7f3e5806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.110+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3e700ad120 con 0x7f3e7815e880 2024-03-18T00:25:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.110+0000 7f3e7659c640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 0x7f3e5806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.111+0000 7f3e7659c640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 0x7f3e5806e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b40 tx=0x7f3e68009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.115+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3e7004d030 con 0x7f3e7815e880 2024-03-18T00:25:32.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.288+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e781668d0 con 0x7f3e7815e880 2024-03-18T00:25:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.289+0000 7f3e6effd640 1 -- 172.21.15.81:0/1756399237 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f3e7007b530 con 0x7f3e7815e880 2024-03-18T00:25:32.290 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:32.290 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 msgr2=0x7f3e5806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 0x7f3e5806e090 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009b40 tx=0x7f3e68009190 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 msgr2=0x7f3e780acec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009f40 tx=0x7f3e70004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 shutdown_connections 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3e5806bbd0 0x7f3e5806e090 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e7815e880 0x7f3e780acec0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e78154a90 0x7f3e781461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 --2- 172.21.15.81:0/1756399237 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e7806d1b0 0x7f3e781401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 >> 172.21.15.81:0/1756399237 conn(0x7f3e7806b5e0 msgr2=0x7f3e78150730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 shutdown_connections 2024-03-18T00:25:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.291+0000 7f3e7cf5b640 1 -- 172.21.15.81:0/1756399237 wait complete. 2024-03-18T00:25:32.302 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T00:25:32.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:32.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.401+0000 7f77af6b2640 1 Processor -- start 2024-03-18T00:25:32.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.401+0000 7f77af6b2640 1 -- start start 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77af6b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77a80b3ba0 0x7f77a806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77af6b2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f77a80b4f90 0x7f77a80ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77af6b2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a806f1c0 con 0x7f77a806ed40 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77af6b2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f77a806f4a0 con 0x7f77a80b3ba0 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77af6b2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f77a806f780 con 0x7f77a80b4f90 2024-03-18T00:25:32.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77ad44e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f77a80b3ba0 0x7f77a806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77acc4d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f77a806ed40 0x7f77a80ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55700/0 (socket says 172.21.15.81:55700) 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77acc4d640 1 -- 172.21.15.81:0/3744475710 learned_addr learned my addr 172.21.15.81:0/3744475710 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.402+0000 7f77adc4f640 1 --2- 172.21.15.81:0/3744475710 >> v2:172.21.15.136:3300/0 conn(0x7f77a80b4f90 0x7f77a80ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f77ad44e640 1 -- 172.21.15.81:0/3744475710 >> v2:172.21.15.136:3300/0 conn(0x7f77a80b4f90 msgr2=0x7f77a80ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f77ad44e640 1 --2- 172.21.15.81:0/3744475710 >> v2:172.21.15.136:3300/0 conn(0x7f77a80b4f90 0x7f77a80ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f77ad44e640 1 -- 172.21.15.81:0/3744475710 >> v1:172.21.15.81:6789/0 conn(0x7f77a806ed40 legacy=0x7f77a80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f779ffff640 1 -- 172.21.15.81:0/3744475710 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642763849 0 0) 0x7f77a806f1c0 con 0x7f77a806ed40 2024-03-18T00:25:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f77ad44e640 1 -- 172.21.15.81:0/3744475710 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a806fa60 con 0x7f77a80b3ba0 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f77ad44e640 1 --2- 172.21.15.81:0/3744475710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b3ba0 0x7f77a806e800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77a8073620 tx=0x7f77a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e385696b09d5b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f779ffff640 1 -- 172.21.15.81:0/3744475710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4039070 con 0x7f77a80b3ba0 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f779ffff640 1 -- 172.21.15.81:0/3744475710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a402cc80 con 0x7f77a80b3ba0 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.403+0000 7f779ffff640 1 -- 172.21.15.81:0/3744475710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4034660 con 0x7f77a80b3ba0 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 -- 172.21.15.81:0/3744475710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b3ba0 msgr2=0x7f77a806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 --2- 172.21.15.81:0/3744475710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b3ba0 0x7f77a806e800 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f77a8073620 tx=0x7f77a402bed0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 -- 172.21.15.81:0/3744475710 shutdown_connections 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 --2- 172.21.15.81:0/3744475710 >> v2:172.21.15.136:3300/0 conn(0x7f77a80b4f90 0x7f77a80ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 --2- 172.21.15.81:0/3744475710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b3ba0 0x7f77a806e800 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 -- 172.21.15.81:0/3744475710 >> 172.21.15.81:0/3744475710 conn(0x7f77a80d0d30 msgr2=0x7f77a80d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 -- 172.21.15.81:0/3744475710 shutdown_connections 2024-03-18T00:25:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.404+0000 7f77af6b2640 1 -- 172.21.15.81:0/3744475710 wait complete. 2024-03-18T00:25:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.405+0000 7f77af6b2640 1 Processor -- start 2024-03-18T00:25:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.405+0000 7f77af6b2640 1 -- start start 2024-03-18T00:25:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77a806ed40 0x7f77a813b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77a80b3ba0 0x7f77a81e5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80b5540 con 0x7f77a80b4f90 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80b53c0 con 0x7f77a806ed40 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77af6b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f77a8144b00 con 0x7f77a80b3ba0 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59266/0 (socket says 172.21.15.81:59266) 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 -- 172.21.15.81:0/512737353 learned_addr learned my addr 172.21.15.81:0/512737353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77ad44e640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77a806ed40 0x7f77a813b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77acc4d640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77a80b3ba0 0x7f77a81e5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 -- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77a80b3ba0 msgr2=0x7f77a81e5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77a80b3ba0 0x7f77a81e5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 -- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77a806ed40 msgr2=0x7f77a813b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77a806ed40 0x7f77a813b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 -- 172.21.15.81:0/512737353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a81e4390 con 0x7f77a80b4f90 2024-03-18T00:25:32.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.406+0000 7f77adc4f640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77a000e7f0 tx=0x7f77a000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.407+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0017070 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.407+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a000ee40 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.407+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a81e4670 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.407+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a000cb80 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.407+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a81e4c30 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.408+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a804f5b0 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.408+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f77a001a070 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.409+0000 7f779dffb640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 0x7f778c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.409+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f77a008abf0 con 0x7f77a80b4f90 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.409+0000 7f77ad44e640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 0x7f778c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.409+0000 7f77ad44e640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 0x7f778c06e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77a4036000 tx=0x7f77a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.413+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f77a0059090 con 0x7f77a80b4f90 2024-03-18T00:25:32.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.588+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77a80cd4d0 con 0x7f77a80b4f90 2024-03-18T00:25:32.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.589+0000 7f779dffb640 1 -- 172.21.15.81:0/512737353 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f77a005d130 con 0x7f77a80b4f90 2024-03-18T00:25:32.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:32.590 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:32.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 msgr2=0x7f778c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 0x7f778c06e090 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f77a4036000 tx=0x7f77a4030000 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 msgr2=0x7f77a81e6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77a000e7f0 tx=0x7f77a000ebf0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 shutdown_connections 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f778c06bbd0 0x7f778c06e090 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77a80b4f90 0x7f77a81e6380 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f77a80b3ba0 0x7f77a81e5e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 --2- 172.21.15.81:0/512737353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f77a806ed40 0x7f77a813b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 >> 172.21.15.81:0/512737353 conn(0x7f77a80d0d30 msgr2=0x7f77a80d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 shutdown_connections 2024-03-18T00:25:32.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.591+0000 7f77af6b2640 1 -- 172.21.15.81:0/512737353 wait complete. 2024-03-18T00:25:32.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T00:25:32.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T00:25:32.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T00:25:32.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T00:25:32.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-18T00:25:32.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-18T00:25:32.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-18T00:25:32.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-18T00:25:32.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7ff2998f8640 1 Processor -- start 2024-03-18T00:25:32.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7f1ca99b3640 1 Processor -- start 2024-03-18T00:25:32.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fab262f9640 1 Processor -- start 2024-03-18T00:25:32.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fdc45dff640 1 Processor -- start 2024-03-18T00:25:32.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7ff2998f8640 1 -- start start 2024-03-18T00:25:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fe756160640 1 Processor -- start 2024-03-18T00:25:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fdc45dff640 1 -- start start 2024-03-18T00:25:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fe756160640 1 -- start start 2024-03-18T00:25:32.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7f1ca99b3640 1 -- start start 2024-03-18T00:25:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.776+0000 7fab262f9640 1 -- start start 2024-03-18T00:25:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f002bfff640 1 Processor -- start 2024-03-18T00:25:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f002bfff640 1 -- start start 2024-03-18T00:25:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2998f8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 0x7ff2940c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2998f8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff2940d1c50 0x7ff29406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2998f8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2940c5e10 con 0x7ff2940d00f0 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2998f8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff2940d05f0 con 0x7ff2940d1c50 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2998f8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff2940b2340 con 0x7ff2940c54f0 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f1ca99b3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1ca415ea30 0x7f1ca40cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f1ca99b3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 0x7f1ca40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f1ca99b3640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ca40cf700 con 0x7f1ca415ad80 2024-03-18T00:25:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f51bf03f640 1 Processor -- start 2024-03-18T00:25:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f1ca99b3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca40cbf40 con 0x7f1ca40cd7a0 2024-03-18T00:25:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff292ffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 0x7ff2940c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2927fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff2940d00f0 0x7ff2940b3100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55714/0 (socket says 172.21.15.81:55714) 2024-03-18T00:25:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7ff2927fc640 1 -- 172.21.15.81:0/3512931286 learned_addr learned my addr 172.21.15.81:0/3512931286 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.777+0000 7f1ca99b3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1ca40cf9e0 con 0x7f1ca415ea30 2024-03-18T00:25:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca27fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1ca415ea30 0x7f1ca40cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca37fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 0x7f1ca40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe756160640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7480df420 0x7fe748053260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe756160640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe7480392d0 0x7fe7480537a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe756160640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe748006af0 con 0x7fe74804fa90 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe756160640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe7480068a0 con 0x7fe7480392d0 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe756160640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe748006dd0 con 0x7fe7480df420 2024-03-18T00:25:32.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca27fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1ca415ea30 0x7f1ca40cba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37208/0 (socket says 172.21.15.81:37208) 2024-03-18T00:25:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7ff293fff640 1 --2- 172.21.15.81:0/3512931286 >> v2:172.21.15.136:3300/0 conn(0x7ff2940d1c50 0x7ff29406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca27fc640 1 -- 172.21.15.81:0/4121091811 learned_addr learned my addr 172.21.15.81:0/4121091811 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc45dff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdc38038280 0x7fdc380eba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc45dff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc380e7c00 con 0x7fdc380061a0 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc45dff640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc38057f20 con 0x7fdc380e7820 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc45dff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdc380ebf50 con 0x7fdc38038280 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc44dfd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdc380e7820 0x7fdc380eb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48520/0 (socket says 172.21.15.81:48520) 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7ff292ffd640 1 -- 172.21.15.81:0/3512931286 >> v2:172.21.15.136:3300/0 conn(0x7ff2940d1c50 msgr2=0x7ff29406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7ff292ffd640 1 --2- 172.21.15.81:0/3512931286 >> v2:172.21.15.136:3300/0 conn(0x7ff2940d1c50 0x7ff29406b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7ff292ffd640 1 -- 172.21.15.81:0/3512931286 >> v1:172.21.15.81:6789/0 conn(0x7ff2940d00f0 legacy=0x7ff2940b3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7ff292ffd640 1 -- 172.21.15.81:0/3512931286 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2940b2620 con 0x7ff2940c54f0 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe74effd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7480df420 0x7fe748053260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 0x7f002c0cc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f002c0cf450 0x7f002c06d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002bfff640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002c06cb90 con 0x7f002c0cca40 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002bfff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f002c06d4c0 con 0x7f002c14be30 2024-03-18T00:25:32.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002bfff640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f002c06ce70 con 0x7f002c0cf450 2024-03-18T00:25:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc44dfd640 1 -- 172.21.15.81:0/3733189570 learned_addr learned my addr 172.21.15.81:0/3733189570 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe74effd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7480df420 0x7fe748053260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37224/0 (socket says 172.21.15.81:37224) 2024-03-18T00:25:32.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe74effd640 1 -- 172.21.15.81:0/4206841951 learned_addr learned my addr 172.21.15.81:0/4206841951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 0x7f002c0cc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002b7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f002c0cf450 0x7f002c06d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc3f7fe640 1 -- 172.21.15.81:0/3733189570 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3248632493 0 0) 0x7fdc38057f20 con 0x7fdc380e7820 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc3f7fe640 1 -- 172.21.15.81:0/3733189570 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc30003520 con 0x7fdc380e7820 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002b7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f002c0cf450 0x7f002c06d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37238/0 (socket says 172.21.15.81:37238) 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002affd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 0x7f002c0cc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59324/0 (socket says 172.21.15.81:59324) 2024-03-18T00:25:32.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f002b7fe640 1 -- 172.21.15.81:0/1532603914 learned_addr learned my addr 172.21.15.81:0/1532603914 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fab262f9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fab18005e90 0x7fab180062d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fab262f9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fab18006810 0x7fab18006c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fab262f9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab18053720 con 0x7fab180ead00 2024-03-18T00:25:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fab262f9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fab18054330 con 0x7fab18006810 2024-03-18T00:25:32.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fab262f9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fab18053a00 con 0x7fab18005e90 2024-03-18T00:25:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fdc3ffff640 1 --2- 172.21.15.81:0/3733189570 >> v2:172.21.15.81:3300/0 conn(0x7fdc38038280 0x7fdc380eba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab252f7640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fab180ead00 0x7fab1804fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48536/0 (socket says 172.21.15.81:48536) 2024-03-18T00:25:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab252f7640 1 -- 172.21.15.81:0/2229395701 learned_addr learned my addr 172.21.15.81:0/2229395701 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:32.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7fe74ffff640 1 --2- 172.21.15.81:0/4206841951 >> v2:172.21.15.81:3300/0 conn(0x7fe7480392d0 0x7fe7480537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab25af8640 1 --2- 172.21.15.81:0/2229395701 >> v2:172.21.15.81:3300/0 conn(0x7fab18006810 0x7fab18006c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab24af6640 1 --2- 172.21.15.81:0/2229395701 >> v2:172.21.15.136:3300/0 conn(0x7fab18005e90 0x7fab180062d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f002b7fe640 1 -- 172.21.15.81:0/1532603914 >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 msgr2=0x7f002c0cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f002b7fe640 1 --2- 172.21.15.81:0/1532603914 >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 0x7f002c0cc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f002b7fe640 1 -- 172.21.15.81:0/1532603914 >> v1:172.21.15.136:6789/0 conn(0x7f002c0cca40 legacy=0x7f002c0ced40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f002b7fe640 1 -- 172.21.15.81:0/1532603914 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c06d150 con 0x7f002c0cf450 2024-03-18T00:25:32.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f51bf03f640 1 -- start start 2024-03-18T00:25:32.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f51bf03f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51b815b4d0 0x7f51b806f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f51bf03f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b806ea80 con 0x7f51b806e530 2024-03-18T00:25:32.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f51bf03f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b806ed60 con 0x7f51b806fcc0 2024-03-18T00:25:32.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f51bf03f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f51b806f040 con 0x7f51b815b4d0 2024-03-18T00:25:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7ff292ffd640 1 --2- 172.21.15.81:0/3512931286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 0x7ff2940c58d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2880097a0 tx=0x7ff28802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5d8fe127ac0a6c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f6bde1ff640 1 Processor -- start 2024-03-18T00:25:32.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f6bde1ff640 1 -- start start 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f51bd83c640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f51b806fcc0 0x7f51b815b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48558/0 (socket says 172.21.15.81:48558) 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd83c640 1 -- 172.21.15.81:0/1392888077 learned_addr learned my addr 172.21.15.81:0/1392888077 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51be83e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f51b806e530 0x7f51b8164810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55736/0 (socket says 172.21.15.81:55736) 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51be03d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51b815b4d0 0x7f51b806f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7ff291ffb640 1 -- 172.21.15.81:0/3512931286 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288035020 con 0x7ff2940c54f0 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7ff291ffb640 1 -- 172.21.15.81:0/3512931286 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288031810 con 0x7ff2940c54f0 2024-03-18T00:25:32.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7ff291ffb640 1 -- 172.21.15.81:0/3512931286 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288031be0 con 0x7ff2940c54f0 2024-03-18T00:25:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bde1ff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bde1ff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 0x7f6bd80d0510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bde1ff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bd8166980 con 0x7f6bd80b4f00 2024-03-18T00:25:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bde1ff640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6bd8163b10 con 0x7f6bd80d0080 2024-03-18T00:25:32.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bde1ff640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd8166c60 con 0x7f6bd8162640 2024-03-18T00:25:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fdc3ffff640 1 -- 172.21.15.81:0/3733189570 >> v1:172.21.15.136:6789/0 conn(0x7fdc380e7820 legacy=0x7fdc380eb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fe74effd640 1 -- 172.21.15.81:0/4206841951 >> v2:172.21.15.81:3300/0 conn(0x7fe7480392d0 msgr2=0x7fe7480537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 66014534 0 0) 0x7fab18053720 con 0x7fab180ead00 2024-03-18T00:25:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fe74effd640 1 --2- 172.21.15.81:0/4206841951 >> v2:172.21.15.81:3300/0 conn(0x7fe7480392d0 0x7fe7480537a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fe74effd640 1 -- 172.21.15.81:0/4206841951 >> v1:172.21.15.81:6789/0 conn(0x7fe74804fa90 legacy=0x7fe74804fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fe74effd640 1 -- 172.21.15.81:0/4206841951 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7480070b0 con 0x7fe7480df420 2024-03-18T00:25:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796274065 0 0) 0x7f51b806ed60 con 0x7f51b806fcc0 2024-03-18T00:25:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a4003520 con 0x7f51b806fcc0 2024-03-18T00:25:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab0c003520 con 0x7fab180ead00 2024-03-18T00:25:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3876781956 0 0) 0x7fab0c003520 con 0x7fab180ead00 2024-03-18T00:25:32.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 >> v2:172.21.15.136:3300/0 conn(0x7fab18005e90 msgr2=0x7fab180062d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fdc3ffff640 1 -- 172.21.15.81:0/3733189570 >> v1:172.21.15.81:6789/0 conn(0x7fdc380061a0 legacy=0x7fdc38006630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fdc3ffff640 1 -- 172.21.15.81:0/3733189570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc38058200 con 0x7fdc38038280 2024-03-18T00:25:32.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 --2- 172.21.15.81:0/2229395701 >> v2:172.21.15.136:3300/0 conn(0x7fab18005e90 0x7fab180062d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 >> v2:172.21.15.81:3300/0 conn(0x7fab18006810 msgr2=0x7fab18006c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 --2- 172.21.15.81:0/2229395701 >> v2:172.21.15.81:3300/0 conn(0x7fab18006810 0x7fab18006c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18053ce0 con 0x7fab180ead00 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7fab1c001650 con 0x7fab180ead00 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 >> v1:172.21.15.136:6789/0 conn(0x7fab180ead00 legacy=0x7fab1804fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab0c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab0c004800 0x7fab0c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854913115 0 0) 0x7f1ca40cf700 con 0x7f1ca415ad80 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab0c0051c0 0x7fab0c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab18054330 con 0x7fab0c004800 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab18053a00 con 0x7fab0c0039d0 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.778+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c8c003520 con 0x7f1ca415ad80 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f1ca27fc640 1 -- 172.21.15.81:0/4121091811 >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 msgr2=0x7f1ca40cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f1ca27fc640 1 --2- 172.21.15.81:0/4121091811 >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 0x7f1ca40cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f1ca27fc640 1 -- 172.21.15.81:0/4121091811 >> v1:172.21.15.136:6789/0 conn(0x7f1ca415ad80 legacy=0x7f1ca40cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2475903084 0 0) 0x7f1c8c003520 con 0x7f1ca415ad80 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7f1ca27fc640 1 -- 172.21.15.81:0/4121091811 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca40cfcc0 con 0x7f1ca415ea30 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f1ca37fe640 1 --2- 172.21.15.81:0/4121091811 >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 0x7f1ca40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f002b7fe640 1 --2- 172.21.15.81:0/1532603914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c06d950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d01b0 tx=0x7f002402be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0fdf014fb4495c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.779+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fab0c00c170 con 0x7fab0c0051c0 2024-03-18T00:25:32.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7fab252f7640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab0c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 192040409 0 0) 0x7f51a4003520 con 0x7f51b806fcc0 2024-03-18T00:25:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7fe74effd640 1 --2- 172.21.15.81:0/4206841951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7480df420 0x7fe748053260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe748007a60 tx=0x7fe74402df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be8528dbb6693436 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 0x7f6bd80d0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 0x7f6bd80d0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37252/0 (socket says 172.21.15.81:37252) 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47622/0 (socket says 172.21.15.81:47622) 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd7fff640 1 -- 172.21.15.81:0/1347740945 learned_addr learned my addr 172.21.15.81:0/1347740945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 -- 172.21.15.81:0/1347740945 >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 msgr2=0x7f6bd80d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 --2- 172.21.15.81:0/1347740945 >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 0x7f6bd80d0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 -- 172.21.15.81:0/1347740945 >> v1:172.21.15.81:6789/0 conn(0x7f6bd80b4f00 legacy=0x7f6bd8163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f6bd77fe640 1 -- 172.21.15.81:0/1347740945 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd8162c00 con 0x7f6bd8162640 2024-03-18T00:25:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51b815b4d0 msgr2=0x7f51b806f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51b815b4d0 0x7f51b806f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fdc3ffff640 1 --2- 172.21.15.81:0/3733189570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38038280 0x7fdc380eba10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0097a0 tx=0x7fdc2c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179068a0b548fb5d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 >> v1:172.21.15.81:6789/0 conn(0x7f51b806e530 legacy=0x7f51b8164810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80b3cd0 con 0x7f51b806fcc0 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f51b4001670 con 0x7f51b806fcc0 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 >> v1:172.21.15.136:6789/0 conn(0x7f51b806fcc0 legacy=0x7f51b815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 -- 172.21.15.81:0/3512931286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 msgr2=0x7ff2940c58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 --2- 172.21.15.81:0/3512931286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 0x7ff2940c58d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff2880097a0 tx=0x7ff28802b8b0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fe74e7fc640 1 -- 172.21.15.81:0/4206841951 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744034070 con 0x7fe7480df420 2024-03-18T00:25:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fe74e7fc640 1 -- 172.21.15.81:0/4206841951 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74402ed00 con 0x7fe7480df420 2024-03-18T00:25:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fe74e7fc640 1 -- 172.21.15.81:0/4206841951 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe744038600 con 0x7fe7480df420 2024-03-18T00:25:32.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f51bd03b640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab24af6640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab0c004800 0x7fab0c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab252f7640 1 -- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab0c0051c0 msgr2=0x7fab0c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab252f7640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab0c0051c0 0x7fab0c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab252f7640 1 -- 172.21.15.81:0/2229395701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab0c004800 msgr2=0x7fab0c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab252f7640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab0c004800 0x7fab0c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab252f7640 1 -- 172.21.15.81:0/2229395701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18053ce0 con 0x7fab0c0039d0 2024-03-18T00:25:32.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fab25af8640 1 -- 172.21.15.81:0/2229395701 reap_dead start 2024-03-18T00:25:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd03b640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a40051c0 0x7f51a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fdc3f7fe640 1 -- 172.21.15.81:0/3733189570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c035020 con 0x7fdc38038280 2024-03-18T00:25:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fdc3f7fe640 1 -- 172.21.15.81:0/3733189570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c031830 con 0x7fdc38038280 2024-03-18T00:25:32.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7fdc3f7fe640 1 -- 172.21.15.81:0/3733189570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc2c031c00 con 0x7fdc38038280 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51b806f040 con 0x7f51a4004800 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f51a400bfb0 con 0x7f51a40039b0 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f51a400c1b0 con 0x7f51a40051c0 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51be03d640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 -- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a40051c0 msgr2=0x7f51a400b9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a40051c0 0x7f51a400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 -- 172.21.15.81:0/3512931286 shutdown_connections 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 --2- 172.21.15.81:0/3512931286 >> v2:172.21.15.136:3300/0 conn(0x7ff2940d1c50 0x7ff29406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 --2- 172.21.15.81:0/3512931286 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940c54f0 0x7ff2940c58d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7ff2998f8640 1 -- 172.21.15.81:0/3512931286 >> 172.21.15.81:0/3512931286 conn(0x7ff2940b4010 msgr2=0x7ff2940b4420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 -- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51a40039b0 msgr2=0x7f51a4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.780+0000 7f002a7fc640 1 -- 172.21.15.81:0/1532603914 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002402c9f0 con 0x7f002c0cf450 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f002a7fc640 1 -- 172.21.15.81:0/1532603914 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002402cb90 con 0x7f002c0cf450 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f002a7fc640 1 -- 172.21.15.81:0/1532603914 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00240343f0 con 0x7f002c0cf450 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f1ca27fc640 1 --2- 172.21.15.81:0/4121091811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca415ea30 0x7f1ca40cba00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40d0d10 tx=0x7f1c9c02be50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7793264b5d237739 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f002bfff640 1 -- 172.21.15.81:0/1532603914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 msgr2=0x7f002c06d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f002bfff640 1 --2- 172.21.15.81:0/1532603914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c06d950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f002c0d01b0 tx=0x7f002402be50 comp rx=0 tx=0).stop 2024-03-18T00:25:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51a40039b0 0x7f51a4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.781+0000 7f51bd83c640 1 -- 172.21.15.81:0/1392888077 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b80b3cd0 con 0x7f51a4004800 2024-03-18T00:25:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 -- 172.21.15.81:0/1532603914 shutdown_connections 2024-03-18T00:25:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 --2- 172.21.15.81:0/1532603914 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c06d950 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 --2- 172.21.15.81:0/1532603914 >> v2:172.21.15.81:3300/0 conn(0x7f002c14be30 0x7f002c0cc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 -- 172.21.15.81:0/1532603914 >> 172.21.15.81:0/1532603914 conn(0x7f002c06b5e0 msgr2=0x7f002c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fab252f7640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab0c003e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c290 tx=0x7fab0c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e623820eb1f7a22 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c98001650 con 0x7f1ca415ea30 2024-03-18T00:25:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c02c770 con 0x7f1ca415ea30 2024-03-18T00:25:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f1ca1ffb640 1 -- 172.21.15.81:0/4121091811 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c02cb40 con 0x7f1ca415ea30 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f6bd77fe640 1 --2- 172.21.15.81:0/1347740945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009d90 tx=0x7f6bc802bd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c92fb1100f67bd7b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 -- 172.21.15.81:0/4206841951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7480df420 msgr2=0x7fe748053260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 --2- 172.21.15.81:0/4206841951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7480df420 0x7fe748053260 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe748007a60 tx=0x7fe74402df50 comp rx=0 tx=0).stop 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c007cf0 con 0x7fab0c0039d0 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7ff2998f8640 1 -- 172.21.15.81:0/3512931286 shutdown_connections 2024-03-18T00:25:32.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7ff2998f8640 1 -- 172.21.15.81:0/3512931286 wait complete. 2024-03-18T00:25:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f6bd67fc640 1 -- 172.21.15.81:0/1347740945 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8039070 con 0x7f6bd8162640 2024-03-18T00:25:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f6bd67fc640 1 -- 172.21.15.81:0/1347740945 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc802cb40 con 0x7f6bd8162640 2024-03-18T00:25:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f6bd67fc640 1 -- 172.21.15.81:0/1347740945 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8034440 con 0x7f6bd8162640 2024-03-18T00:25:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 -- 172.21.15.81:0/3733189570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38038280 msgr2=0x7fdc380eba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 --2- 172.21.15.81:0/3733189570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38038280 0x7fdc380eba10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0097a0 tx=0x7fdc2c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 -- 172.21.15.81:0/1532603914 shutdown_connections 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 -- 172.21.15.81:0/4206841951 shutdown_connections 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 --2- 172.21.15.81:0/4206841951 >> v2:172.21.15.81:3300/0 conn(0x7fe7480392d0 0x7fe7480537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 --2- 172.21.15.81:0/4206841951 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7480df420 0x7fe748053260 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 -- 172.21.15.81:0/4206841951 >> 172.21.15.81:0/4206841951 conn(0x7fe748009fb0 msgr2=0x7fe74800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 -- 172.21.15.81:0/3733189570 shutdown_connections 2024-03-18T00:25:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 --2- 172.21.15.81:0/3733189570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38038280 0x7fdc380eba10 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0097a0 tx=0x7fdc2c02b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 -- 172.21.15.81:0/3733189570 >> 172.21.15.81:0/3733189570 conn(0x7fdc380559e0 msgr2=0x7fdc38055df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fe756160640 1 -- 172.21.15.81:0/4206841951 shutdown_connections 2024-03-18T00:25:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fdc45dff640 1 -- 172.21.15.81:0/3733189570 shutdown_connections 2024-03-18T00:25:32.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 -- 172.21.15.81:0/4121091811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca415ea30 msgr2=0x7f1ca40cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab1c030030 con 0x7fab0c0039d0 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/4121091811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca415ea30 0x7f1ca40cba00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1ca40d0d10 tx=0x7f1c9c02be50 comp rx=0 tx=0).stop 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 -- 172.21.15.81:0/4121091811 shutdown_connections 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/4121091811 >> v2:172.21.15.81:3300/0 conn(0x7f1ca40cd7a0 0x7f1ca40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/4121091811 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca415ea30 0x7f1ca40cba00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 -- 172.21.15.81:0/4121091811 >> 172.21.15.81:0/4121091811 conn(0x7f1ca40b2a40 msgr2=0x7f1ca40b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f51bd83c640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c260 tx=0x7f51a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ee4b9e5d940cc9a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fdc45dff640 1 -- 172.21.15.81:0/3733189570 wait complete. 2024-03-18T00:25:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 -- 172.21.15.81:0/1347740945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 msgr2=0x7f6bd81660e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 --2- 172.21.15.81:0/1347740945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8009d90 tx=0x7f6bc802bd90 comp rx=0 tx=0).stop 2024-03-18T00:25:32.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7ff2998f8640 1 Processor -- start 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4007cf0 con 0x7f51a4004800 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fe756160640 1 -- 172.21.15.81:0/4206841951 wait complete. 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 -- 172.21.15.81:0/1347740945 shutdown_connections 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 --2- 172.21.15.81:0/1347740945 >> v2:172.21.15.136:3300/0 conn(0x7f6bd80d0080 0x7f6bd80d0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 --2- 172.21.15.81:0/1347740945 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd8162640 0x7f6bd81660e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 -- 172.21.15.81:0/1347740945 >> 172.21.15.81:0/1347740945 conn(0x7f6bd806b1c0 msgr2=0x7f6bd806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f51bd03b640 1 -- 172.21.15.81:0/1392888077 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4005ad0 con 0x7f51a4004800 2024-03-18T00:25:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab17fff640 1 -- 172.21.15.81:0/2229395701 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab1c007cf0 con 0x7fab0c0039d0 2024-03-18T00:25:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab262f9640 1 -- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 msgr2=0x7fab0c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab262f9640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab0c003e10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fab1c00c290 tx=0x7fab0c005830 comp rx=0 tx=0).stop 2024-03-18T00:25:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7ff2998f8640 1 -- start start 2024-03-18T00:25:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f1ca99b3640 1 -- 172.21.15.81:0/4121091811 shutdown_connections 2024-03-18T00:25:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.782+0000 7f002bfff640 1 -- 172.21.15.81:0/1532603914 wait complete. 2024-03-18T00:25:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7f6bde1ff640 1 -- 172.21.15.81:0/1347740945 shutdown_connections 2024-03-18T00:25:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab262f9640 1 -- 172.21.15.81:0/2229395701 shutdown_connections 2024-03-18T00:25:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab262f9640 1 --2- 172.21.15.81:0/2229395701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab0c003e10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.783+0000 7fab262f9640 1 -- 172.21.15.81:0/2229395701 >> 172.21.15.81:0/2229395701 conn(0x7fab18009fb0 msgr2=0x7fab1800a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7fab262f9640 1 -- 172.21.15.81:0/2229395701 shutdown_connections 2024-03-18T00:25:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7fdc45dff640 1 Processor -- start 2024-03-18T00:25:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7fab262f9640 1 -- 172.21.15.81:0/2229395701 wait complete. 2024-03-18T00:25:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7fdc45dff640 1 -- start start 2024-03-18T00:25:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f6bde1ff640 1 -- 172.21.15.81:0/1347740945 wait complete. 2024-03-18T00:25:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f51bf03f640 1 -- 172.21.15.81:0/1392888077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a4004800 msgr2=0x7f51a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f51bf03f640 1 --2- 172.21.15.81:0/1392888077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51a4004800 0x7f51a4004c80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f51b400c260 tx=0x7f51a4005830 comp rx=0 tx=0).stop 2024-03-18T00:25:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f51be83e640 1 -- 172.21.15.81:0/1392888077 reap_dead start 2024-03-18T00:25:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f002bfff640 1 Processor -- start 2024-03-18T00:25:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f002bfff640 1 -- start start 2024-03-18T00:25:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2940c54f0 0x7ff2941fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f51bf03f640 1 -- 172.21.15.81:0/1392888077 shutdown_connections 2024-03-18T00:25:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f51bf03f640 1 -- 172.21.15.81:0/1392888077 >> 172.21.15.81:0/1392888077 conn(0x7f51b806c2d0 msgr2=0x7f51b806c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940d00f0 0x7ff2941fc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 0x7ff29409cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f51bf03f640 1 -- 172.21.15.81:0/1392888077 shutdown_connections 2024-03-18T00:25:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff294162bc0 con 0x7ff2940d1c50 2024-03-18T00:25:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f002bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f002c0cca40 0x7f002c1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff2940b2be0 con 0x7ff2940c54f0 2024-03-18T00:25:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff2998f8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff294162d40 con 0x7ff2940d00f0 2024-03-18T00:25:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f6bde1ff640 1 Processor -- start 2024-03-18T00:25:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f002affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f002c0cca40 0x7f002c1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f002affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f002c0cca40 0x7f002c1420a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59342/0 (socket says 172.21.15.81:59342) 2024-03-18T00:25:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f002affd640 1 -- 172.21.15.81:0/1458755100 learned_addr learned my addr 172.21.15.81:0/1458755100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff293fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 0x7ff29409cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff293fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 0x7ff29409cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59356/0 (socket says 172.21.15.81:59356) 2024-03-18T00:25:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7ff293fff640 1 -- 172.21.15.81:0/1397988658 learned_addr learned my addr 172.21.15.81:0/1397988658 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7fdc45dff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc380061a0 0x7fdc380dc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7fdc45dff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc380e7820 0x7fdc38181b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc45dff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 0x7fdc38051ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 -- 172.21.15.81:0/1397988658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940d00f0 msgr2=0x7ff2941fc4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff2940d00f0 0x7ff2941fc4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 -- 172.21.15.81:0/1397988658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2940c54f0 msgr2=0x7ff2941fbf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T00:25:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff2940c54f0 0x7ff2941fbf90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc45dff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc380ec1a0 con 0x7fdc380061a0 2024-03-18T00:25:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc3ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc380e7820 0x7fdc38181b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 -- 172.21.15.81:0/1397988658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2940b5340 con 0x7ff2940d1c50 2024-03-18T00:25:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc455fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 0x7fdc38051ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc455fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 0x7fdc38051ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47656/0 (socket says 172.21.15.81:47656) 2024-03-18T00:25:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc455fe640 1 -- 172.21.15.81:0/1184588665 learned_addr learned my addr 172.21.15.81:0/1184588665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc380587c0 con 0x7fdc380e7820 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdc38058ce0 con 0x7fdc380ddb00 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c13e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f002c14be30 0x7f002c143e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f002c06e220 con 0x7f002c0cca40 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f002c06e0a0 con 0x7f002c0cf450 2024-03-18T00:25:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f002c06e3a0 con 0x7f002c14be30 2024-03-18T00:25:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fdc44dfd640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc380061a0 0x7fdc380dc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f0023fff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c13e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7ff293fff640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 0x7ff29409cdc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009dd0 tx=0x7ff28c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7fe756160640 1 Processor -- start 2024-03-18T00:25:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7f51bf03f640 1 -- 172.21.15.81:0/1392888077 wait complete. 2024-03-18T00:25:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f6bde1ff640 1 -- start start 2024-03-18T00:25:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f51bf03f640 1 Processor -- start 2024-03-18T00:25:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 -- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f002c14be30 msgr2=0x7f002c143e80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T00:25:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f002c14be30 0x7f002c143e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 -- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f002c0cca40 msgr2=0x7f002c1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.785+0000 7fe756160640 1 -- start start 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7480392d0 0x7fe7480d4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe74804fa90 0x7fe7480495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 0x7fe74817b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe748052cc0 con 0x7fe7480392d0 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe748052b40 con 0x7fe74804fa90 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe756160640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe74800aaa0 con 0x7fe7480df420 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 0x7fe74817b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 0x7fe74817b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47680/0 (socket says 172.21.15.81:47680) 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 -- 172.21.15.81:0/3788364322 learned_addr learned my addr 172.21.15.81:0/3788364322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74effd640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe74804fa90 0x7fe7480495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f002c0cca40 0x7f002c1420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002c2043e0 con 0x7f002c0cf450 2024-03-18T00:25:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fab262f9640 1 Processor -- start 2024-03-18T00:25:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7fab262f9640 1 -- start start 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 -- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe74804fa90 msgr2=0x7fe7480495c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe74804fa90 0x7fe7480495c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 -- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7480392d0 msgr2=0x7fe7480d4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7480392d0 0x7fe7480d4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74804b880 con 0x7fe7480df420 2024-03-18T00:25:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.784+0000 7f1ca99b3640 1 -- 172.21.15.81:0/4121091811 wait complete. 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe74ffff640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 0x7fe74817b920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe7500507b0 tx=0x7fe750068d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fdc455fe640 1 -- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc380e7820 msgr2=0x7fdc38181b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fdc455fe640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc380e7820 0x7fdc38181b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fdc455fe640 1 -- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc380061a0 msgr2=0x7fdc380dc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fdc455fe640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc380061a0 0x7fdc380dc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fdc455fe640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc380ddf90 con 0x7fdc380ddb00 2024-03-18T00:25:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f0023fff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c13e610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f001400c390 tx=0x7f001400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f1ca99b3640 1 Processor -- start 2024-03-18T00:25:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.786+0000 7f1ca99b3640 1 -- start start 2024-03-18T00:25:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fab262f9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab18032cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fab262f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab180466b0 0x7fab1819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c018020 con 0x7ff2940d1c50 2024-03-18T00:25:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28c014480 con 0x7ff2940d1c50 2024-03-18T00:25:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c014850 con 0x7ff2940d1c50 2024-03-18T00:25:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75004fab0 con 0x7fe7480df420 2024-03-18T00:25:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7fab252f7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab18032cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab252f7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab18032cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37294/0 (socket says 172.21.15.81:37294) 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab252f7640 1 -- 172.21.15.81:0/951585044 learned_addr learned my addr 172.21.15.81:0/951585044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab24af6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab180466b0 0x7fab1819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7ff2998f8640 1 -- 172.21.15.81:0/1397988658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2940b5620 con 0x7ff2940d1c50 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7ff2998f8640 1 -- 172.21.15.81:0/1397988658 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2940b5be0 con 0x7ff2940d1c50 2024-03-18T00:25:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab262f9640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab1819f530 0x7fab18044a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca40cd7a0 0x7f1ca414b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 0x7f1ca414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca415ea30 0x7f1ca40af530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca415b160 con 0x7f1ca415ea30 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca406eb20 con 0x7f1ca40cd7a0 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca99b3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1ca406f040 con 0x7f1ca415ad80 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca27fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 0x7f1ca414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca27fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 0x7f1ca414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47696/0 (socket says 172.21.15.81:47696) 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f1ca27fc640 1 -- 172.21.15.81:0/669774700 learned_addr learned my addr 172.21.15.81:0/669774700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd80b4f00 0x7f6bd809d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd80d0080 0x7f6bd80b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bd8162640 0x7f6bd80addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8166f40 con 0x7f6bd80d0080 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6bd8166620 con 0x7f6bd8162640 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bde1ff640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6bd80711f0 con 0x7f6bd80b4f00 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bd8162640 0x7f6bd80addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bd7fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bd8162640 0x7f6bd80addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37304/0 (socket says 172.21.15.81:37304) 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bd7fff640 1 -- 172.21.15.81:0/3062548629 learned_addr learned my addr 172.21.15.81:0/3062548629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bd77fe640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd80b4f00 0x7f6bd809d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fe756160640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7480d55d0 con 0x7fe7480df420 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fe756160640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7480d5b90 con 0x7fe7480df420 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe75006f560 con 0x7fe7480df420 2024-03-18T00:25:32.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe75006f910 con 0x7fe7480df420 2024-03-18T00:25:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fdc455fe640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 0x7fdc38051ba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc4006a750 tx=0x7fdc40068750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014005220 con 0x7f002c0cf450 2024-03-18T00:25:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00140053c0 con 0x7f002c0cf450 2024-03-18T00:25:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0014007270 con 0x7f002c0cf450 2024-03-18T00:25:32.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f002c2046c0 con 0x7f002c0cf450 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f002c204c80 con 0x7f002c0cf450 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.787+0000 7f51bf03f640 1 -- start start 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a4004800 0x7f51b8153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b80a9b10 0x7f51b80a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b80cf230 0x7f51b80cf690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b5380 con 0x7f51b80cf230 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f51b80b5200 con 0x7f51b80a9b10 2024-03-18T00:25:32.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f51bf03f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f51b80b5500 con 0x7f51a4004800 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab18054940 con 0x7fab180466b0 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fab180547c0 con 0x7fab0c0039d0 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab1819f530 0x7fab18044a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fab1804f550 con 0x7fab1819f530 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 -- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 msgr2=0x7fab18032cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fab0c0039d0 0x7fab18032cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 -- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab180466b0 msgr2=0x7fab1819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7f6bd6ffd640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd80d0080 0x7f6bd80b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab180466b0 0x7fab1819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fab25af8640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab18033210 con 0x7fab1819f530 2024-03-18T00:25:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7fab24af6640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab180466b0 0x7fab1819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:32.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7fab25af8640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab1819f530 0x7fab18044a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab1800b3a0 tx=0x7fab1000d820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 -- 172.21.15.81:0/3062548629 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd80b4f00 msgr2=0x7f6bd809d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6bd80b4f00 0x7f6bd809d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 -- 172.21.15.81:0/3062548629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bd8162640 msgr2=0x7f6bd80addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6bd8162640 0x7f6bd80addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bd8161220 con 0x7f6bd80d0080 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f51be83e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b80cf230 0x7f51b80cf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f51be83e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b80cf230 0x7f51b80cf690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59410/0 (socket says 172.21.15.81:59410) 2024-03-18T00:25:32.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f51be83e640 1 -- 172.21.15.81:0/4158364326 learned_addr learned my addr 172.21.15.81:0/4158364326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4004fab0 con 0x7fdc380ddb00 2024-03-18T00:25:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc400735d0 con 0x7fdc380ddb00 2024-03-18T00:25:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.788+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc400737e0 con 0x7fdc380ddb00 2024-03-18T00:25:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc380de200 con 0x7fdc380ddb00 2024-03-18T00:25:32.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f51bd83c640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b80a9b10 0x7f51b80a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f1ca37fe640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca415ea30 0x7f1ca40af530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f1ca2ffd640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca40cd7a0 0x7f1ca414b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f6bd6ffd640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd80d0080 0x7f6bd80b3680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c440 tx=0x7f6bc000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc38181090 con 0x7fdc380ddb00 2024-03-18T00:25:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.789+0000 7f51be03d640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a4004800 0x7f51b8153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f51bd83c640 1 -- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a4004800 msgr2=0x7f51b8153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f51bd83c640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f51a4004800 0x7f51b8153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 -- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca40cd7a0 msgr2=0x7f1ca414b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1ca40cd7a0 0x7f1ca414b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 -- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca415ea30 msgr2=0x7f1ca40af530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f51bd83c640 1 -- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b80cf230 msgr2=0x7f51b80cf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f51bd83c640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51b80cf230 0x7f51b80cf690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f51bd83c640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b8201a20 con 0x7f51b80a9b10 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab100125f0 con 0x7fab1819f530 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab10018070 con 0x7fab1819f530 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab100129d0 con 0x7fab1819f530 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab18046b70 con 0x7fab1819f530 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca415ea30 0x7f1ca40af530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca413d950 con 0x7f1ca415ad80 2024-03-18T00:25:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca37fe640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ca415ea30 0x7f1ca40af530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0017070 con 0x7f6bd80d0080 2024-03-18T00:25:32.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1ca27fc640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 0x7f1ca414ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c036040 tx=0x7f1c9c004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fab18047130 con 0x7fab1819f530 2024-03-18T00:25:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0014019020 con 0x7f002c0cf450 2024-03-18T00:25:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7fdc2affd640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc18001030 con 0x7fdc380ddb00 2024-03-18T00:25:32.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0005230 con 0x7f6bd80d0080 2024-03-18T00:25:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f6bde1ff640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bd8161500 con 0x7f6bd80d0080 2024-03-18T00:25:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f6bde1ff640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bd8161ac0 con 0x7f6bd80d0080 2024-03-18T00:25:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe75006fab0 con 0x7fe7480df420 2024-03-18T00:25:32.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f00237fe640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f000c06bc20 0x7f000c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff28c005d10 con 0x7ff2940d1c50 2024-03-18T00:25:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c043020 con 0x7f1ca415ad80 2024-03-18T00:25:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.790+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c9c007c30 con 0x7f1ca415ad80 2024-03-18T00:25:32.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7fe756160640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe730001030 con 0x7fe7480df420 2024-03-18T00:25:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f51bd83c640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b80a9b10 0x7f51b80a9f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a40057c0 tx=0x7f51b4001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f00140560f0 con 0x7f002c0cf450 2024-03-18T00:25:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7ff27bfff640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff28006bca0 0x7ff28006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff28c08b510 con 0x7ff2940d1c50 2024-03-18T00:25:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7ff2998f8640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7ff2940c8700 0x7ff2940c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7ff2998f8640 1 -- 172.21.15.81:0/1397988658 --> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff2941fbd40 con 0x7ff2940c8700 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7ff2927fc640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7ff2940c8700 0x7ff2940c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c03e450 con 0x7f1ca415ad80 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca413dc30 con 0x7f1ca415ad80 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca413e1f0 con 0x7f1ca415ad80 2024-03-18T00:25:32.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.791+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0017070 con 0x7f6bd80d0080 2024-03-18T00:25:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6bd804f5b0 con 0x7f6bd80d0080 2024-03-18T00:25:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7fe73bfff640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe73406bbd0 0x7fe73406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7f0010001650 0x7f0010003b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0010006bb0 con 0x7f0010001650 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f002affd640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f000c06bc20 0x7f000c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f002b7fe640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7f0010001650 0x7f0010003b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4041020 con 0x7f51b80a9b10 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f51bf03f640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b81fe400 con 0x7f51b80a9b10 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f51bf03f640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b8201fa0 con 0x7f51b80a9b10 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51b4001640 con 0x7f51b80a9b10 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b40074d0 con 0x7f51b80a9b10 2024-03-18T00:25:32.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7ff292ffd640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff28006bca0 0x7ff28006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fab18005390 con 0x7fab1819f530 2024-03-18T00:25:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7ff2927fc640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7ff2940c8700 0x7ff2940c8ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7ff292ffd640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff28006bca0 0x7ff28006e160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff288008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7fe74f7fe640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe73406bbd0 0x7fe73406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe7501069c0 con 0x7fe7480df420 2024-03-18T00:25:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fe73bfff640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fe734073dd0 0x7fe7340761f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7340768a0 con 0x7fe734073dd0 2024-03-18T00:25:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fe7500d0de0 con 0x7fe7480df420 2024-03-18T00:25:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.792+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdc40095020 con 0x7fdc380ddb00 2024-03-18T00:25:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fdc3d7fa640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc2406bcd0 0x7fdc2406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdc40105660 con 0x7fdc380ddb00 2024-03-18T00:25:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fdc3d7fa640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7fdc24073e70 0x7fdc24076290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc24076940 con 0x7fdc24073e70 2024-03-18T00:25:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fe74effd640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fe734073dd0 0x7fe7340761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fdc4010c050 con 0x7fdc380ddb00 2024-03-18T00:25:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== osd.0 v2:172.21.15.81:6800/1556273579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff2941fbd40 con 0x7ff2940c8700 2024-03-18T00:25:32.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1ca404f5b0 con 0x7f1ca415ad80 2024-03-18T00:25:32.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fe74f7fe640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe73406bbd0 0x7fe73406e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe74803a320 tx=0x7fe73c0079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fe74effd640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fe734073dd0 0x7fe7340761f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7f51bf03f640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f51a0001030 con 0x7f51b80a9b10 2024-03-18T00:25:32.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7f002b7fe640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7f0010001650 0x7f0010003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.793+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fab10012b70 con 0x7fab1819f530 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab15ffb640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fab0406bca0 0x7fab0406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab252f7640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fab0406bca0 0x7fab0406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fab1008a6f0 con 0x7fab1819f530 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab15ffb640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7fab04073e40 0x7fab04076260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fab10021ec0 con 0x7fab04073e40 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7fab10091050 con 0x7fab1819f530 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fab24af6640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7fab04073e40 0x7fab04076260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7fab252f7640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fab0406bca0 0x7fab0406e160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab1c031040 tx=0x7fab1c006000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1c9c046020 con 0x7f1ca415ad80 2024-03-18T00:25:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== osd.3 v2:172.21.15.81:6824/2792020926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe7340768a0 con 0x7fe734073dd0 2024-03-18T00:25:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== osd.5 v2:172.21.15.136:6824/4148726140 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0010006bb0 con 0x7f0010001650 2024-03-18T00:25:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f002affd640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f000c06bc20 0x7f000c06e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f001c009b40 tx=0x7f001c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f51b4044020 con 0x7f51b80a9b10 2024-03-18T00:25:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6bc001a070 con 0x7f6bd80d0080 2024-03-18T00:25:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7fab24af6640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7fab04073e40 0x7fab04076260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51aeffd640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f519c06bbd0 0x7f519c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7f1c8bfff640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1c9006bca0 0x7f1c9006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f51b40abcf0 con 0x7f51b80a9b10 2024-03-18T00:25:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1c9c0acf60 con 0x7f1ca415ad80 2024-03-18T00:25:32.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1ca2ffd640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1c9006bca0 0x7f1c9006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51be03d640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f519c06bbd0 0x7f519c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51aeffd640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f519c073d70 0x7f519c076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51be83e640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f519c073d70 0x7f519c076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1c8bfff640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f1c90073ec0 0x7f1c900762e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c9c007c30 con 0x7f1c90073ec0 2024-03-18T00:25:32.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f1c9c0af5c0 con 0x7f1ca415ad80 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f519c076840 con 0x7f519c073d70 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1ca2ffd640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1c9006bca0 0x7f1c9006e160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007990 tx=0x7f1c98009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f1ca37fe640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f1c90073ec0 0x7f1c900762e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f6bcffff640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6bb806bdd0 0x7f6bb806e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6bc0089db0 con 0x7f6bd80d0080 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f6bcffff640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f6bb8073f70 0x7f6bb8076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6bb8076a40 con 0x7f6bb8073f70 2024-03-18T00:25:32.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f6bc008a240 con 0x7f6bd80d0080 2024-03-18T00:25:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.796+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== osd.7 v2:172.21.15.136:6808/3828864915 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fab10021ec0 con 0x7fab04073e40 2024-03-18T00:25:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7f51be03d640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f519c06bbd0 0x7f519c06e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51b80d0210 tx=0x7f51b000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fdc3ffff640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7fdc24073e70 0x7fdc24076290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.794+0000 7fdc44dfd640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc2406bcd0 0x7fdc2406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7fdc44dfd640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc2406bcd0 0x7fdc2406e190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc340011e0 tx=0x7fdc34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.795+0000 7fdc3ffff640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7fdc24073e70 0x7fdc24076290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== osd.4 v2:172.21.15.136:6800/1798639050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc24076940 con 0x7fdc24073e70 2024-03-18T00:25:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7f6bd77fe640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6bb806bdd0 0x7f6bb806e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7f6bd7fff640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f6bb8073f70 0x7f6bb8076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:32.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f51b40b0030 con 0x7f51b80a9b10 2024-03-18T00:25:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.797+0000 7f1ca37fe640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f1c90073ec0 0x7f1c900762e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.798+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== osd.1 v2:172.21.15.81:6801/2697389687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c9c007c30 con 0x7f1c90073ec0 2024-03-18T00:25:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.798+0000 7f6bd77fe640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6bb806bdd0 0x7f6bb806e290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8036000 tx=0x7f6bc8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.799+0000 7f6bd7fff640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f6bb8073f70 0x7f6bb8076390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.799+0000 7f51be83e640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f519c073d70 0x7f519c076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.799+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== osd.2 v2:172.21.15.81:6816/1596798397 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6bb8076a40 con 0x7f6bb8073f70 2024-03-18T00:25:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.800+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== osd.6 v2:172.21.15.136:6814/2186134377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f519c076840 con 0x7f519c073d70 2024-03-18T00:25:32.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.826+0000 7ff2998f8640 1 -- 172.21.15.81:0/1397988658 --> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff2940b5de0 con 0x7ff2940c8700 2024-03-18T00:25:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.827+0000 7ff27bfff640 1 -- 172.21.15.81:0/1397988658 <== osd.0 v2:172.21.15.81:6800/1556273579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff2940b5de0 con 0x7ff2940c8700 2024-03-18T00:25:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.827+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7ff2940c8700 msgr2=0x7ff2940c8ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.827+0000 7ff279ffb640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7ff2940c8700 0x7ff2940c8ae0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.827+0000 7fe756160640 1 -- 172.21.15.81:0/3788364322 --> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe730002dd0 con 0x7fe734073dd0 2024-03-18T00:25:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 --> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0010005c40 con 0x7f0010001650 2024-03-18T00:25:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff28006bca0 msgr2=0x7ff28006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff28006bca0 0x7ff28006e160 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff288008030 comp rx=0 tx=0).stop 2024-03-18T00:25:32.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 msgr2=0x7ff29409cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 --2- 172.21.15.81:0/1397988658 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2940d1c50 0x7ff29409cdc0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009dd0 tx=0x7ff28c00c490 comp rx=0 tx=0).stop 2024-03-18T00:25:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff293fff640 1 -- 172.21.15.81:0/1397988658 reap_dead start 2024-03-18T00:25:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 shutdown_connections 2024-03-18T00:25:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7fe73bfff640 1 -- 172.21.15.81:0/3788364322 <== osd.3 v2:172.21.15.81:6824/2792020926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fe730002dd0 con 0x7fe734073dd0 2024-03-18T00:25:32.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.828+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 >> 172.21.15.81:0/1397988658 conn(0x7ff2940b4010 msgr2=0x7ff2940c7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fdc2affd640 1 -- 172.21.15.81:0/1184588665 --> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc18002dd0 con 0x7fdc24073e70 2024-03-18T00:25:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 shutdown_connections 2024-03-18T00:25:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7ff279ffb640 1 -- 172.21.15.81:0/1397988658 wait complete. 2024-03-18T00:25:32.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 --> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fab180e8870 con 0x7fab04073e40 2024-03-18T00:25:32.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f00237fe640 1 -- 172.21.15.81:0/1458755100 <== osd.5 v2:172.21.15.136:6824/4148726140 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0010005c40 con 0x7f0010001650 2024-03-18T00:25:32.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fe734073dd0 msgr2=0x7fe7340761f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fe734073dd0 0x7fe7340761f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe73406bbd0 msgr2=0x7fe73406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe73406bbd0 0x7fe73406e090 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe74803a320 tx=0x7fe73c0079b0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 msgr2=0x7fe74817b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 --2- 172.21.15.81:0/3788364322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7480df420 0x7fe74817b920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe7500507b0 tx=0x7fe750068d00 comp rx=0 tx=0).stop 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe74ffff640 1 -- 172.21.15.81:0/3788364322 reap_dead start 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 shutdown_connections 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 >> 172.21.15.81:0/3788364322 conn(0x7fe748009fb0 msgr2=0x7fe7480dda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fdc3d7fa640 1 -- 172.21.15.81:0/1184588665 <== osd.4 v2:172.21.15.136:6800/1798639050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc18002dd0 con 0x7fdc24073e70 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fab15ffb640 1 -- 172.21.15.81:0/951585044 <== osd.7 v2:172.21.15.136:6808/3828864915 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fab180e8870 con 0x7fab04073e40 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7f0010001650 msgr2=0x7f0010003b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7f0010001650 0x7f0010003b10 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f000c06bc20 msgr2=0x7f000c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f000c06bc20 0x7f000c06e0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f001c009b40 tx=0x7f001c009190 comp rx=0 tx=0).stop 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 msgr2=0x7f002c13e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 --2- 172.21.15.81:0/1458755100 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f002c0cf450 0x7f002c13e610 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f001400c390 tx=0x7f001400c850 comp rx=0 tx=0).stop 2024-03-18T00:25:32.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002b7fe640 1 -- 172.21.15.81:0/1458755100 reap_dead start 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 shutdown_connections 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 >> 172.21.15.81:0/1458755100 conn(0x7f002c06b5e0 msgr2=0x7f002c072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 shutdown_connections 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7f002bfff640 1 -- 172.21.15.81:0/1458755100 wait complete. 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.829+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 shutdown_connections 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7fab04073e40 msgr2=0x7fab04076260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7fab04073e40 0x7fab04076260 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fe739ffb640 1 -- 172.21.15.81:0/3788364322 wait complete. 2024-03-18T00:25:32.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7fdc24073e70 msgr2=0x7fdc24076290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7fdc24073e70 0x7fdc24076290 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fab0406bca0 msgr2=0x7fab0406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fab0406bca0 0x7fab0406e160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fab1c031040 tx=0x7fab1c006000 comp rx=0 tx=0).stop 2024-03-18T00:25:32.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc2406bcd0 msgr2=0x7fdc2406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc2406bcd0 0x7fdc2406e190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdc340011e0 tx=0x7fdc34009040 comp rx=0 tx=0).stop 2024-03-18T00:25:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab1819f530 msgr2=0x7fab18044a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 --2- 172.21.15.81:0/951585044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fab1819f530 0x7fab18044a00 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fab1800b3a0 tx=0x7fab1000d820 comp rx=0 tx=0).stop 2024-03-18T00:25:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 msgr2=0x7fdc38051ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 --2- 172.21.15.81:0/1184588665 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc380ddb00 0x7fdc38051ba0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fdc4006a750 tx=0x7fdc40068750 comp rx=0 tx=0).stop 2024-03-18T00:25:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab25af8640 1 -- 172.21.15.81:0/951585044 reap_dead start 2024-03-18T00:25:32.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc455fe640 1 -- 172.21.15.81:0/1184588665 reap_dead start 2024-03-18T00:25:32.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 shutdown_connections 2024-03-18T00:25:32.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 >> 172.21.15.81:0/951585044 conn(0x7fab18009fb0 msgr2=0x7fab180491c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 shutdown_connections 2024-03-18T00:25:32.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 >> 172.21.15.81:0/1184588665 conn(0x7fdc380559e0 msgr2=0x7fdc3803aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.830+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 shutdown_connections 2024-03-18T00:25:32.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.831+0000 7fab262f9640 1 -- 172.21.15.81:0/951585044 wait complete. 2024-03-18T00:25:32.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.831+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 --> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1ca406e0d0 con 0x7f1c90073ec0 2024-03-18T00:25:32.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 shutdown_connections 2024-03-18T00:25:32.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7fdc45dff640 1 -- 172.21.15.81:0/1184588665 wait complete. 2024-03-18T00:25:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7f1c8bfff640 1 -- 172.21.15.81:0/669774700 <== osd.1 v2:172.21.15.81:6801/2697389687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1ca406e0d0 con 0x7f1c90073ec0 2024-03-18T00:25:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f1c90073ec0 msgr2=0x7f1c900762e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f1c90073ec0 0x7f1c900762e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.832+0000 7f51bf03f640 1 -- 172.21.15.81:0/4158364326 --> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f51a0002dd0 con 0x7f519c073d70 2024-03-18T00:25:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1c9006bca0 msgr2=0x7f1c9006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1c9006bca0 0x7f1c9006e160 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1c98007990 tx=0x7f1c98009040 comp rx=0 tx=0).stop 2024-03-18T00:25:32.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 msgr2=0x7f1ca414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f1ca99b3640 1 --2- 172.21.15.81:0/669774700 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1ca415ad80 0x7f1ca414ce10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c036040 tx=0x7f1c9c004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 --> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6bd8165cf0 con 0x7f6bb8073f70 2024-03-18T00:25:32.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f51aeffd640 1 -- 172.21.15.81:0/4158364326 <== osd.6 v2:172.21.15.136:6814/2186134377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f51a0002dd0 con 0x7f519c073d70 2024-03-18T00:25:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f1ca37fe640 1 -- 172.21.15.81:0/669774700 reap_dead start 2024-03-18T00:25:32.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.833+0000 7f6bcffff640 1 -- 172.21.15.81:0/3062548629 <== osd.2 v2:172.21.15.81:6816/1596798397 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6bd8165cf0 con 0x7f6bb8073f70 2024-03-18T00:25:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 shutdown_connections 2024-03-18T00:25:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 >> 172.21.15.81:0/669774700 conn(0x7f1ca40b2a40 msgr2=0x7f1ca406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f519c073d70 msgr2=0x7f519c076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f519c073d70 0x7f519c076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f519c06bbd0 msgr2=0x7f519c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f519c06bbd0 0x7f519c06e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f51b80d0210 tx=0x7f51b000b040 comp rx=0 tx=0).stop 2024-03-18T00:25:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b80a9b10 msgr2=0x7f51b80a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 shutdown_connections 2024-03-18T00:25:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 --2- 172.21.15.81:0/4158364326 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f51b80a9b10 0x7f51b80a9f90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a40057c0 tx=0x7f51b4001970 comp rx=0 tx=0).stop 2024-03-18T00:25:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51be83e640 1 -- 172.21.15.81:0/4158364326 reap_dead start 2024-03-18T00:25:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f1ca99b3640 1 -- 172.21.15.81:0/669774700 wait complete. 2024-03-18T00:25:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 shutdown_connections 2024-03-18T00:25:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f6bb8073f70 msgr2=0x7f6bb8076390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 >> 172.21.15.81:0/4158364326 conn(0x7f51b806c2d0 msgr2=0x7f51b8158e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 shutdown_connections 2024-03-18T00:25:32.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f51acff9640 1 -- 172.21.15.81:0/4158364326 wait complete. 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f6bcdffb640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f6bb8073f70 0x7f6bb8076390 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6bb806bdd0 msgr2=0x7f6bb806e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.834+0000 7f6bcdffb640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6bb806bdd0 0x7f6bb806e290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6bc8036000 tx=0x7f6bc8030000 comp rx=0 tx=0).stop 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd80d0080 msgr2=0x7f6bd80b3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 --2- 172.21.15.81:0/3062548629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bd80d0080 0x7f6bd80b3680 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c440 tx=0x7f6bc000c900 comp rx=0 tx=0).stop 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bd7fff640 1 -- 172.21.15.81:0/3062548629 reap_dead start 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 shutdown_connections 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 >> 172.21.15.81:0/3062548629 conn(0x7f6bd806b1c0 msgr2=0x7f6bd80b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 shutdown_connections 2024-03-18T00:25:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:32.835+0000 7f6bcdffb640 1 -- 172.21.15.81:0/3062548629 wait complete. 2024-03-18T00:25:32.907 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T00:25:32.909 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-03-18T00:25:32.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T00:25:32.910 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-18T00:25:32.911 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.912 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-18T00:25:32.912 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-03-18T00:25:32.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-18T00:25:32.913 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-18T00:25:32.914 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T00:25:32.915 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:32.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T00:25:33.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.117+0000 7f9e78b97640 1 Processor -- start 2024-03-18T00:25:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.118+0000 7f18689da640 1 Processor -- start 2024-03-18T00:25:33.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.118+0000 7f18689da640 1 -- start start 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.117+0000 7f9e78b97640 1 -- start start 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e78b97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c051760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e78b97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c0548a0 0x7f9e6c0f1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e78b97640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e6c048510 con 0x7f9e6c008160 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e78b97640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9e6c0487b0 con 0x7f9e6c0548a0 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e78b97640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c048a70 con 0x7f9e6c04fc00 2024-03-18T00:25:33.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f18689da640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f186415a280 0x7f1864071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f18689da640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1864072810 0x7f18640d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f18689da640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1864071900 con 0x7f18640d06f0 2024-03-18T00:25:33.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e72d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c0548a0 0x7f9e6c0f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e72d9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9e6c0548a0 0x7f9e6c0f1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59424/0 (socket says 172.21.15.81:59424) 2024-03-18T00:25:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e71d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9e6c008160 0x7f9e6c04ffe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55752/0 (socket says 172.21.15.81:55752) 2024-03-18T00:25:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9e71d9b640 1 -- 172.21.15.81:0/539743037 learned_addr learned my addr 172.21.15.81:0/539743037 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f9c4ac9d640 1 Processor -- start 2024-03-18T00:25:33.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f8ba8713640 1 Processor -- start 2024-03-18T00:25:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9e7259c640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c051760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f8ba8713640 1 -- start start 2024-03-18T00:25:33.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9e72d9d640 1 -- 172.21.15.81:0/539743037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 msgr2=0x7f9e6c051760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9e72d9d640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c051760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9e72d9d640 1 -- 172.21.15.81:0/539743037 >> v1:172.21.15.81:6789/0 conn(0x7f9e6c008160 legacy=0x7f9e6c04ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9e72d9d640 1 -- 172.21.15.81:0/539743037 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c053090 con 0x7f9e6c0548a0 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f9c4ac9d640 1 -- start start 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4ac9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 0x7f9c3c038270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4ac9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9c3c006190 0x7f9c3c006620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4ac9d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c3c0e7bf0 con 0x7f9c3c0eb2f0 2024-03-18T00:25:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4ac9d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3c057f10 con 0x7f9c3c0e7810 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4ac9d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9c3c0581f0 con 0x7f9c3c006190 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f18689da640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1864072480 con 0x7f1864072810 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f18689da640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1864073240 con 0x7f186415a280 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f1862d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f18640d06f0 0x7f186406cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55756/0 (socket says 172.21.15.81:55756) 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f1862d9d640 1 -- 172.21.15.81:0/3035282701 learned_addr learned my addr 172.21.15.81:0/3035282701 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f186259c640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f186415a280 0x7f1864071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.119+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> v2:172.21.15.81:3300/0 conn(0x7f1864072810 0x7f18640d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2230362322 0 0) 0x7f1864071900 con 0x7f18640d06f0 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.120+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f184c003520 con 0x7f18640d06f0 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3535559740 0 0) 0x7f184c003520 con 0x7f18640d06f0 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f186415a280 msgr2=0x7f1864071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f186415a280 0x7f1864071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 >> v2:172.21.15.81:3300/0 conn(0x7f1864072810 msgr2=0x7f18640d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 --2- 172.21.15.81:0/3035282701 >> v2:172.21.15.81:3300/0 conn(0x7f1864072810 0x7f18640d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1864071be0 con 0x7f18640d06f0 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c49c9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 0x7f9c3c038270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c49c9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 0x7f9c3c038270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59444/0 (socket says 172.21.15.81:59444) 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c49c9b640 1 -- 172.21.15.81:0/3798033246 learned_addr learned my addr 172.21.15.81:0/3798033246 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f9c4a49c640 1 --2- 172.21.15.81:0/3798033246 >> v2:172.21.15.136:3300/0 conn(0x7f9c3c006190 0x7f9c3c006620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> v2:172.21.15.81:3300/0 conn(0x7f1864072810 0x7f18640d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:33.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f185c001250 con 0x7f18640d06f0 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 >> v1:172.21.15.81:6789/0 conn(0x7f18640d06f0 legacy=0x7f186406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c003a20 0x7f184c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f184c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f184c0051c0 0x7f184c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1864072480 con 0x7f184c004800 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f184c00bf30 con 0x7f184c003a20 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f184c00c130 con 0x7f184c0051c0 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f186259c640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f186415a280 0x7f1864071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f1862d9d640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f184c0051c0 0x7f184c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f184c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f186259c640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c003a20 0x7f184c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f3ce7a85640 1 Processor -- start 2024-03-18T00:25:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f3491d1c640 1 Processor -- start 2024-03-18T00:25:33.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba8713640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8ba00b5670 0x7f8ba00d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba8713640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ba00d1530 0x7f8ba00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba8713640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ba00c78a0 con 0x7f8ba00d09a0 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba8713640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba00cf660 con 0x7f8ba00d1530 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba8713640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8ba00d01e0 con 0x7f8ba00b5670 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba64af640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8ba00b5670 0x7f8ba00d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba64af640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8ba00b5670 0x7f8ba00d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37334/0 (socket says 172.21.15.81:37334) 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f8ba64af640 1 -- 172.21.15.81:0/1509347651 learned_addr learned my addr 172.21.15.81:0/1509347651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f8ba64af640 1 -- 172.21.15.81:0/1509347651 >> v2:172.21.15.81:3300/0 conn(0x7f8ba00d1530 msgr2=0x7f8ba00c7e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f8ba64af640 1 --2- 172.21.15.81:0/1509347651 >> v2:172.21.15.81:3300/0 conn(0x7f8ba00d1530 0x7f8ba00c7e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f8ba64af640 1 -- 172.21.15.81:0/1509347651 >> v1:172.21.15.136:6789/0 conn(0x7f8ba00d09a0 legacy=0x7f8ba00d0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f8ba64af640 1 -- 172.21.15.81:0/1509347651 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba00cf8b0 con 0x7f8ba00b5670 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7f3ce7a85640 1 -- start start 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f9e72d9d640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0f1160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097a0 tx=0x7f9e6802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd020470aadef153 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f9c4a49c640 1 -- 172.21.15.81:0/3798033246 >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 msgr2=0x7f9c3c038270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f9c4a49c640 1 --2- 172.21.15.81:0/3798033246 >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 0x7f9c3c038270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f9c4a49c640 1 -- 172.21.15.81:0/3798033246 >> v1:172.21.15.81:6789/0 conn(0x7f9c3c0eb2f0 legacy=0x7f9c3c0eb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f9c4a49c640 1 -- 172.21.15.81:0/3798033246 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c0584d0 con 0x7f9c3c006190 2024-03-18T00:25:33.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7fe905e4b640 1 Processor -- start 2024-03-18T00:25:33.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.121+0000 7fe905e4b640 1 -- start start 2024-03-18T00:25:33.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce7a85640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3cd80543b0 0x7f3cd80e7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce7a85640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd8058800 con 0x7f3cd80e3150 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce7a85640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cd8058ae0 con 0x7f3cd803c090 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce7a85640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3cd8007b60 con 0x7f3cd80543b0 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7fe905e4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8f8009180 0x7fe8f8052ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7fe905e4b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8f8048c30 0x7fe8f8049060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7fe8ff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8f8009180 0x7fe8f8052ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7fe8ff7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe8f8009180 0x7fe8f8052ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59458/0 (socket says 172.21.15.81:59458) 2024-03-18T00:25:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/1285545873 learned_addr learned my addr 172.21.15.81:0/1285545873 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe8feffd640 1 --2- 172.21.15.81:0/1285545873 >> v2:172.21.15.136:3300/0 conn(0x7fe8f8048c30 0x7fe8f8049060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f3491d1c640 1 -- start start 2024-03-18T00:25:33.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3491d1c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f348c0cc830 0x7f348c072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3491d1c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3491d1c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f348c0cf730 con 0x7f348c0ccc10 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3491d1c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f348c0cfcf0 con 0x7f348c0cc830 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3491d1c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f348c0cfa10 con 0x7f348c0b2f40 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce5821640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3cd80e3150 0x7f3cd8058040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55792/0 (socket says 172.21.15.81:55792) 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f1861d9b640 1 -- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f184c0051c0 msgr2=0x7f184c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f184c0051c0 0x7f184c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f8ba64af640 1 --2- 172.21.15.81:0/1509347651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba00d4b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ba008c170 tx=0x7f8b9c02b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e800b2136b56b10 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f1861d9b640 1 -- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c003a20 msgr2=0x7f184c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f184c003a20 0x7f184c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.122+0000 7f1861d9b640 1 -- 172.21.15.81:0/3035282701 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f184c003520 con 0x7f184c004800 2024-03-18T00:25:33.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8f8009560 con 0x7fe8f80eb290 2024-03-18T00:25:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f80495a0 con 0x7fe8f8009180 2024-03-18T00:25:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe8f8035960 con 0x7fe8f8048c30 2024-03-18T00:25:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f3ce5821640 1 -- 172.21.15.81:0/2376059146 learned_addr learned my addr 172.21.15.81:0/2376059146 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f9e7159a640 1 -- 172.21.15.81:0/539743037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e680315a0 con 0x7f9e6c0548a0 2024-03-18T00:25:33.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f9c4a49c640 1 --2- 172.21.15.81:0/3798033246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c006620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c03bf50 tx=0x7f9c3802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa043fee71f55908 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f9e7159a640 1 -- 172.21.15.81:0/539743037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e68037070 con 0x7f9e6c0548a0 2024-03-18T00:25:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f9e7159a640 1 -- 172.21.15.81:0/539743037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e68031960 con 0x7f9e6c0548a0 2024-03-18T00:25:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f348bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f348bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47770/0 (socket says 172.21.15.81:47770) 2024-03-18T00:25:33.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f348bfff640 1 -- 172.21.15.81:0/3094709135 learned_addr learned my addr 172.21.15.81:0/3094709135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f1861d9b640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f184c004c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f185400dfc0 tx=0x7f184c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d61fcc982ae7e20 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f9c48c99640 1 -- 172.21.15.81:0/3798033246 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38035020 con 0x7f9c3c006190 2024-03-18T00:25:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f9c48c99640 1 -- 172.21.15.81:0/3798033246 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38031830 con 0x7f9c3c006190 2024-03-18T00:25:33.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f9c48c99640 1 -- 172.21.15.81:0/3798033246 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38031c00 con 0x7f9c3c006190 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7f8ba54ad640 1 -- 172.21.15.81:0/1509347651 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c02f810 con 0x7f8ba00b5670 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f8ba54ad640 1 -- 172.21.15.81:0/1509347651 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c02f9b0 con 0x7f8ba00b5670 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f8ba54ad640 1 -- 172.21.15.81:0/1509347651 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c02fd80 con 0x7f8ba00b5670 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.123+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/1285545873 >> v2:172.21.15.136:3300/0 conn(0x7fe8f8048c30 msgr2=0x7fe8f8049060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/1285545873 >> v2:172.21.15.136:3300/0 conn(0x7fe8f8048c30 0x7fe8f8049060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/1285545873 >> v1:172.21.15.81:6789/0 conn(0x7fe8f80eb290 legacy=0x7fe8f80eb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/1285545873 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f8035c20 con 0x7fe8f8009180 2024-03-18T00:25:33.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7fe8fe7fc640 1 -- 172.21.15.81:0/1285545873 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323912105 0 0) 0x7fe8f8009560 con 0x7fe8f80eb290 2024-03-18T00:25:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410864276 0 0) 0x7f3cd8058800 con 0x7f3cd80e3150 2024-03-18T00:25:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ccc003520 con 0x7f3cd80e3150 2024-03-18T00:25:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f8ba8713640 1 -- 172.21.15.81:0/1509347651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 msgr2=0x7f8ba00d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3215884587 0 0) 0x7f3ccc003520 con 0x7f3cd80e3150 2024-03-18T00:25:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 >> v2:172.21.15.81:3300/0 conn(0x7f3cd80543b0 msgr2=0x7f3cd80e7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f8ba8713640 1 --2- 172.21.15.81:0/1509347651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba00d4b80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ba008c170 tx=0x7f8b9c02b9f0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185400dc10 con 0x7f184c004800 2024-03-18T00:25:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1854030a40 con 0x7f184c004800 2024-03-18T00:25:33.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f9e78b97640 1 -- 172.21.15.81:0/539743037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0548a0 msgr2=0x7f9e6c0f1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f9e78b97640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0f1160 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9e680097a0 tx=0x7f9e6802b840 comp rx=0 tx=0).stop 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f186159a640 1 -- 172.21.15.81:0/3035282701 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185400d2d0 con 0x7f184c004800 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 -- 172.21.15.81:0/1509347651 shutdown_connections 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 --2- 172.21.15.81:0/1509347651 >> v2:172.21.15.81:3300/0 conn(0x7f8ba00d1530 0x7f8ba00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 --2- 172.21.15.81:0/1509347651 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba00d4b80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 -- 172.21.15.81:0/1509347651 >> 172.21.15.81:0/1509347651 conn(0x7f8ba00d4060 msgr2=0x7f8ba00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f348bfff640 1 -- 172.21.15.81:0/3094709135 >> v2:172.21.15.81:3300/0 conn(0x7f348c0cc830 msgr2=0x7f348c072c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f348bfff640 1 --2- 172.21.15.81:0/3094709135 >> v2:172.21.15.81:3300/0 conn(0x7f348c0cc830 0x7f348c072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f348bfff640 1 -- 172.21.15.81:0/3094709135 >> v1:172.21.15.136:6789/0 conn(0x7f348c0ccc10 legacy=0x7f348c166050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.124+0000 7f348bfff640 1 -- 172.21.15.81:0/3094709135 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c071190 con 0x7f348c0b2f40 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce6022640 1 --2- 172.21.15.81:0/2376059146 >> v2:172.21.15.81:3300/0 conn(0x7f3cd80543b0 0x7f3cd80e7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 --2- 172.21.15.81:0/2376059146 >> v2:172.21.15.81:3300/0 conn(0x7f3cd80543b0 0x7f3cd80e7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 >> v1:172.21.15.136:6789/0 conn(0x7f3cd803c090 legacy=0x7f3cd8053ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/3798033246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 msgr2=0x7f9c3c006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8006350 con 0x7f3cd80e3150 2024-03-18T00:25:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 -- 172.21.15.81:0/539743037 shutdown_connections 2024-03-18T00:25:33.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0f1160 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 --2- 172.21.15.81:0/539743037 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c051760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 -- 172.21.15.81:0/539743037 >> 172.21.15.81:0/539743037 conn(0x7f9e6c055340 msgr2=0x7f9e6c055750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 --2- 172.21.15.81:0/3798033246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c006620 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c03bf50 tx=0x7f9c3802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce6022640 1 --2- 172.21.15.81:0/2376059146 >> v2:172.21.15.81:3300/0 conn(0x7f3cd80543b0 0x7f3cd80e7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:33.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 -- 172.21.15.81:0/539743037 shutdown_connections 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f3cdc001670 con 0x7f3cd80e3150 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/3798033246 shutdown_connections 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 --2- 172.21.15.81:0/3798033246 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c006620 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 --2- 172.21.15.81:0/3798033246 >> v2:172.21.15.81:3300/0 conn(0x7f9c3c0e7810 0x7f9c3c038270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/3798033246 >> 172.21.15.81:0/3798033246 conn(0x7f9c3c0559d0 msgr2=0x7f9c3c055de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f348bfff640 1 --2- 172.21.15.81:0/3094709135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3480009870 tx=0x7f348002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9da1a73dc9517f28 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 -- 172.21.15.81:0/1509347651 shutdown_connections 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/3798033246 shutdown_connections 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/3798033246 wait complete. 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 -- 172.21.15.81:0/3035282701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 msgr2=0x7f184c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 --2- 172.21.15.81:0/3035282701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f184c004c80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f185400dfc0 tx=0x7f184c005830 comp rx=0 tx=0).stop 2024-03-18T00:25:33.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f1862d9d640 1 -- 172.21.15.81:0/3035282701 reap_dead start 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 -- 172.21.15.81:0/3035282701 shutdown_connections 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 -- 172.21.15.81:0/3035282701 >> 172.21.15.81:0/3035282701 conn(0x7f186406b5e0 msgr2=0x7f186406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 -- 172.21.15.81:0/3035282701 shutdown_connections 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f18689da640 1 -- 172.21.15.81:0/3035282701 wait complete. 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 >> v1:172.21.15.81:6789/0 conn(0x7f3cd80e3150 legacy=0x7f3cd8058040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc0039b0 0x7f3ccc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3ccc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ccc0052e0 0x7f3ccc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc00c1b0 con 0x7f3ccc0039b0 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3ccc00c360 con 0x7f3ccc004800 2024-03-18T00:25:33.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3ccc00c560 con 0x7f3ccc0052e0 2024-03-18T00:25:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/1285545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8052ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe90006a750 tx=0x7fe900068fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6012290d90437131 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f348b7fe640 1 -- 172.21.15.81:0/3094709135 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3480035020 con 0x7f348c0b2f40 2024-03-18T00:25:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f348b7fe640 1 -- 172.21.15.81:0/3094709135 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3480031640 con 0x7f348c0b2f40 2024-03-18T00:25:33.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f348b7fe640 1 -- 172.21.15.81:0/3094709135 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f348002d040 con 0x7f348c0b2f40 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f9e78b97640 1 -- 172.21.15.81:0/539743037 wait complete. 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3ccc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce6022640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ccc0052e0 0x7f3ccc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5821640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc0039b0 0x7f3ccc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5020640 1 -- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ccc0052e0 msgr2=0x7f3ccc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3ccc0052e0 0x7f3ccc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5020640 1 -- 172.21.15.81:0/2376059146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc0039b0 msgr2=0x7f3ccc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ccc0039b0 0x7f3ccc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce5020640 1 -- 172.21.15.81:0/2376059146 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ccc003520 con 0x7f3ccc004800 2024-03-18T00:25:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7f3ce6022640 1 -- 172.21.15.81:0/2376059146 reap_dead start 2024-03-18T00:25:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.125+0000 7f8ba8713640 1 -- 172.21.15.81:0/1509347651 wait complete. 2024-03-18T00:25:33.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7fe8fe7fc640 1 -- 172.21.15.81:0/1285545873 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000b3070 con 0x7fe8f8009180 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7fe8fe7fc640 1 -- 172.21.15.81:0/1285545873 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9000ac5d0 con 0x7fe8f8009180 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.126+0000 7fe8fe7fc640 1 -- 172.21.15.81:0/1285545873 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000aca40 con 0x7fe8f8009180 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 -- 172.21.15.81:0/3094709135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 msgr2=0x7f348c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 --2- 172.21.15.81:0/3094709135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3480009870 tx=0x7f348002b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f8ba8713640 1 Processor -- start 2024-03-18T00:25:33.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f8ba8713640 1 -- start start 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f9c4ac9d640 1 Processor -- start 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 -- 172.21.15.81:0/3094709135 shutdown_connections 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 --2- 172.21.15.81:0/3094709135 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c06ee70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 --2- 172.21.15.81:0/3094709135 >> v2:172.21.15.81:3300/0 conn(0x7f348c0cc830 0x7f348c072c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3491d1c640 1 -- 172.21.15.81:0/3094709135 >> 172.21.15.81:0/3094709135 conn(0x7f348c0b1c40 msgr2=0x7f348c0b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f9c4ac9d640 1 -- start start 2024-03-18T00:25:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3ccc004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce004fa60 tx=0x7f3ccc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=207501404176c117 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f9e78b97640 1 Processor -- start 2024-03-18T00:25:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f9e78b97640 1 -- start start 2024-03-18T00:25:33.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00b3070 con 0x7f3ccc004800 2024-03-18T00:25:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.127+0000 7f18689da640 1 Processor -- start 2024-03-18T00:25:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f3ce481f640 1 -- 172.21.15.81:0/2376059146 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ae400 con 0x7f3ccc004800 2024-03-18T00:25:33.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f3491d1c640 1 -- 172.21.15.81:0/3094709135 shutdown_connections 2024-03-18T00:25:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f18689da640 1 -- start start 2024-03-18T00:25:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 msgr2=0x7fe8f8052ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7fe905e4b640 1 --2- 172.21.15.81:0/1285545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8052ef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fe90006a750 tx=0x7fe900068fa0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba015b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ba00d09a0 0x7f8ba00b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 0x7f8ba00b9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00c83d0 con 0x7f8ba00d1530 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ba00cfe70 con 0x7f8ba00b5670 2024-03-18T00:25:33.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba8713640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8ba00c8550 con 0x7f8ba00d09a0 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba6cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 0x7f8ba00b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba6cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 0x7f8ba00b9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59502/0 (socket says 172.21.15.81:59502) 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba6cb0640 1 -- 172.21.15.81:0/3970556199 learned_addr learned my addr 172.21.15.81:0/3970556199 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba64af640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba015b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f8ba5cae640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ba00d09a0 0x7f8ba00b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 0x7f9c3c04ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 0x7f9c3c0db430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0ebe80 con 0x7f9c3c0e7810 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9c3c0ec190 con 0x7f9c3c006190 2024-03-18T00:25:33.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c4ac9d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9c3c058cd0 con 0x7f9c3c0eb2f0 2024-03-18T00:25:33.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c49c9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 msgr2=0x7f3ccc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3ccc004c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3ce004fa60 tx=0x7f3ccc005830 comp rx=0 tx=0).stop 2024-03-18T00:25:33.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2376059146 shutdown_connections 2024-03-18T00:25:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2376059146 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3ccc004c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 0x7f9e6c0e7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c4a49c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 0x7f9c3c0db430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c4a49c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 0x7f9c3c0db430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47800/0 (socket says 172.21.15.81:47800) 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c4a49c640 1 -- 172.21.15.81:0/610877349 learned_addr learned my addr 172.21.15.81:0/610877349 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c4949a640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 0x7f9c3c04ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c0e7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 shutdown_connections 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 --2- 172.21.15.81:0/1285545873 >> v2:172.21.15.136:3300/0 conn(0x7fe8f8048c30 0x7fe8f8049060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 --2- 172.21.15.81:0/1285545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8052ef0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 >> 172.21.15.81:0/1285545873 conn(0x7fe8f801ef30 msgr2=0x7fe8f8055c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2376059146 >> 172.21.15.81:0/2376059146 conn(0x7f3cd8058ed0 msgr2=0x7f3cd80592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 shutdown_connections 2024-03-18T00:25:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f9c49c9b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37390/0 (socket says 172.21.15.81:37390) 2024-03-18T00:25:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 -- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ba00d09a0 msgr2=0x7f8ba00b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ba00d09a0 0x7f8ba00b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 -- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 msgr2=0x7f8ba00b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 0x7f8ba00b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 -- 172.21.15.81:0/3970556199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ba0164360 con 0x7f8ba00b5670 2024-03-18T00:25:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0f16a0 con 0x7f9e6c008160 2024-03-18T00:25:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9e6c0506f0 con 0x7f9e6c0548a0 2024-03-18T00:25:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e72d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8ba64af640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba015b340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c033000 tx=0x7f8b9c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f7c65590640 1 Processor -- start 2024-03-18T00:25:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f7c65590640 1 -- start start 2024-03-18T00:25:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2376059146 shutdown_connections 2024-03-18T00:25:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e72d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0e83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37398/0 (socket says 172.21.15.81:37398) 2024-03-18T00:25:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f18689da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e72d9d640 1 -- 172.21.15.81:0/2018718607 learned_addr learned my addr 172.21.15.81:0/2018718607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f18689da640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18641e3e90 0x7f18641567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9e6c0f1820 con 0x7f9e6c04fc00 2024-03-18T00:25:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.128+0000 7f3491d1c640 1 -- 172.21.15.81:0/3094709135 wait complete. 2024-03-18T00:25:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3491d1c640 1 Processor -- start 2024-03-18T00:25:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f7c65590640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 0x7f9e6c0e7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c02fe60 con 0x7f8ba00b5670 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ba00cd650 con 0x7f8ba00b5670 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b9c0379c0 con 0x7f8ba00b5670 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b9c037d70 con 0x7f8ba00b5670 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c49c9b640 1 -- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 msgr2=0x7f9c3c0db430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c49c9b640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 0x7f9c3c0db430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c49c9b640 1 -- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 msgr2=0x7f9c3c04ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c49c9b640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 0x7f9c3c04ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c49c9b640 1 -- 172.21.15.81:0/610877349 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c3c04f220 con 0x7f9c3c006190 2024-03-18T00:25:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f9c4949a640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 0x7f9c3c04ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f186259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f186259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59518/0 (socket says 172.21.15.81:59518) 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f186259c640 1 -- 172.21.15.81:0/4241923889 learned_addr learned my addr 172.21.15.81:0/4241923889 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 0x7f18640cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18640721a0 con 0x7f184c004800 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f186415a660 con 0x7f18640ccbe0 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f186406efe0 con 0x7f18641e3e90 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 0x7f18640cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1861d9b640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18641e3e90 0x7f18641567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2376059146 wait complete. 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c5e7fc640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f7c600acfb0 0x7f7c60071420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48600/0 (socket says 172.21.15.81:48600) 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c5effd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47802/0 (socket says 172.21.15.81:47802) 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c5e7fc640 1 -- 172.21.15.81:0/2984978571 learned_addr learned my addr 172.21.15.81:0/2984978571 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c6006ea30 con 0x7f7c60071b30 2024-03-18T00:25:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c600b39c0 con 0x7f7c600acfb0 2024-03-18T00:25:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600b3770 con 0x7f7c60069050 2024-03-18T00:25:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.129+0000 7fe905e4b640 1 -- 172.21.15.81:0/1285545873 wait complete. 2024-03-18T00:25:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 -- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 msgr2=0x7f9e6c0e7e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T00:25:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c0e7e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 -- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 msgr2=0x7f9e6c0e83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 -- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18641e3e90 msgr2=0x7f18641567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18641e3e90 0x7f18641567d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 -- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 msgr2=0x7f186409bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f1862d9d640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18641e1720 con 0x7f18640ccbe0 2024-03-18T00:25:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0e83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9e7259c640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e6c04c660 con 0x7f9e6c008160 2024-03-18T00:25:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f186259c640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ba00cdc10 con 0x7f8ba00b5670 2024-03-18T00:25:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9e7259c640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 0x7f9e6c0e7920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e7402d740 tx=0x7f9e74068750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f1862d9d640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 0x7f18640cd060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18640b2f70 tx=0x7f185c005ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c020580 con 0x7f18640ccbe0 2024-03-18T00:25:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f185c020720 con 0x7f18640ccbe0 2024-03-18T00:25:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185c020ad0 con 0x7f18640ccbe0 2024-03-18T00:25:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18640cf0a0 con 0x7f18640ccbe0 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74091070 con 0x7f9e6c008160 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f3491d1c640 1 -- start start 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f3491d1c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f3491d1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 0x7f348c163400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f3491d1c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ccc10 0x7f348c151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e7404fab0 con 0x7f9e6c008160 2024-03-18T00:25:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18641e1ca0 con 0x7f18640ccbe0 2024-03-18T00:25:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f3ce7a85640 1 Processor -- start 2024-03-18T00:25:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f3ce7a85640 1 -- start start 2024-03-18T00:25:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3490d1a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3490d1a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47830/0 (socket says 172.21.15.81:47830) 2024-03-18T00:25:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f7c5effd640 1 -- 172.21.15.81:0/2984978571 >> v1:172.21.15.136:6789/0 conn(0x7f7c600acfb0 legacy=0x7f7c60071420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8b9c049020 con 0x7f8ba00b5670 2024-03-18T00:25:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f348bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 0x7f348c163400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f348bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 0x7f348c163400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59530/0 (socket says 172.21.15.81:59530) 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f7c5effd640 1 -- 172.21.15.81:0/2984978571 >> v1:172.21.15.81:6789/0 conn(0x7f7c60071b30 legacy=0x7f7c6006dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3491d1c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f348c162740 con 0x7f348c0cc830 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3491d1c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f348c0cd0a0 con 0x7f348c0ccc10 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3491d1c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f348c1628c0 con 0x7f348c0b2f40 2024-03-18T00:25:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3490d1a640 1 -- 172.21.15.81:0/4261302733 learned_addr learned my addr 172.21.15.81:0/4261302733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f349151b640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ccc10 0x7f348c151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f7c5effd640 1 -- 172.21.15.81:0/2984978571 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c600b3ca0 con 0x7f7c60069050 2024-03-18T00:25:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f7c5effd640 1 --2- 172.21.15.81:0/2984978571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c500097d0 tx=0x7f7c5002b5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=939cacba57afc05e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7fe905e4b640 1 Processor -- start 2024-03-18T00:25:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7fe905e4b640 1 -- start start 2024-03-18T00:25:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3ce7a85640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8050ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f8b96ffd640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 0x7f8b8406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3ce7a85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 0x7f3cd80e55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 0x7fe8f8007f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f80eb290 0x7fe8f8182510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7f3ce5821640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce5821640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37420/0 (socket says 172.21.15.81:37420) 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80364c0 con 0x7fe8f8009180 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9c49c9b640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406a750 tx=0x7f9c44068d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.130+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44091070 con 0x7f9c3c006190 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce5821640 1 -- 172.21.15.81:0/2124529172 learned_addr learned my addr 172.21.15.81:0/2124529172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/610877349 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c3c0d8de0 con 0x7f9c3c006190 2024-03-18T00:25:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/610877349 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c3c0d7d40 con 0x7f9c3c006190 2024-03-18T00:25:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4404fab0 con 0x7f9c3c006190 2024-03-18T00:25:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.131+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c44071750 con 0x7f9c3c006190 2024-03-18T00:25:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd8188600 0x7f3cd8188a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8f80361e0 con 0x7fe8f80eb290 2024-03-18T00:25:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80e7770 con 0x7f3cd80e5140 2024-03-18T00:25:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e74071750 con 0x7f9e6c008160 2024-03-18T00:25:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3cd80e3530 con 0x7f3ccc004800 2024-03-18T00:25:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.132+0000 7fe905e4b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe8f80367a0 con 0x7fe8f8048c30 2024-03-18T00:25:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 -- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ccc10 msgr2=0x7f348c151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ccc10 0x7f348c151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 -- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 msgr2=0x7f348c163400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 0x7f348c163400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 -- 172.21.15.81:0/4261302733 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f348c14f7b0 con 0x7f348c0b2f40 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 0x7fe8f8007f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7fe8feffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 0x7fe8f8007f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47838/0 (socket says 172.21.15.81:47838) 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7fe8feffd640 1 -- 172.21.15.81:0/2262265839 learned_addr learned my addr 172.21.15.81:0/2262265839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7fe8fffff640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f80eb290 0x7fe8f8182510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3490d1a640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f348400ba80 tx=0x7f348400bf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8050ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484019070 con 0x7f348c0b2f40 2024-03-18T00:25:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f348c163d30 con 0x7f348c0b2f40 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f348c1642f0 con 0x7f348c0b2f40 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f7c5dffb640 1 -- 172.21.15.81:0/2984978571 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50037070 con 0x7f7c60069050 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f7c5dffb640 1 -- 172.21.15.81:0/2984978571 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c50030710 con 0x7f7c60069050 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f7c5dffb640 1 -- 172.21.15.81:0/2984978571 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50030ae0 con 0x7f7c60069050 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 msgr2=0x7f7c6015a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 --2- 172.21.15.81:0/2984978571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7c500097d0 tx=0x7f7c5002b5d0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f185c020c70 con 0x7f18640ccbe0 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 msgr2=0x7fe8f8007f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 0x7fe8f8007f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f80eb290 msgr2=0x7fe8f8182510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f80eb290 0x7fe8f8182510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 -- 172.21.15.81:0/2262265839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8f8185a80 con 0x7fe8f8009180 2024-03-18T00:25:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 shutdown_connections 2024-03-18T00:25:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 --2- 172.21.15.81:0/2984978571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60069050 0x7f7c6015a320 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 >> 172.21.15.81:0/2984978571 conn(0x7f7c600b1cd0 msgr2=0x7f7c600b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8b9c0acf60 con 0x7f8ba00b5670 2024-03-18T00:25:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f8ba5cae640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 0x7f8b8406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9c440718f0 con 0x7f9c3c006190 2024-03-18T00:25:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ff7fe640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8050ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe90004fa60 tx=0x7fe900069cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.133+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3cd80e78f0 con 0x7f3cd8188600 2024-03-18T00:25:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 0x7f3cd80e55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f1852ffd640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 0x7f184406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f185c01c020 con 0x7f18640ccbe0 2024-03-18T00:25:33.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 shutdown_connections 2024-03-18T00:25:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/610877349 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2c005290 con 0x7f9c3c006190 2024-03-18T00:25:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f8ba5cae640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 0x7f8b8406e160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00cf5f0 tx=0x7f8b90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ba00cdde0 con 0x7f8ba00b5670 2024-03-18T00:25:33.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f9c367fc640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 0x7f9c2806e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000be020 con 0x7fe8f8009180 2024-03-18T00:25:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9000aea70 con 0x7fe8f8009180 2024-03-18T00:25:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9000b3040 con 0x7fe8f8009180 2024-03-18T00:25:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e6c04c940 con 0x7f9e6c008160 2024-03-18T00:25:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f186259c640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 0x7f184406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f3ce6022640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd8188600 0x7f3cd8188a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e6c04cf00 con 0x7f9e6c008160 2024-03-18T00:25:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9c44106190 con 0x7f9c3c006190 2024-03-18T00:25:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f348400cc20 con 0x7f348c0b2f40 2024-03-18T00:25:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.134+0000 7f7c65590640 1 -- 172.21.15.81:0/2984978571 wait complete. 2024-03-18T00:25:33.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7fe905e4b640 1 -- 172.21.15.81:0/2262265839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8f8185d60 con 0x7fe8f8009180 2024-03-18T00:25:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3472ffd640 1 -- 172.21.15.81:0/4261302733 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f348c04f540 con 0x7f348c0b2f40 2024-03-18T00:25:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7fe905e4b640 1 -- 172.21.15.81:0/2262265839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8f8186320 con 0x7fe8f8009180 2024-03-18T00:25:33.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3484014440 con 0x7f348c0b2f40 2024-03-18T00:25:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f9c4949a640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 0x7f9c2806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 -- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd8188600 msgr2=0x7f3cd8188a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd8188600 0x7f3cd8188a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 -- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 msgr2=0x7f3cd803e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cd8051da0 con 0x7f3cd80e5140 2024-03-18T00:25:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5821640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f3ce5020640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 0x7f3cd80e55c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0062da0 tx=0x7f3ce0069cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.135+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1848005290 con 0x7f18640ccbe0 2024-03-18T00:25:33.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f9c4949a640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 0x7f9c2806e190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c052590 tx=0x7f9c40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00b3040 con 0x7f3cd80e5140 2024-03-18T00:25:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e6c0057d0 con 0x7f9e6c008160 2024-03-18T00:25:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cd8052080 con 0x7f3cd80e5140 2024-03-18T00:25:33.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f7c65590640 1 Processor -- start 2024-03-18T00:25:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f348401c070 con 0x7f348c0b2f40 2024-03-18T00:25:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f186259c640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 0x7f184406e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18641f2940 tx=0x7f1858009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cd8052640 con 0x7f3cd80e5140 2024-03-18T00:25:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.136+0000 7fe905e4b640 1 -- 172.21.15.81:0/2262265839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8f80057d0 con 0x7fe8f8009180 2024-03-18T00:25:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.137+0000 7f7c65590640 1 -- start start 2024-03-18T00:25:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.137+0000 7f34897fa640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 0x7f347806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.137+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f348408ad90 con 0x7f348c0b2f40 2024-03-18T00:25:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.137+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce00ae400 con 0x7f3cd80e5140 2024-03-18T00:25:33.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.137+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0050430 con 0x7f3cd80e5140 2024-03-18T00:25:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9e740718f0 con 0x7f9e6c008160 2024-03-18T00:25:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c60069050 0x7f7c60147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60071b30 0x7f7c60155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6006e750 con 0x7f7c600acfb0 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6006e5d0 con 0x7f7c60069050 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c65590640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7c600b4010 con 0x7f7c60071b30 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c5f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c5f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59554/0 (socket says 172.21.15.81:59554) 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c5f7fe640 1 -- 172.21.15.81:0/3905115270 learned_addr learned my addr 172.21.15.81:0/3905115270 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c5e7fc640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60071b30 0x7f7c60155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f9e62ffd640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 0x7f9e5406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f348bfff640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 0x7f347806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f7c5effd640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c60069050 0x7f7c60147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe9000c1020 con 0x7fe8f8009180 2024-03-18T00:25:33.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 -- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60071b30 msgr2=0x7f7c60155310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f348bfff640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 0x7f347806e160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3480036000 tx=0x7f348003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60071b30 0x7f7c60155310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 -- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c60069050 msgr2=0x7f7c60147070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c60069050 0x7f7c60147070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 -- 172.21.15.81:0/3905115270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6009af30 con 0x7f7c600acfb0 2024-03-18T00:25:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7fe8ebfff640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 0x7fe8e406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f9e71d9b640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 0x7f9e5406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.138+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc8005290 con 0x7f3cd80e5140 2024-03-18T00:25:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7fe8feffd640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 0x7fe8e406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe9001286e0 con 0x7fe8f8009180 2024-03-18T00:25:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f9e71d9b640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 0x7f9e5406e160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007fd0 tx=0x7f9e64007aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f7c5f7fe640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c890 tx=0x7f7c5800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9e74106260 con 0x7f9e6c008160 2024-03-18T00:25:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3ce00c2020 con 0x7f3cd80e5140 2024-03-18T00:25:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.139+0000 7fe8feffd640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 0x7fe8e406e160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8005f40 tx=0x7fe8f4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.140+0000 7f3cd67fc640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 0x7f3cc406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.140+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8b9c0db2e0 con 0x7f8ba00b5670 2024-03-18T00:25:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.140+0000 7f3ce5821640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 0x7f3cc406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.140+0000 7f3ce5821640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 0x7f3cc406e0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc001050 tx=0x7f3cdc001c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.141+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3484059860 con 0x7f348c0b2f40 2024-03-18T00:25:33.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.144+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9c3c04f220 con 0x7f9c3c006190 2024-03-18T00:25:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.146+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3ce00f4540 con 0x7f3cd80e5140 2024-03-18T00:25:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.146+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58003da0 con 0x7f7c600acfb0 2024-03-18T00:25:33.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.146+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe9000c8030 con 0x7fe8f8009180 2024-03-18T00:25:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.146+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6009b210 con 0x7f7c600acfb0 2024-03-18T00:25:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.146+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6009b7d0 con 0x7f7c600acfb0 2024-03-18T00:25:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.147+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6004f5b0 con 0x7f7c600acfb0 2024-03-18T00:25:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.148+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f185c061a10 con 0x7f18640ccbe0 2024-03-18T00:25:33.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.155+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9e740d4dc0 con 0x7f9e6c008160 2024-03-18T00:25:33.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.164+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3ce00f6ba0 con 0x7f3cd80e5140 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.164+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c58005070 con 0x7f7c600acfb0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.165+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c58001900 con 0x7f7c600acfb0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.168+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7c580054a0 con 0x7f7c600acfb0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.168+0000 7f7c477fe640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 0x7f7c4c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.168+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7c5808b4d0 con 0x7f7c600acfb0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.169+0000 7f7c5effd640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 0x7f7c4c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.170+0000 7f7c5effd640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 0x7f7c4c06e090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c50034000 tx=0x7f7c50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.174+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7c5805a030 con 0x7f7c600acfb0 2024-03-18T00:25:33.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.549+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8ba004f5b0 con 0x7f8ba00b5670 2024-03-18T00:25:33.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.549+0000 7f8b96ffd640 1 -- 172.21.15.81:0/3970556199 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b9c033030 con 0x7f8ba00b5670 2024-03-18T00:25:33.550 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-03-18T00:25:33.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.551+0000 7f3472ffd640 1 -- 172.21.15.81:0/4261302733 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f348c06f790 con 0x7f348c0b2f40 2024-03-18T00:25:33.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.551+0000 7f34897fa640 1 -- 172.21.15.81:0/4261302733 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3484059160 con 0x7f348c0b2f40 2024-03-18T00:25:33.552 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 msgr2=0x7f8b8406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 0x7f8b8406e160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8ba00cf5f0 tx=0x7f8b90009040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 msgr2=0x7f8ba015b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba015b340 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8b9c033000 tx=0x7f8b9c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 shutdown_connections 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8b8406bca0 0x7f8b8406e160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ba00d1530 0x7f8ba00b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.553+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ba00d09a0 0x7f8ba00b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.554+0000 7f8ba8713640 1 --2- 172.21.15.81:0/3970556199 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ba00b5670 0x7f8ba015b340 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.554+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 >> 172.21.15.81:0/3970556199 conn(0x7f8ba00d4060 msgr2=0x7f8ba00ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.554+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 shutdown_connections 2024-03-18T00:25:33.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.554+0000 7f8ba8713640 1 -- 172.21.15.81:0/3970556199 wait complete. 2024-03-18T00:25:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 msgr2=0x7f347806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 0x7f347806e160 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3480036000 tx=0x7f348003c040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 msgr2=0x7f348c152c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f348400ba80 tx=0x7f348400bf40 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 shutdown_connections 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f348c0ccc10 0x7f348c151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f347806bca0 0x7f347806e160 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f348c0cc830 0x7f348c163400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 --2- 172.21.15.81:0/4261302733 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f348c0b2f40 0x7f348c152c20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 >> 172.21.15.81:0/4261302733 conn(0x7f348c0b1c40 msgr2=0x7f348c0afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 shutdown_connections 2024-03-18T00:25:33.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.555+0000 7f3491d1c640 1 -- 172.21.15.81:0/4261302733 wait complete. 2024-03-18T00:25:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.557+0000 7f9c4ac9d640 1 -- 172.21.15.81:0/610877349 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9c2c005580 con 0x7f9c3c006190 2024-03-18T00:25:33.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.557+0000 7f9c367fc640 1 -- 172.21.15.81:0/610877349 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c440d46a0 con 0x7f9c3c006190 2024-03-18T00:25:33.558 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.558+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9e6c04b8a0 con 0x7f9e6c008160 2024-03-18T00:25:33.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.559+0000 7f9e62ffd640 1 -- 172.21.15.81:0/2018718607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e740d46c0 con 0x7f9e6c008160 2024-03-18T00:25:33.560 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 msgr2=0x7f9c2806e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 0x7f9c2806e190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c052590 tx=0x7f9c40009040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 msgr2=0x7f9c3c0d71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9c4406a750 tx=0x7f9c44068d00 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 shutdown_connections 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.561+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9c3c0eb2f0 0x7f9c3c0db430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9c2806bcd0 0x7f9c2806e190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c3c0e7810 0x7f9c3c04ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 --2- 172.21.15.81:0/610877349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9c3c006190 0x7f9c3c0d71c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 >> 172.21.15.81:0/610877349 conn(0x7f9c3c0559d0 msgr2=0x7f9c3c0ea230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 shutdown_connections 2024-03-18T00:25:33.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f9c27fff640 1 -- 172.21.15.81:0/610877349 wait complete. 2024-03-18T00:25:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1848005580 con 0x7f18640ccbe0 2024-03-18T00:25:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.562+0000 7f1852ffd640 1 -- 172.21.15.81:0/4241923889 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f185c061310 con 0x7f18640ccbe0 2024-03-18T00:25:33.564 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 msgr2=0x7f9e5406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 0x7f9e5406e160 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007fd0 tx=0x7f9e64007aa0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 msgr2=0x7f9e6c0e7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 0x7f9e6c0e7920 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9e7402d740 tx=0x7f9e74068750 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 shutdown_connections 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9e6c0548a0 0x7f9e6c0e83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9e6c04fc00 0x7f9e6c0e7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9e5406bca0 0x7f9e5406e160 secure :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e64007fd0 tx=0x7f9e64007aa0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 --2- 172.21.15.81:0/2018718607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e6c008160 0x7f9e6c0e7920 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.563+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 >> 172.21.15.81:0/2018718607 conn(0x7f9e6c055340 msgr2=0x7f9e6c0e6780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.564+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 shutdown_connections 2024-03-18T00:25:33.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.564+0000 7f9e78b97640 1 -- 172.21.15.81:0/2018718607 wait complete. 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 msgr2=0x7f184406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 0x7f184406e090 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f18641f2940 tx=0x7f1858009040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 msgr2=0x7f18640cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 0x7f18640cd060 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18640b2f70 tx=0x7f185c005ae0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 shutdown_connections 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f18640ccbe0 0x7f18640cd060 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f18641e3e90 0x7f18641567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f184406bbd0 0x7f184406e090 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 --2- 172.21.15.81:0/4241923889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f184c004800 0x7f186409bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.566+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 >> 172.21.15.81:0/4241923889 conn(0x7f186406b5e0 msgr2=0x7f186406e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.567+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 shutdown_connections 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.567+0000 7f18689da640 1 -- 172.21.15.81:0/4241923889 wait complete. 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.567+0000 7fe905e4b640 1 -- 172.21.15.81:0/2262265839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe8f801f3d0 con 0x7fe8f8009180 2024-03-18T00:25:33.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.568+0000 7fe8ebfff640 1 -- 172.21.15.81:0/2262265839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe9000aee20 con 0x7fe8f8009180 2024-03-18T00:25:33.569 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.571+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 msgr2=0x7fe8e406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.571+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 0x7fe8e406e160 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe8f8005f40 tx=0x7fe8f4008040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.571+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 msgr2=0x7fe8f8050ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.571+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8050ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe90004fa60 tx=0x7fe900069cc0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 shutdown_connections 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe8f80eb290 0x7fe8f8182510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8f8048c30 0x7fe8f8007f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe8e406bca0 0x7fe8e406e160 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 --2- 172.21.15.81:0/2262265839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8f8009180 0x7fe8f8050ca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 >> 172.21.15.81:0/2262265839 conn(0x7fe8f801ef30 msgr2=0x7fe8f80eb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 shutdown_connections 2024-03-18T00:25:33.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.572+0000 7fe8e9ffb640 1 -- 172.21.15.81:0/2262265839 wait complete. 2024-03-18T00:25:33.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-03-18T00:25:33.575 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2024-03-18T00:25:33.577 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.583+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7c60153b30 con 0x7f7c600acfb0 2024-03-18T00:25:33.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.583+0000 7f7c477fe640 1 -- 172.21.15.81:0/3905115270 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c58059930 con 0x7f7c600acfb0 2024-03-18T00:25:33.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f3cc8005580 con 0x7f3cd80e5140 2024-03-18T00:25:33.587 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-03-18T00:25:33.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-03-18T00:25:33.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-03-18T00:25:33.589 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-03-18T00:25:33.589 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.589 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.589 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f3cd67fc640 1 -- 172.21.15.81:0/2124529172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ce00f64a0 con 0x7f3cd80e5140 2024-03-18T00:25:33.590 INFO:teuthology.orchestra.run.smithi081.stdout:55834574856 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 msgr2=0x7f7c4c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 0x7f7c4c06e090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7c50034000 tx=0x7f7c50008030 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 msgr2=0x7f7c60140730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7c5800c890 tx=0x7f7c5800cd50 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 shutdown_connections 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c4c06bbd0 0x7f7c4c06e090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c600acfb0 0x7f7c60140730 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7c60071b30 0x7f7c60155310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 --2- 172.21.15.81:0/3905115270 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7c60069050 0x7f7c60147070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.586+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 >> 172.21.15.81:0/3905115270 conn(0x7f7c600b1cd0 msgr2=0x7f7c6006d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.587+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 shutdown_connections 2024-03-18T00:25:33.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.587+0000 7f7c65590640 1 -- 172.21.15.81:0/3905115270 wait complete. 2024-03-18T00:25:33.592 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-03-18T00:25:33.593 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 msgr2=0x7f3cc406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 0x7f3cc406e0c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc001050 tx=0x7f3cdc001c00 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 msgr2=0x7f3cd80e55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 0x7f3cd80e55c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0062da0 tx=0x7f3ce0069cc0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 shutdown_connections 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3cd8188600 0x7f3cd8188a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3cc406bc00 0x7f3cc406e0c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3cd80e5140 0x7f3cd80e55c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 --2- 172.21.15.81:0/2124529172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3ccc004800 0x7f3cd803e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 >> 172.21.15.81:0/2124529172 conn(0x7f3cd8058ed0 msgr2=0x7f3cd8039800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.588+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 shutdown_connections 2024-03-18T00:25:33.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.589+0000 7f3ce7a85640 1 -- 172.21.15.81:0/2124529172 wait complete. 2024-03-18T00:25:33.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-03-18T00:25:33.599 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.600 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-03-18T00:25:33.600 DEBUG:teuthology.parallel:result is None 2024-03-18T00:25:33.600 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T00:25:33.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.738+0000 7f4b50ea1640 1 Processor -- start 2024-03-18T00:25:33.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.738+0000 7f4b50ea1640 1 -- start start 2024-03-18T00:25:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b50ea1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b4c154a90 0x7f4b4c06cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b50ea1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b4c15e880 0x7f4b4c071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b50ea1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b4c06e6f0 con 0x7f4b4c06d1b0 2024-03-18T00:25:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b50ea1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4c06d650 con 0x7f4b4c154a90 2024-03-18T00:25:33.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b50ea1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4b4c06d930 con 0x7f4b4c15e880 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b4a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b4c154a90 0x7f4b4c06cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b49d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4b4c06d1b0 0x7f4b4c15e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55816/0 (socket says 172.21.15.81:55816) 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b49d9b640 1 -- 172.21.15.81:0/2650474243 learned_addr learned my addr 172.21.15.81:0/2650474243 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.739+0000 7f4b4ad9d640 1 --2- 172.21.15.81:0/2650474243 >> v2:172.21.15.136:3300/0 conn(0x7f4b4c15e880 0x7f4b4c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4a59c640 1 -- 172.21.15.81:0/2650474243 >> v2:172.21.15.136:3300/0 conn(0x7f4b4c15e880 msgr2=0x7f4b4c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4a59c640 1 --2- 172.21.15.81:0/2650474243 >> v2:172.21.15.136:3300/0 conn(0x7f4b4c15e880 0x7f4b4c071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4a59c640 1 -- 172.21.15.81:0/2650474243 >> v1:172.21.15.81:6789/0 conn(0x7f4b4c06d1b0 legacy=0x7f4b4c15e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4959a640 1 -- 172.21.15.81:0/2650474243 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362777518 0 0) 0x7f4b4c06e6f0 con 0x7f4b4c06d1b0 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4a59c640 1 -- 172.21.15.81:0/2650474243 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c06dc10 con 0x7f4b4c154a90 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4a59c640 1 --2- 172.21.15.81:0/2650474243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c06cc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0d0d30 tx=0x7f4b3c02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d979f7e44a968f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.740+0000 7f4b4959a640 1 -- 172.21.15.81:0/2650474243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c03a070 con 0x7f4b4c154a90 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b4959a640 1 -- 172.21.15.81:0/2650474243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3c02dad0 con 0x7f4b4c154a90 2024-03-18T00:25:33.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b4959a640 1 -- 172.21.15.81:0/2650474243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3c00b040 con 0x7f4b4c154a90 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 -- 172.21.15.81:0/2650474243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 msgr2=0x7f4b4c06cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/2650474243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c06cc70 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0d0d30 tx=0x7f4b3c02cd20 comp rx=0 tx=0).stop 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 -- 172.21.15.81:0/2650474243 shutdown_connections 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/2650474243 >> v2:172.21.15.136:3300/0 conn(0x7f4b4c15e880 0x7f4b4c071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/2650474243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c06cc70 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 -- 172.21.15.81:0/2650474243 >> 172.21.15.81:0/2650474243 conn(0x7f4b4c06b5e0 msgr2=0x7f4b4c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 -- 172.21.15.81:0/2650474243 shutdown_connections 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.741+0000 7f4b50ea1640 1 -- 172.21.15.81:0/2650474243 wait complete. 2024-03-18T00:25:33.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.742+0000 7f4b50ea1640 1 Processor -- start 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.742+0000 7f4b50ea1640 1 -- start start 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b4c06d1b0 0x7f4b4c0cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4c15e880 0x7f4b4c1f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c154e70 con 0x7f4b4c154a90 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b4c06e1d0 con 0x7f4b4c15e880 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b50ea1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4b4c154ff0 con 0x7f4b4c06d1b0 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b49d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59570/0 (socket says 172.21.15.81:59570) 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b49d9b640 1 -- 172.21.15.81:0/3807869217 learned_addr learned my addr 172.21.15.81:0/3807869217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b4a59c640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b4c06d1b0 0x7f4b4c0cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b4ad9d640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4c15e880 0x7f4b4c1f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b49d9b640 1 -- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b4c06d1b0 msgr2=0x7f4b4c0cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.743+0000 7f4b49d9b640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b4c06d1b0 0x7f4b4c0cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b49d9b640 1 -- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4c15e880 msgr2=0x7f4b4c1f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b49d9b640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4c15e880 0x7f4b4c1f3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b49d9b640 1 -- 172.21.15.81:0/3807869217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4c0afe00 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b49d9b640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e990 tx=0x7f4b4000ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400072e0 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40016020 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b4c0b00e0 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400047e0 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.744+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b4c1f3f60 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.745+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b4c159720 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.745+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4b40004980 con 0x7f4b4c154a90 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.746+0000 7f4b3affd640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 0x7f4b2c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:33.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.746+0000 7f4b4a59c640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 0x7f4b2c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:33.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.746+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b4008cd20 con 0x7f4b4c154a90 2024-03-18T00:25:33.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.746+0000 7f4b4a59c640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 0x7f4b2c06e090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c037000 tx=0x7f4b3c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:33.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.750+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4b4c159720 con 0x7f4b4c154a90 2024-03-18T00:25:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.920+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4b4c0afbb0 con 0x7f4b2c06bbd0 2024-03-18T00:25:33.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.926+0000 7f4b3affd640 1 -- 172.21.15.81:0/3807869217 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f4b4c0afbb0 con 0x7f4b2c06bbd0 2024-03-18T00:25:33.929 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:33.930 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 msgr2=0x7f4b2c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 0x7f4b2c06e090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4b3c037000 tx=0x7f4b3c00c040 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 msgr2=0x7f4b4c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4b4000e990 tx=0x7f4b4000ee50 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 shutdown_connections 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b4c15e880 0x7f4b4c1f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b2c06bbd0 0x7f4b2c06e090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b4c154a90 0x7f4b4c072940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 --2- 172.21.15.81:0/3807869217 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b4c06d1b0 0x7f4b4c0cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:33.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 >> 172.21.15.81:0/3807869217 conn(0x7f4b4c06b5e0 msgr2=0x7f4b4c15a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 shutdown_connections 2024-03-18T00:25:33.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:33.929+0000 7f4b50ea1640 1 -- 172.21.15.81:0/3807869217 wait complete. 2024-03-18T00:25:33.940 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-18T00:25:33.360778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.846544"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360165+0000","last_change":"2024-03-18T00:25:23.535915+0000","last_active":"2024-03-18T00:25:25.360165+0000","last_peered":"2024-03-18T00:25:25.360165+0000","last_clean":"2024-03-18T00:25:25.360165+0000","last_became_active":"2024-03-18T00:25:23.535620+0000","last_became_peered":"2024-03-18T00:25:23.535620+0000","last_unstale":"2024-03-18T00:25:25.360165+0000","last_undegraded":"2024-03-18T00:25:25.360165+0000","last_fullsized":"2024-03-18T00:25:25.360165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527350+0000","last_change":"2024-03-18T00:25:23.526470+0000","last_active":"2024-03-18T00:25:24.527350+0000","last_peered":"2024-03-18T00:25:24.527350+0000","last_clean":"2024-03-18T00:25:24.527350+0000","last_became_active":"2024-03-18T00:25:23.526181+0000","last_became_peered":"2024-03-18T00:25:23.526181+0000","last_unstale":"2024-03-18T00:25:24.527350+0000","last_undegraded":"2024-03-18T00:25:24.527350+0000","last_fullsized":"2024-03-18T00:25:24.527350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933336+0000","last_change":"2024-03-18T00:25:23.529914+0000","last_active":"2024-03-18T00:25:24.933336+0000","last_peered":"2024-03-18T00:25:24.933336+0000","last_clean":"2024-03-18T00:25:24.933336+0000","last_became_active":"2024-03-18T00:25:23.529601+0000","last_became_peered":"2024-03-18T00:25:23.529601+0000","last_unstale":"2024-03-18T00:25:24.933336+0000","last_undegraded":"2024-03-18T00:25:24.933336+0000","last_fullsized":"2024-03-18T00:25:24.933336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:42:59.751721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360378+0000","last_change":"2024-03-18T00:25:23.543302+0000","last_active":"2024-03-18T00:25:25.360378+0000","last_peered":"2024-03-18T00:25:25.360378+0000","last_clean":"2024-03-18T00:25:25.360378+0000","last_became_active":"2024-03-18T00:25:23.542926+0000","last_became_peered":"2024-03-18T00:25:23.542926+0000","last_unstale":"2024-03-18T00:25:25.360378+0000","last_undegraded":"2024-03-18T00:25:25.360378+0000","last_fullsized":"2024-03-18T00:25:25.360378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360045+0000","last_change":"2024-03-18T00:25:23.539758+0000","last_active":"2024-03-18T00:25:25.360045+0000","last_peered":"2024-03-18T00:25:25.360045+0000","last_clean":"2024-03-18T00:25:25.360045+0000","last_became_active":"2024-03-18T00:25:23.537575+0000","last_became_peered":"2024-03-18T00:25:23.537575+0000","last_unstale":"2024-03-18T00:25:25.360045+0000","last_undegraded":"2024-03-18T00:25:25.360045+0000","last_fullsized":"2024-03-18T00:25:25.360045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360144+0000","last_change":"2024-03-18T00:25:23.528725+0000","last_active":"2024-03-18T00:25:25.360144+0000","last_peered":"2024-03-18T00:25:25.360144+0000","last_clean":"2024-03-18T00:25:25.360144+0000","last_became_active":"2024-03-18T00:25:23.528456+0000","last_became_peered":"2024-03-18T00:25:23.528456+0000","last_unstale":"2024-03-18T00:25:25.360144+0000","last_undegraded":"2024-03-18T00:25:25.360144+0000","last_fullsized":"2024-03-18T00:25:25.360144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359549+0000","last_change":"2024-03-18T00:25:23.532811+0000","last_active":"2024-03-18T00:25:25.359549+0000","last_peered":"2024-03-18T00:25:25.359549+0000","last_clean":"2024-03-18T00:25:25.359549+0000","last_became_active":"2024-03-18T00:25:23.530841+0000","last_became_peered":"2024-03-18T00:25:23.530841+0000","last_unstale":"2024-03-18T00:25:25.359549+0000","last_undegraded":"2024-03-18T00:25:25.359549+0000","last_fullsized":"2024-03-18T00:25:25.359549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524831+0000","last_change":"2024-03-18T00:25:23.536908+0000","last_active":"2024-03-18T00:25:24.524831+0000","last_peered":"2024-03-18T00:25:24.524831+0000","last_clean":"2024-03-18T00:25:24.524831+0000","last_became_active":"2024-03-18T00:25:23.536369+0000","last_became_peered":"2024-03-18T00:25:23.536369+0000","last_unstale":"2024-03-18T00:25:24.524831+0000","last_undegraded":"2024-03-18T00:25:24.524831+0000","last_fullsized":"2024-03-18T00:25:24.524831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360205+0000","last_change":"2024-03-18T00:25:23.535358+0000","last_active":"2024-03-18T00:25:25.360205+0000","last_peered":"2024-03-18T00:25:25.360205+0000","last_clean":"2024-03-18T00:25:25.360205+0000","last_became_active":"2024-03-18T00:25:23.535099+0000","last_became_peered":"2024-03-18T00:25:23.535099+0000","last_unstale":"2024-03-18T00:25:25.360205+0000","last_undegraded":"2024-03-18T00:25:25.360205+0000","last_fullsized":"2024-03-18T00:25:25.360205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525233+0000","last_change":"2024-03-18T00:25:23.524721+0000","last_active":"2024-03-18T00:25:24.525233+0000","last_peered":"2024-03-18T00:25:24.525233+0000","last_clean":"2024-03-18T00:25:24.525233+0000","last_became_active":"2024-03-18T00:25:23.524434+0000","last_became_peered":"2024-03-18T00:25:23.524434+0000","last_unstale":"2024-03-18T00:25:24.525233+0000","last_undegraded":"2024-03-18T00:25:24.525233+0000","last_fullsized":"2024-03-18T00:25:24.525233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525031+0000","last_change":"2024-03-18T00:25:23.525372+0000","last_active":"2024-03-18T00:25:24.525031+0000","last_peered":"2024-03-18T00:25:24.525031+0000","last_clean":"2024-03-18T00:25:24.525031+0000","last_became_active":"2024-03-18T00:25:23.524989+0000","last_became_peered":"2024-03-18T00:25:23.524989+0000","last_unstale":"2024-03-18T00:25:24.525031+0000","last_undegraded":"2024-03-18T00:25:24.525031+0000","last_fullsized":"2024-03-18T00:25:24.525031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859513+0000","last_change":"2024-03-18T00:25:23.536156+0000","last_active":"2024-03-18T00:25:24.859513+0000","last_peered":"2024-03-18T00:25:24.859513+0000","last_clean":"2024-03-18T00:25:24.859513+0000","last_became_active":"2024-03-18T00:25:23.535858+0000","last_became_peered":"2024-03-18T00:25:23.535858+0000","last_unstale":"2024-03-18T00:25:24.859513+0000","last_undegraded":"2024-03-18T00:25:24.859513+0000","last_fullsized":"2024-03-18T00:25:24.859513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524955+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.524955+0000","last_peered":"2024-03-18T00:25:24.524955+0000","last_clean":"2024-03-18T00:25:24.524955+0000","last_became_active":"2024-03-18T00:25:23.537444+0000","last_became_peered":"2024-03-18T00:25:23.537444+0000","last_unstale":"2024-03-18T00:25:24.524955+0000","last_undegraded":"2024-03-18T00:25:24.524955+0000","last_fullsized":"2024-03-18T00:25:24.524955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933313+0000","last_change":"2024-03-18T00:25:23.528214+0000","last_active":"2024-03-18T00:25:24.933313+0000","last_peered":"2024-03-18T00:25:24.933313+0000","last_clean":"2024-03-18T00:25:24.933313+0000","last_became_active":"2024-03-18T00:25:23.527939+0000","last_became_peered":"2024-03-18T00:25:23.527939+0000","last_unstale":"2024-03-18T00:25:24.933313+0000","last_undegraded":"2024-03-18T00:25:24.933313+0000","last_fullsized":"2024-03-18T00:25:24.933313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:48.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527062+0000","last_change":"2024-03-18T00:25:23.539451+0000","last_active":"2024-03-18T00:25:24.527062+0000","last_peered":"2024-03-18T00:25:24.527062+0000","last_clean":"2024-03-18T00:25:24.527062+0000","last_became_active":"2024-03-18T00:25:23.539183+0000","last_became_peered":"2024-03-18T00:25:23.539183+0000","last_unstale":"2024-03-18T00:25:24.527062+0000","last_undegraded":"2024-03-18T00:25:24.527062+0000","last_fullsized":"2024-03-18T00:25:24.527062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359583+0000","last_change":"2024-03-18T00:25:23.529121+0000","last_active":"2024-03-18T00:25:25.359583+0000","last_peered":"2024-03-18T00:25:25.359583+0000","last_clean":"2024-03-18T00:25:25.359583+0000","last_became_active":"2024-03-18T00:25:23.528826+0000","last_became_peered":"2024-03-18T00:25:23.528826+0000","last_unstale":"2024-03-18T00:25:25.359583+0000","last_undegraded":"2024-03-18T00:25:25.359583+0000","last_fullsized":"2024-03-18T00:25:25.359583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360000+0000","last_change":"2024-03-18T00:25:23.532218+0000","last_active":"2024-03-18T00:25:25.360000+0000","last_peered":"2024-03-18T00:25:25.360000+0000","last_clean":"2024-03-18T00:25:25.360000+0000","last_became_active":"2024-03-18T00:25:23.531962+0000","last_became_peered":"2024-03-18T00:25:23.531962+0000","last_unstale":"2024-03-18T00:25:25.360000+0000","last_undegraded":"2024-03-18T00:25:25.360000+0000","last_fullsized":"2024-03-18T00:25:25.360000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359804+0000","last_change":"2024-03-18T00:25:23.531016+0000","last_active":"2024-03-18T00:25:25.359804+0000","last_peered":"2024-03-18T00:25:25.359804+0000","last_clean":"2024-03-18T00:25:25.359804+0000","last_became_active":"2024-03-18T00:25:23.530710+0000","last_became_peered":"2024-03-18T00:25:23.530710+0000","last_unstale":"2024-03-18T00:25:25.359804+0000","last_undegraded":"2024-03-18T00:25:25.359804+0000","last_fullsized":"2024-03-18T00:25:25.359804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360675+0000","last_change":"2024-03-18T00:25:23.532105+0000","last_active":"2024-03-18T00:25:25.360675+0000","last_peered":"2024-03-18T00:25:25.360675+0000","last_clean":"2024-03-18T00:25:25.360675+0000","last_became_active":"2024-03-18T00:25:23.531767+0000","last_became_peered":"2024-03-18T00:25:23.531767+0000","last_unstale":"2024-03-18T00:25:25.360675+0000","last_undegraded":"2024-03-18T00:25:25.360675+0000","last_fullsized":"2024-03-18T00:25:25.360675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:03.624129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525483+0000","last_change":"2024-03-18T00:25:23.535568+0000","last_active":"2024-03-18T00:25:24.525483+0000","last_peered":"2024-03-18T00:25:24.525483+0000","last_clean":"2024-03-18T00:25:24.525483+0000","last_became_active":"2024-03-18T00:25:23.535301+0000","last_became_peered":"2024-03-18T00:25:23.535301+0000","last_unstale":"2024-03-18T00:25:24.525483+0000","last_undegraded":"2024-03-18T00:25:24.525483+0000","last_fullsized":"2024-03-18T00:25:24.525483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.531923+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.531605+0000","last_became_peered":"2024-03-18T00:25:23.531605+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360278+0000","last_change":"2024-03-18T00:25:23.540875+0000","last_active":"2024-03-18T00:25:25.360278+0000","last_peered":"2024-03-18T00:25:25.360278+0000","last_clean":"2024-03-18T00:25:25.360278+0000","last_became_active":"2024-03-18T00:25:23.540621+0000","last_became_peered":"2024-03-18T00:25:23.540621+0000","last_unstale":"2024-03-18T00:25:25.360278+0000","last_undegraded":"2024-03-18T00:25:25.360278+0000","last_fullsized":"2024-03-18T00:25:25.360278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524925+0000","last_change":"2024-03-18T00:25:23.540944+0000","last_active":"2024-03-18T00:25:24.524925+0000","last_peered":"2024-03-18T00:25:24.524925+0000","last_clean":"2024-03-18T00:25:24.524925+0000","last_became_active":"2024-03-18T00:25:23.540662+0000","last_became_peered":"2024-03-18T00:25:23.540662+0000","last_unstale":"2024-03-18T00:25:24.524925+0000","last_undegraded":"2024-03-18T00:25:24.524925+0000","last_fullsized":"2024-03-18T00:25:24.524925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359780+0000","last_change":"2024-03-18T00:25:23.538366+0000","last_active":"2024-03-18T00:25:25.359780+0000","last_peered":"2024-03-18T00:25:25.359780+0000","last_clean":"2024-03-18T00:25:25.359780+0000","last_became_active":"2024-03-18T00:25:23.538091+0000","last_became_peered":"2024-03-18T00:25:23.538091+0000","last_unstale":"2024-03-18T00:25:25.359780+0000","last_undegraded":"2024-03-18T00:25:25.359780+0000","last_fullsized":"2024-03-18T00:25:25.359780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525286+0000","last_change":"2024-03-18T00:25:23.539971+0000","last_active":"2024-03-18T00:25:24.525286+0000","last_peered":"2024-03-18T00:25:24.525286+0000","last_clean":"2024-03-18T00:25:24.525286+0000","last_became_active":"2024-03-18T00:25:23.539703+0000","last_became_peered":"2024-03-18T00:25:23.539703+0000","last_unstale":"2024-03-18T00:25:24.525286+0000","last_undegraded":"2024-03-18T00:25:24.525286+0000","last_fullsized":"2024-03-18T00:25:24.525286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525354+0000","last_change":"2024-03-18T00:25:23.528213+0000","last_active":"2024-03-18T00:25:24.525354+0000","last_peered":"2024-03-18T00:25:24.525354+0000","last_clean":"2024-03-18T00:25:24.525354+0000","last_became_active":"2024-03-18T00:25:23.527957+0000","last_became_peered":"2024-03-18T00:25:23.527957+0000","last_unstale":"2024-03-18T00:25:24.525354+0000","last_undegraded":"2024-03-18T00:25:24.525354+0000","last_fullsized":"2024-03-18T00:25:24.525354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527277+0000","last_change":"2024-03-18T00:25:23.538220+0000","last_active":"2024-03-18T00:25:24.527277+0000","last_peered":"2024-03-18T00:25:24.527277+0000","last_clean":"2024-03-18T00:25:24.527277+0000","last_became_active":"2024-03-18T00:25:23.537965+0000","last_became_peered":"2024-03-18T00:25:23.537965+0000","last_unstale":"2024-03-18T00:25:24.527277+0000","last_undegraded":"2024-03-18T00:25:24.527277+0000","last_fullsized":"2024-03-18T00:25:24.527277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525245+0000","last_change":"2024-03-18T00:25:23.540936+0000","last_active":"2024-03-18T00:25:24.525245+0000","last_peered":"2024-03-18T00:25:24.525245+0000","last_clean":"2024-03-18T00:25:24.525245+0000","last_became_active":"2024-03-18T00:25:23.540679+0000","last_became_peered":"2024-03-18T00:25:23.540679+0000","last_unstale":"2024-03-18T00:25:24.525245+0000","last_undegraded":"2024-03-18T00:25:24.525245+0000","last_fullsized":"2024-03-18T00:25:24.525245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933579+0000","last_change":"2024-03-18T00:25:23.538218+0000","last_active":"2024-03-18T00:25:24.933579+0000","last_peered":"2024-03-18T00:25:24.933579+0000","last_clean":"2024-03-18T00:25:24.933579+0000","last_became_active":"2024-03-18T00:25:23.537892+0000","last_became_peered":"2024-03-18T00:25:23.537892+0000","last_unstale":"2024-03-18T00:25:24.933579+0000","last_undegraded":"2024-03-18T00:25:24.933579+0000","last_fullsized":"2024-03-18T00:25:24.933579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360411+0000","last_change":"2024-03-18T00:25:23.539202+0000","last_active":"2024-03-18T00:25:25.360411+0000","last_peered":"2024-03-18T00:25:25.360411+0000","last_clean":"2024-03-18T00:25:25.360411+0000","last_became_active":"2024-03-18T00:25:23.538922+0000","last_became_peered":"2024-03-18T00:25:23.538922+0000","last_unstale":"2024-03-18T00:25:25.360411+0000","last_undegraded":"2024-03-18T00:25:25.360411+0000","last_fullsized":"2024-03-18T00:25:25.360411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359685+0000","last_change":"2024-03-18T00:25:23.529487+0000","last_active":"2024-03-18T00:25:25.359685+0000","last_peered":"2024-03-18T00:25:25.359685+0000","last_clean":"2024-03-18T00:25:25.359685+0000","last_became_active":"2024-03-18T00:25:23.529211+0000","last_became_peered":"2024-03-18T00:25:23.529211+0000","last_unstale":"2024-03-18T00:25:25.359685+0000","last_undegraded":"2024-03-18T00:25:25.359685+0000","last_fullsized":"2024-03-18T00:25:25.359685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524820+0000","last_change":"2024-03-18T00:25:23.526131+0000","last_active":"2024-03-18T00:25:24.524820+0000","last_peered":"2024-03-18T00:25:24.524820+0000","last_clean":"2024-03-18T00:25:24.524820+0000","last_became_active":"2024-03-18T00:25:23.525869+0000","last_became_peered":"2024-03-18T00:25:23.525869+0000","last_unstale":"2024-03-18T00:25:24.524820+0000","last_undegraded":"2024-03-18T00:25:24.524820+0000","last_fullsized":"2024-03-18T00:25:24.524820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859267+0000","last_change":"2024-03-18T00:25:23.528904+0000","last_active":"2024-03-18T00:25:24.859267+0000","last_peered":"2024-03-18T00:25:24.859267+0000","last_clean":"2024-03-18T00:25:24.859267+0000","last_became_active":"2024-03-18T00:25:23.528637+0000","last_became_peered":"2024-03-18T00:25:23.528637+0000","last_unstale":"2024-03-18T00:25:24.859267+0000","last_undegraded":"2024-03-18T00:25:24.859267+0000","last_fullsized":"2024-03-18T00:25:24.859267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:50.372929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525171+0000","last_change":"2024-03-18T00:25:22.525633+0000","last_active":"2024-03-18T00:25:24.525171+0000","last_peered":"2024-03-18T00:25:24.525171+0000","last_clean":"2024-03-18T00:25:24.525171+0000","last_became_active":"2024-03-18T00:25:22.525293+0000","last_became_peered":"2024-03-18T00:25:22.525293+0000","last_unstale":"2024-03-18T00:25:24.525171+0000","last_undegraded":"2024-03-18T00:25:24.525171+0000","last_fullsized":"2024-03-18T00:25:24.525171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:29:02.213393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933633+0000","last_change":"2024-03-18T00:25:23.532009+0000","last_active":"2024-03-18T00:25:24.933633+0000","last_peered":"2024-03-18T00:25:24.933633+0000","last_clean":"2024-03-18T00:25:24.933633+0000","last_became_active":"2024-03-18T00:25:23.531736+0000","last_became_peered":"2024-03-18T00:25:23.531736+0000","last_unstale":"2024-03-18T00:25:24.933633+0000","last_undegraded":"2024-03-18T00:25:24.933633+0000","last_fullsized":"2024-03-18T00:25:24.933633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524921+0000","last_change":"2024-03-18T00:25:22.521332+0000","last_active":"2024-03-18T00:25:24.524921+0000","last_peered":"2024-03-18T00:25:24.524921+0000","last_clean":"2024-03-18T00:25:24.524921+0000","last_became_active":"2024-03-18T00:25:22.520113+0000","last_became_peered":"2024-03-18T00:25:22.520113+0000","last_unstale":"2024-03-18T00:25:24.524921+0000","last_undegraded":"2024-03-18T00:25:24.524921+0000","last_fullsized":"2024-03-18T00:25:24.524921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524901+0000","last_change":"2024-03-18T00:25:22.525936+0000","last_active":"2024-03-18T00:25:24.524901+0000","last_peered":"2024-03-18T00:25:24.524901+0000","last_clean":"2024-03-18T00:25:24.524901+0000","last_became_active":"2024-03-18T00:25:22.525688+0000","last_became_peered":"2024-03-18T00:25:22.525688+0000","last_unstale":"2024-03-18T00:25:24.524901+0000","last_undegraded":"2024-03-18T00:25:24.524901+0000","last_fullsized":"2024-03-18T00:25:24.524901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524904+0000","last_change":"2024-03-18T00:25:23.537268+0000","last_active":"2024-03-18T00:25:24.524904+0000","last_peered":"2024-03-18T00:25:24.524904+0000","last_clean":"2024-03-18T00:25:24.524904+0000","last_became_active":"2024-03-18T00:25:23.536747+0000","last_became_peered":"2024-03-18T00:25:23.536747+0000","last_unstale":"2024-03-18T00:25:24.524904+0000","last_undegraded":"2024-03-18T00:25:24.524904+0000","last_fullsized":"2024-03-18T00:25:24.524904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359815+0000","last_change":"2024-03-18T00:25:22.525372+0000","last_active":"2024-03-18T00:25:25.359815+0000","last_peered":"2024-03-18T00:25:25.359815+0000","last_clean":"2024-03-18T00:25:25.359815+0000","last_became_active":"2024-03-18T00:25:22.525058+0000","last_became_peered":"2024-03-18T00:25:22.525058+0000","last_unstale":"2024-03-18T00:25:25.359815+0000","last_undegraded":"2024-03-18T00:25:25.359815+0000","last_fullsized":"2024-03-18T00:25:25.359815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526925+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.526925+0000","last_peered":"2024-03-18T00:25:24.526925+0000","last_clean":"2024-03-18T00:25:24.526925+0000","last_became_active":"2024-03-18T00:25:23.538003+0000","last_became_peered":"2024-03-18T00:25:23.538003+0000","last_unstale":"2024-03-18T00:25:24.526925+0000","last_undegraded":"2024-03-18T00:25:24.526925+0000","last_fullsized":"2024-03-18T00:25:24.526925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525197+0000","last_change":"2024-03-18T00:25:22.512527+0000","last_active":"2024-03-18T00:25:24.525197+0000","last_peered":"2024-03-18T00:25:24.525197+0000","last_clean":"2024-03-18T00:25:24.525197+0000","last_became_active":"2024-03-18T00:25:22.512256+0000","last_became_peered":"2024-03-18T00:25:22.512256+0000","last_unstale":"2024-03-18T00:25:24.525197+0000","last_undegraded":"2024-03-18T00:25:24.525197+0000","last_fullsized":"2024-03-18T00:25:24.525197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360064+0000","last_change":"2024-03-18T00:25:23.536878+0000","last_active":"2024-03-18T00:25:25.360064+0000","last_peered":"2024-03-18T00:25:25.360064+0000","last_clean":"2024-03-18T00:25:25.360064+0000","last_became_active":"2024-03-18T00:25:23.536571+0000","last_became_peered":"2024-03-18T00:25:23.536571+0000","last_unstale":"2024-03-18T00:25:25.360064+0000","last_undegraded":"2024-03-18T00:25:25.360064+0000","last_fullsized":"2024-03-18T00:25:25.360064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360235+0000","last_change":"2024-03-18T00:25:22.516162+0000","last_active":"2024-03-18T00:25:25.360235+0000","last_peered":"2024-03-18T00:25:25.360235+0000","last_clean":"2024-03-18T00:25:25.360235+0000","last_became_active":"2024-03-18T00:25:22.515844+0000","last_became_peered":"2024-03-18T00:25:22.515844+0000","last_unstale":"2024-03-18T00:25:25.360235+0000","last_undegraded":"2024-03-18T00:25:25.360235+0000","last_fullsized":"2024-03-18T00:25:25.360235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.529085+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.528662+0000","last_became_peered":"2024-03-18T00:25:23.528662+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527254+0000","last_change":"2024-03-18T00:25:22.521602+0000","last_active":"2024-03-18T00:25:24.527254+0000","last_peered":"2024-03-18T00:25:24.527254+0000","last_clean":"2024-03-18T00:25:24.527254+0000","last_became_active":"2024-03-18T00:25:22.521328+0000","last_became_peered":"2024-03-18T00:25:22.521328+0000","last_unstale":"2024-03-18T00:25:24.527254+0000","last_undegraded":"2024-03-18T00:25:24.527254+0000","last_fullsized":"2024-03-18T00:25:24.527254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859580+0000","last_change":"2024-03-18T00:25:23.543862+0000","last_active":"2024-03-18T00:25:24.859580+0000","last_peered":"2024-03-18T00:25:24.859580+0000","last_clean":"2024-03-18T00:25:24.859580+0000","last_became_active":"2024-03-18T00:25:23.543558+0000","last_became_peered":"2024-03-18T00:25:23.543558+0000","last_unstale":"2024-03-18T00:25:24.859580+0000","last_undegraded":"2024-03-18T00:25:24.859580+0000","last_fullsized":"2024-03-18T00:25:24.859580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:14.829023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525576+0000","last_change":"2024-03-18T00:25:22.525827+0000","last_active":"2024-03-18T00:25:24.525576+0000","last_peered":"2024-03-18T00:25:24.525576+0000","last_clean":"2024-03-18T00:25:24.525576+0000","last_became_active":"2024-03-18T00:25:22.525551+0000","last_became_peered":"2024-03-18T00:25:22.525551+0000","last_unstale":"2024-03-18T00:25:24.525576+0000","last_undegraded":"2024-03-18T00:25:24.525576+0000","last_fullsized":"2024-03-18T00:25:24.525576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360412+0000","last_change":"2024-03-18T00:25:23.543586+0000","last_active":"2024-03-18T00:25:25.360412+0000","last_peered":"2024-03-18T00:25:25.360412+0000","last_clean":"2024-03-18T00:25:25.360412+0000","last_became_active":"2024-03-18T00:25:23.543343+0000","last_became_peered":"2024-03-18T00:25:23.543343+0000","last_unstale":"2024-03-18T00:25:25.360412+0000","last_undegraded":"2024-03-18T00:25:25.360412+0000","last_fullsized":"2024-03-18T00:25:25.360412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:39:37.708353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933641+0000","last_change":"2024-03-18T00:25:22.525005+0000","last_active":"2024-03-18T00:25:24.933641+0000","last_peered":"2024-03-18T00:25:24.933641+0000","last_clean":"2024-03-18T00:25:24.933641+0000","last_became_active":"2024-03-18T00:25:22.524742+0000","last_became_peered":"2024-03-18T00:25:22.524742+0000","last_unstale":"2024-03-18T00:25:24.933641+0000","last_undegraded":"2024-03-18T00:25:24.933641+0000","last_fullsized":"2024-03-18T00:25:24.933641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933361+0000","last_change":"2024-03-18T00:25:23.525230+0000","last_active":"2024-03-18T00:25:24.933361+0000","last_peered":"2024-03-18T00:25:24.933361+0000","last_clean":"2024-03-18T00:25:24.933361+0000","last_became_active":"2024-03-18T00:25:23.524978+0000","last_became_peered":"2024-03-18T00:25:23.524978+0000","last_unstale":"2024-03-18T00:25:24.933361+0000","last_undegraded":"2024-03-18T00:25:24.933361+0000","last_fullsized":"2024-03-18T00:25:24.933361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360495+0000","last_change":"2024-03-18T00:25:22.524729+0000","last_active":"2024-03-18T00:25:25.360495+0000","last_peered":"2024-03-18T00:25:25.360495+0000","last_clean":"2024-03-18T00:25:25.360495+0000","last_became_active":"2024-03-18T00:25:22.524455+0000","last_became_peered":"2024-03-18T00:25:22.524455+0000","last_unstale":"2024-03-18T00:25:25.360495+0000","last_undegraded":"2024-03-18T00:25:25.360495+0000","last_fullsized":"2024-03-18T00:25:25.360495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:23.541999+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:23.541593+0000","last_became_peered":"2024-03-18T00:25:23.541593+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524819+0000","last_change":"2024-03-18T00:25:22.519877+0000","last_active":"2024-03-18T00:25:24.524819+0000","last_peered":"2024-03-18T00:25:24.524819+0000","last_clean":"2024-03-18T00:25:24.524819+0000","last_became_active":"2024-03-18T00:25:22.519396+0000","last_became_peered":"2024-03-18T00:25:22.519396+0000","last_unstale":"2024-03-18T00:25:24.524819+0000","last_undegraded":"2024-03-18T00:25:24.524819+0000","last_fullsized":"2024-03-18T00:25:24.524819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.526752+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.526434+0000","last_became_peered":"2024-03-18T00:25:23.526434+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359803+0000","last_change":"2024-03-18T00:25:22.518260+0000","last_active":"2024-03-18T00:25:25.359803+0000","last_peered":"2024-03-18T00:25:25.359803+0000","last_clean":"2024-03-18T00:25:25.359803+0000","last_became_active":"2024-03-18T00:25:22.517930+0000","last_became_peered":"2024-03-18T00:25:22.517930+0000","last_unstale":"2024-03-18T00:25:25.359803+0000","last_undegraded":"2024-03-18T00:25:25.359803+0000","last_fullsized":"2024-03-18T00:25:25.359803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359692+0000","last_change":"2024-03-18T00:25:23.541873+0000","last_active":"2024-03-18T00:25:25.359692+0000","last_peered":"2024-03-18T00:25:25.359692+0000","last_clean":"2024-03-18T00:25:25.359692+0000","last_became_active":"2024-03-18T00:25:23.541574+0000","last_became_peered":"2024-03-18T00:25:23.541574+0000","last_unstale":"2024-03-18T00:25:25.359692+0000","last_undegraded":"2024-03-18T00:25:25.359692+0000","last_fullsized":"2024-03-18T00:25:25.359692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859586+0000","last_change":"2024-03-18T00:25:22.524063+0000","last_active":"2024-03-18T00:25:24.859586+0000","last_peered":"2024-03-18T00:25:24.859586+0000","last_clean":"2024-03-18T00:25:24.859586+0000","last_became_active":"2024-03-18T00:25:22.523714+0000","last_became_peered":"2024-03-18T00:25:22.523714+0000","last_unstale":"2024-03-18T00:25:24.859586+0000","last_undegraded":"2024-03-18T00:25:24.859586+0000","last_fullsized":"2024-03-18T00:25:24.859586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360141+0000","last_change":"2024-03-18T00:25:23.542168+0000","last_active":"2024-03-18T00:25:25.360141+0000","last_peered":"2024-03-18T00:25:25.360141+0000","last_clean":"2024-03-18T00:25:25.360141+0000","last_became_active":"2024-03-18T00:25:23.541579+0000","last_became_peered":"2024-03-18T00:25:23.541579+0000","last_unstale":"2024-03-18T00:25:25.360141+0000","last_undegraded":"2024-03-18T00:25:25.360141+0000","last_fullsized":"2024-03-18T00:25:25.360141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359774+0000","last_change":"2024-03-18T00:25:22.525864+0000","last_active":"2024-03-18T00:25:25.359774+0000","last_peered":"2024-03-18T00:25:25.359774+0000","last_clean":"2024-03-18T00:25:25.359774+0000","last_became_active":"2024-03-18T00:25:22.525582+0000","last_became_peered":"2024-03-18T00:25:22.525582+0000","last_unstale":"2024-03-18T00:25:25.359774+0000","last_undegraded":"2024-03-18T00:25:25.359774+0000","last_fullsized":"2024-03-18T00:25:25.359774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360294+0000","last_change":"2024-03-18T00:25:23.542371+0000","last_active":"2024-03-18T00:25:25.360294+0000","last_peered":"2024-03-18T00:25:25.360294+0000","last_clean":"2024-03-18T00:25:25.360294+0000","last_became_active":"2024-03-18T00:25:23.542030+0000","last_became_peered":"2024-03-18T00:25:23.542030+0000","last_unstale":"2024-03-18T00:25:25.360294+0000","last_undegraded":"2024-03-18T00:25:25.360294+0000","last_fullsized":"2024-03-18T00:25:25.360294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:34:40.152850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527312+0000","last_change":"2024-03-18T00:25:22.527178+0000","last_active":"2024-03-18T00:25:24.527312+0000","last_peered":"2024-03-18T00:25:24.527312+0000","last_clean":"2024-03-18T00:25:24.527312+0000","last_became_active":"2024-03-18T00:25:22.526891+0000","last_became_peered":"2024-03-18T00:25:22.526891+0000","last_unstale":"2024-03-18T00:25:24.527312+0000","last_undegraded":"2024-03-18T00:25:24.527312+0000","last_fullsized":"2024-03-18T00:25:24.527312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360509+0000","last_change":"2024-03-18T00:25:23.537093+0000","last_active":"2024-03-18T00:25:25.360509+0000","last_peered":"2024-03-18T00:25:25.360509+0000","last_clean":"2024-03-18T00:25:25.360509+0000","last_became_active":"2024-03-18T00:25:23.536816+0000","last_became_peered":"2024-03-18T00:25:23.536816+0000","last_unstale":"2024-03-18T00:25:25.360509+0000","last_undegraded":"2024-03-18T00:25:25.360509+0000","last_fullsized":"2024-03-18T00:25:25.360509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359667+0000","last_change":"2024-03-18T00:25:22.522241+0000","last_active":"2024-03-18T00:25:25.359667+0000","last_peered":"2024-03-18T00:25:25.359667+0000","last_clean":"2024-03-18T00:25:25.359667+0000","last_became_active":"2024-03-18T00:25:22.521959+0000","last_became_peered":"2024-03-18T00:25:22.521959+0000","last_unstale":"2024-03-18T00:25:25.359667+0000","last_undegraded":"2024-03-18T00:25:25.359667+0000","last_fullsized":"2024-03-18T00:25:25.359667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360544+0000","last_change":"2024-03-18T00:25:23.533012+0000","last_active":"2024-03-18T00:25:25.360544+0000","last_peered":"2024-03-18T00:25:25.360544+0000","last_clean":"2024-03-18T00:25:25.360544+0000","last_became_active":"2024-03-18T00:25:23.532746+0000","last_became_peered":"2024-03-18T00:25:23.532746+0000","last_unstale":"2024-03-18T00:25:25.360544+0000","last_undegraded":"2024-03-18T00:25:25.360544+0000","last_fullsized":"2024-03-18T00:25:25.360544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:06:47.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359515+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:25.359515+0000","last_peered":"2024-03-18T00:25:25.359515+0000","last_clean":"2024-03-18T00:25:25.359515+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:25.359515+0000","last_undegraded":"2024-03-18T00:25:25.359515+0000","last_fullsized":"2024-03-18T00:25:25.359515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:22.518151+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:22.517836+0000","last_became_peered":"2024-03-18T00:25:22.517836+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524976+0000","last_change":"2024-03-18T00:25:23.542819+0000","last_active":"2024-03-18T00:25:24.524976+0000","last_peered":"2024-03-18T00:25:24.524976+0000","last_clean":"2024-03-18T00:25:24.524976+0000","last_became_active":"2024-03-18T00:25:23.541993+0000","last_became_peered":"2024-03-18T00:25:23.541993+0000","last_unstale":"2024-03-18T00:25:24.524976+0000","last_undegraded":"2024-03-18T00:25:24.524976+0000","last_fullsized":"2024-03-18T00:25:24.524976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359453+0000","last_change":"2024-03-18T00:25:22.526454+0000","last_active":"2024-03-18T00:25:25.359453+0000","last_peered":"2024-03-18T00:25:25.359453+0000","last_clean":"2024-03-18T00:25:25.359453+0000","last_became_active":"2024-03-18T00:25:22.525824+0000","last_became_peered":"2024-03-18T00:25:22.525824+0000","last_unstale":"2024-03-18T00:25:25.359453+0000","last_undegraded":"2024-03-18T00:25:25.359453+0000","last_fullsized":"2024-03-18T00:25:25.359453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:36.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933234+0000","last_change":"2024-03-18T00:25:23.533610+0000","last_active":"2024-03-18T00:25:24.933234+0000","last_peered":"2024-03-18T00:25:24.933234+0000","last_clean":"2024-03-18T00:25:24.933234+0000","last_became_active":"2024-03-18T00:25:23.531816+0000","last_became_peered":"2024-03-18T00:25:23.531816+0000","last_unstale":"2024-03-18T00:25:24.933234+0000","last_undegraded":"2024-03-18T00:25:24.933234+0000","last_fullsized":"2024-03-18T00:25:24.933234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:51:00.174852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359686+0000","last_change":"2024-03-18T00:25:22.524836+0000","last_active":"2024-03-18T00:25:25.359686+0000","last_peered":"2024-03-18T00:25:25.359686+0000","last_clean":"2024-03-18T00:25:25.359686+0000","last_became_active":"2024-03-18T00:25:22.524559+0000","last_became_peered":"2024-03-18T00:25:22.524559+0000","last_unstale":"2024-03-18T00:25:25.359686+0000","last_undegraded":"2024-03-18T00:25:25.359686+0000","last_fullsized":"2024-03-18T00:25:25.359686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526935+0000","last_change":"2024-03-18T00:25:23.530154+0000","last_active":"2024-03-18T00:25:24.526935+0000","last_peered":"2024-03-18T00:25:24.526935+0000","last_clean":"2024-03-18T00:25:24.526935+0000","last_became_active":"2024-03-18T00:25:23.529909+0000","last_became_peered":"2024-03-18T00:25:23.529909+0000","last_unstale":"2024-03-18T00:25:24.526935+0000","last_undegraded":"2024-03-18T00:25:24.526935+0000","last_fullsized":"2024-03-18T00:25:24.526935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360581+0000","last_change":"2024-03-18T00:25:22.522580+0000","last_active":"2024-03-18T00:25:25.360581+0000","last_peered":"2024-03-18T00:25:25.360581+0000","last_clean":"2024-03-18T00:25:25.360581+0000","last_became_active":"2024-03-18T00:25:22.522157+0000","last_became_peered":"2024-03-18T00:25:22.522157+0000","last_unstale":"2024-03-18T00:25:25.360581+0000","last_undegraded":"2024-03-18T00:25:25.360581+0000","last_fullsized":"2024-03-18T00:25:25.360581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859361+0000","last_change":"2024-03-18T00:25:23.539763+0000","last_active":"2024-03-18T00:25:24.859361+0000","last_peered":"2024-03-18T00:25:24.859361+0000","last_clean":"2024-03-18T00:25:24.859361+0000","last_became_active":"2024-03-18T00:25:23.539502+0000","last_became_peered":"2024-03-18T00:25:23.539502+0000","last_unstale":"2024-03-18T00:25:24.859361+0000","last_undegraded":"2024-03-18T00:25:24.859361+0000","last_fullsized":"2024-03-18T00:25:24.859361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527211+0000","last_change":"2024-03-18T00:25:22.520229+0000","last_active":"2024-03-18T00:25:24.527211+0000","last_peered":"2024-03-18T00:25:24.527211+0000","last_clean":"2024-03-18T00:25:24.527211+0000","last_became_active":"2024-03-18T00:25:22.519955+0000","last_became_peered":"2024-03-18T00:25:22.519955+0000","last_unstale":"2024-03-18T00:25:24.527211+0000","last_undegraded":"2024-03-18T00:25:24.527211+0000","last_fullsized":"2024-03-18T00:25:24.527211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360629+0000","last_change":"2024-03-18T00:25:23.538375+0000","last_active":"2024-03-18T00:25:25.360629+0000","last_peered":"2024-03-18T00:25:25.360629+0000","last_clean":"2024-03-18T00:25:25.360629+0000","last_became_active":"2024-03-18T00:25:23.538114+0000","last_became_peered":"2024-03-18T00:25:23.538114+0000","last_unstale":"2024-03-18T00:25:25.360629+0000","last_undegraded":"2024-03-18T00:25:25.360629+0000","last_fullsized":"2024-03-18T00:25:25.360629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360706+0000","last_change":"2024-03-18T00:25:22.527522+0000","last_active":"2024-03-18T00:25:25.360706+0000","last_peered":"2024-03-18T00:25:25.360706+0000","last_clean":"2024-03-18T00:25:25.360706+0000","last_became_active":"2024-03-18T00:25:22.527170+0000","last_became_peered":"2024-03-18T00:25:22.527170+0000","last_unstale":"2024-03-18T00:25:25.360706+0000","last_undegraded":"2024-03-18T00:25:25.360706+0000","last_fullsized":"2024-03-18T00:25:25.360706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:50:59.169893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527236+0000","last_change":"2024-03-18T00:25:23.529557+0000","last_active":"2024-03-18T00:25:24.527236+0000","last_peered":"2024-03-18T00:25:24.527236+0000","last_clean":"2024-03-18T00:25:24.527236+0000","last_became_active":"2024-03-18T00:25:23.529316+0000","last_became_peered":"2024-03-18T00:25:23.529316+0000","last_unstale":"2024-03-18T00:25:24.527236+0000","last_undegraded":"2024-03-18T00:25:24.527236+0000","last_fullsized":"2024-03-18T00:25:24.527236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.528528+0000","last_change":"2024-03-18T00:25:22.520956+0000","last_active":"2024-03-18T00:25:24.528528+0000","last_peered":"2024-03-18T00:25:24.528528+0000","last_clean":"2024-03-18T00:25:24.528528+0000","last_became_active":"2024-03-18T00:25:22.520708+0000","last_became_peered":"2024-03-18T00:25:22.520708+0000","last_unstale":"2024-03-18T00:25:24.528528+0000","last_undegraded":"2024-03-18T00:25:24.528528+0000","last_fullsized":"2024-03-18T00:25:24.528528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525346+0000","last_change":"2024-03-18T00:25:23.543671+0000","last_active":"2024-03-18T00:25:24.525346+0000","last_peered":"2024-03-18T00:25:24.525346+0000","last_clean":"2024-03-18T00:25:24.525346+0000","last_became_active":"2024-03-18T00:25:23.543393+0000","last_became_peered":"2024-03-18T00:25:23.543393+0000","last_unstale":"2024-03-18T00:25:24.525346+0000","last_undegraded":"2024-03-18T00:25:24.525346+0000","last_fullsized":"2024-03-18T00:25:24.525346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525281+0000","last_change":"2024-03-18T00:25:22.521876+0000","last_active":"2024-03-18T00:25:24.525281+0000","last_peered":"2024-03-18T00:25:24.525281+0000","last_clean":"2024-03-18T00:25:24.525281+0000","last_became_active":"2024-03-18T00:25:22.521555+0000","last_became_peered":"2024-03-18T00:25:22.521555+0000","last_unstale":"2024-03-18T00:25:24.525281+0000","last_undegraded":"2024-03-18T00:25:24.525281+0000","last_fullsized":"2024-03-18T00:25:24.525281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933490+0000","last_change":"2024-03-18T00:25:23.528031+0000","last_active":"2024-03-18T00:25:24.933490+0000","last_peered":"2024-03-18T00:25:24.933490+0000","last_clean":"2024-03-18T00:25:24.933490+0000","last_became_active":"2024-03-18T00:25:23.527711+0000","last_became_peered":"2024-03-18T00:25:23.527711+0000","last_unstale":"2024-03-18T00:25:24.933490+0000","last_undegraded":"2024-03-18T00:25:24.933490+0000","last_fullsized":"2024-03-18T00:25:24.933490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359454+0000","last_change":"2024-03-18T00:25:22.526660+0000","last_active":"2024-03-18T00:25:25.359454+0000","last_peered":"2024-03-18T00:25:25.359454+0000","last_clean":"2024-03-18T00:25:25.359454+0000","last_became_active":"2024-03-18T00:25:22.526187+0000","last_became_peered":"2024-03-18T00:25:22.526187+0000","last_unstale":"2024-03-18T00:25:25.359454+0000","last_undegraded":"2024-03-18T00:25:25.359454+0000","last_fullsized":"2024-03-18T00:25:25.359454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859319+0000","last_change":"2024-03-18T00:25:23.532831+0000","last_active":"2024-03-18T00:25:24.859319+0000","last_peered":"2024-03-18T00:25:24.859319+0000","last_clean":"2024-03-18T00:25:24.859319+0000","last_became_active":"2024-03-18T00:25:23.532560+0000","last_became_peered":"2024-03-18T00:25:23.532560+0000","last_unstale":"2024-03-18T00:25:24.859319+0000","last_undegraded":"2024-03-18T00:25:24.859319+0000","last_fullsized":"2024-03-18T00:25:24.859319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:53.916378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527047+0000","last_change":"2024-03-18T00:25:22.519545+0000","last_active":"2024-03-18T00:25:24.527047+0000","last_peered":"2024-03-18T00:25:24.527047+0000","last_clean":"2024-03-18T00:25:24.527047+0000","last_became_active":"2024-03-18T00:25:22.519310+0000","last_became_peered":"2024-03-18T00:25:22.519310+0000","last_unstale":"2024-03-18T00:25:24.527047+0000","last_undegraded":"2024-03-18T00:25:24.527047+0000","last_fullsized":"2024-03-18T00:25:24.527047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524965+0000","last_change":"2024-03-18T00:25:23.537154+0000","last_active":"2024-03-18T00:25:24.524965+0000","last_peered":"2024-03-18T00:25:24.524965+0000","last_clean":"2024-03-18T00:25:24.524965+0000","last_became_active":"2024-03-18T00:25:23.536652+0000","last_became_peered":"2024-03-18T00:25:23.536652+0000","last_unstale":"2024-03-18T00:25:24.524965+0000","last_undegraded":"2024-03-18T00:25:24.524965+0000","last_fullsized":"2024-03-18T00:25:24.524965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527167+0000","last_change":"2024-03-18T00:25:22.526658+0000","last_active":"2024-03-18T00:25:24.527167+0000","last_peered":"2024-03-18T00:25:24.527167+0000","last_clean":"2024-03-18T00:25:24.527167+0000","last_became_active":"2024-03-18T00:25:22.526284+0000","last_became_peered":"2024-03-18T00:25:22.526284+0000","last_unstale":"2024-03-18T00:25:24.527167+0000","last_undegraded":"2024-03-18T00:25:24.527167+0000","last_fullsized":"2024-03-18T00:25:24.527167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525137+0000","last_change":"2024-03-18T00:25:23.537415+0000","last_active":"2024-03-18T00:25:24.525137+0000","last_peered":"2024-03-18T00:25:24.525137+0000","last_clean":"2024-03-18T00:25:24.525137+0000","last_became_active":"2024-03-18T00:25:23.537145+0000","last_became_peered":"2024-03-18T00:25:23.537145+0000","last_unstale":"2024-03-18T00:25:24.525137+0000","last_undegraded":"2024-03-18T00:25:24.525137+0000","last_fullsized":"2024-03-18T00:25:24.525137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359988+0000","last_change":"2024-03-18T00:25:22.525503+0000","last_active":"2024-03-18T00:25:25.359988+0000","last_peered":"2024-03-18T00:25:25.359988+0000","last_clean":"2024-03-18T00:25:25.359988+0000","last_became_active":"2024-03-18T00:25:22.525243+0000","last_became_peered":"2024-03-18T00:25:22.525243+0000","last_unstale":"2024-03-18T00:25:25.359988+0000","last_undegraded":"2024-03-18T00:25:25.359988+0000","last_fullsized":"2024-03-18T00:25:25.359988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:47.316817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.530235+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.529957+0000","last_became_peered":"2024-03-18T00:25:23.529957+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360510+0000","last_change":"2024-03-18T00:25:23.542945+0000","last_active":"2024-03-18T00:25:25.360510+0000","last_peered":"2024-03-18T00:25:25.360510+0000","last_clean":"2024-03-18T00:25:25.360510+0000","last_became_active":"2024-03-18T00:25:23.541198+0000","last_became_peered":"2024-03-18T00:25:23.541198+0000","last_unstale":"2024-03-18T00:25:25.360510+0000","last_undegraded":"2024-03-18T00:25:25.360510+0000","last_fullsized":"2024-03-18T00:25:25.360510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359960+0000","last_change":"2024-03-18T00:25:22.524744+0000","last_active":"2024-03-18T00:25:25.359960+0000","last_peered":"2024-03-18T00:25:25.359960+0000","last_clean":"2024-03-18T00:25:25.359960+0000","last_became_active":"2024-03-18T00:25:22.524471+0000","last_became_peered":"2024-03-18T00:25:22.524471+0000","last_unstale":"2024-03-18T00:25:25.359960+0000","last_undegraded":"2024-03-18T00:25:25.359960+0000","last_fullsized":"2024-03-18T00:25:25.359960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:13.824065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360483+0000","last_change":"2024-03-18T00:25:23.535099+0000","last_active":"2024-03-18T00:25:25.360483+0000","last_peered":"2024-03-18T00:25:25.360483+0000","last_clean":"2024-03-18T00:25:25.360483+0000","last_became_active":"2024-03-18T00:25:23.534782+0000","last_became_peered":"2024-03-18T00:25:23.534782+0000","last_unstale":"2024-03-18T00:25:25.360483+0000","last_undegraded":"2024-03-18T00:25:25.360483+0000","last_fullsized":"2024-03-18T00:25:25.360483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360610+0000","last_change":"2024-03-18T00:25:22.524438+0000","last_active":"2024-03-18T00:25:25.360610+0000","last_peered":"2024-03-18T00:25:25.360610+0000","last_clean":"2024-03-18T00:25:25.360610+0000","last_became_active":"2024-03-18T00:25:22.524084+0000","last_became_peered":"2024-03-18T00:25:22.524084+0000","last_unstale":"2024-03-18T00:25:25.360610+0000","last_undegraded":"2024-03-18T00:25:25.360610+0000","last_fullsized":"2024-03-18T00:25:25.360610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:28:12.762540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933449+0000","last_change":"2024-03-18T00:25:23.529284+0000","last_active":"2024-03-18T00:25:24.933449+0000","last_peered":"2024-03-18T00:25:24.933449+0000","last_clean":"2024-03-18T00:25:24.933449+0000","last_became_active":"2024-03-18T00:25:23.529022+0000","last_became_peered":"2024-03-18T00:25:23.529022+0000","last_unstale":"2024-03-18T00:25:24.933449+0000","last_undegraded":"2024-03-18T00:25:24.933449+0000","last_fullsized":"2024-03-18T00:25:24.933449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525414+0000","last_change":"2024-03-18T00:25:22.524838+0000","last_active":"2024-03-18T00:25:24.525414+0000","last_peered":"2024-03-18T00:25:24.525414+0000","last_clean":"2024-03-18T00:25:24.525414+0000","last_became_active":"2024-03-18T00:25:22.524532+0000","last_became_peered":"2024-03-18T00:25:22.524532+0000","last_unstale":"2024-03-18T00:25:24.525414+0000","last_undegraded":"2024-03-18T00:25:24.525414+0000","last_fullsized":"2024-03-18T00:25:24.525414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525427+0000","last_change":"2024-03-18T00:25:23.541815+0000","last_active":"2024-03-18T00:25:24.525427+0000","last_peered":"2024-03-18T00:25:24.525427+0000","last_clean":"2024-03-18T00:25:24.525427+0000","last_became_active":"2024-03-18T00:25:23.541486+0000","last_became_peered":"2024-03-18T00:25:23.541486+0000","last_unstale":"2024-03-18T00:25:24.525427+0000","last_undegraded":"2024-03-18T00:25:24.525427+0000","last_fullsized":"2024-03-18T00:25:24.525427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933609+0000","last_change":"2024-03-18T00:25:22.520313+0000","last_active":"2024-03-18T00:25:24.933609+0000","last_peered":"2024-03-18T00:25:24.933609+0000","last_clean":"2024-03-18T00:25:24.933609+0000","last_became_active":"2024-03-18T00:25:22.520019+0000","last_became_peered":"2024-03-18T00:25:22.520019+0000","last_unstale":"2024-03-18T00:25:24.933609+0000","last_undegraded":"2024-03-18T00:25:24.933609+0000","last_fullsized":"2024-03-18T00:25:24.933609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:33.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:25:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.080+0000 7f324ae34640 1 Processor -- start 2024-03-18T00:25:34.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.080+0000 7f324ae34640 1 -- start start 2024-03-18T00:25:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f324ae34640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 0x7f32440d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f324ae34640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 0x7f32440af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f324ae34640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32440cd510 con 0x7f324415c3a0 2024-03-18T00:25:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f324ae34640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f32440cd7f0 con 0x7f32440cef80 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f324ae34640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f32440cdad0 con 0x7f324415c780 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f3248bd0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f324415c3a0 0x7f32440ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55828/0 (socket says 172.21.15.81:55828) 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f3248bd0640 1 -- 172.21.15.81:0/625102578 learned_addr learned my addr 172.21.15.81:0/625102578 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f3243fff640 1 --2- 172.21.15.81:0/625102578 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 0x7f32440d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.081+0000 7f32493d1640 1 --2- 172.21.15.81:0/625102578 >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 0x7f32440af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f32437fe640 1 -- 172.21.15.81:0/625102578 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 328441186 0 0) 0x7f32440cd510 con 0x7f324415c3a0 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f32437fe640 1 -- 172.21.15.81:0/625102578 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f322c003520 con 0x7f324415c3a0 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f3243fff640 1 -- 172.21.15.81:0/625102578 >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 msgr2=0x7f32440af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f3243fff640 1 --2- 172.21.15.81:0/625102578 >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 0x7f32440af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f3243fff640 1 -- 172.21.15.81:0/625102578 >> v1:172.21.15.81:6789/0 conn(0x7f324415c3a0 legacy=0x7f32440ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f3243fff640 1 -- 172.21.15.81:0/625102578 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32440cddb0 con 0x7f324415c780 2024-03-18T00:25:34.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.082+0000 7f32493d1640 1 --2- 172.21.15.81:0/625102578 >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 0x7f32440af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f3243fff640 1 --2- 172.21.15.81:0/625102578 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 0x7f32440d2980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32380097a0 tx=0x7f323802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27cd0c1cee790382 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f32437fe640 1 -- 172.21.15.81:0/625102578 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238035020 con 0x7f324415c780 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f32437fe640 1 -- 172.21.15.81:0/625102578 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3238031830 con 0x7f324415c780 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f32437fe640 1 -- 172.21.15.81:0/625102578 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3238031be0 con 0x7f324415c780 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 -- 172.21.15.81:0/625102578 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 msgr2=0x7f32440d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 --2- 172.21.15.81:0/625102578 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 0x7f32440d2980 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32380097a0 tx=0x7f323802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 -- 172.21.15.81:0/625102578 shutdown_connections 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 --2- 172.21.15.81:0/625102578 >> v2:172.21.15.136:3300/0 conn(0x7f32440cef80 0x7f32440af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 --2- 172.21.15.81:0/625102578 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c780 0x7f32440d2980 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 -- 172.21.15.81:0/625102578 >> 172.21.15.81:0/625102578 conn(0x7f32440d1e60 msgr2=0x7f32440d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 -- 172.21.15.81:0/625102578 shutdown_connections 2024-03-18T00:25:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.083+0000 7f324ae34640 1 -- 172.21.15.81:0/625102578 wait complete. 2024-03-18T00:25:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.084+0000 7f324ae34640 1 Processor -- start 2024-03-18T00:25:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.084+0000 7f324ae34640 1 -- start start 2024-03-18T00:25:34.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c3a0 0x7f32441f51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 0x7f32440b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32440cf590 con 0x7f32440cef80 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f32440cf410 con 0x7f324415c780 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f324ae34640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f32440af540 con 0x7f324415c3a0 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f3248bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f3248bd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59578/0 (socket says 172.21.15.81:59578) 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.085+0000 7f3248bd0640 1 -- 172.21.15.81:0/689350759 learned_addr learned my addr 172.21.15.81:0/689350759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3243fff640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c3a0 0x7f32441f51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f32493d1640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 0x7f32440b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 -- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c3a0 msgr2=0x7f32441f51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c3a0 0x7f32441f51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 -- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 msgr2=0x7f32440b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 0x7f32440b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 -- 172.21.15.81:0/689350759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32441f5bc0 con 0x7f32440cef80 2024-03-18T00:25:34.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f32493d1640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 0x7f32440b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f3248bd0640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f323400c430 tx=0x7f323400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234017070 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3234005ce0 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32441f5ea0 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32340072f0 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.086+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32440c93b0 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.087+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324404f5b0 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.087+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f323401a070 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.088+0000 7f32417fa640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 0x7f323006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.088+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3234089f00 con 0x7f32440cef80 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.088+0000 7f3243fff640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 0x7f323006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.088+0000 7f3243fff640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 0x7f323006e090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3238036000 tx=0x7f323803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.092+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3234058340 con 0x7f32440cef80 2024-03-18T00:25:34.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.264+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32440ce370 con 0x7f323006bbd0 2024-03-18T00:25:34.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.270+0000 7f32417fa640 1 -- 172.21.15.81:0/689350759 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251836 (secure 0 0 0) 0x7f32440ce370 con 0x7f323006bbd0 2024-03-18T00:25:34.273 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:34.274 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:25:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 msgr2=0x7f323006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 0x7f323006e090 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3238036000 tx=0x7f323803c040 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 msgr2=0x7f32441536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f323400c430 tx=0x7f323400c8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 shutdown_connections 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f324415c780 0x7f32440b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f324415c3a0 0x7f32441f51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f323006bbd0 0x7f323006e090 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 --2- 172.21.15.81:0/689350759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32440cef80 0x7f32441536c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 >> 172.21.15.81:0/689350759 conn(0x7f32440d1e60 msgr2=0x7f32440c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 shutdown_connections 2024-03-18T00:25:34.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.273+0000 7f324ae34640 1 -- 172.21.15.81:0/689350759 wait complete. 2024-03-18T00:25:34.284 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-18T00:25:33.360778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218992,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755728,"statfs":{"total":773094113280,"available":772869865472,"internally_reserved":0,"allocated":2891776,"data_stored":1753028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.846544"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360165+0000","last_change":"2024-03-18T00:25:23.535915+0000","last_active":"2024-03-18T00:25:25.360165+0000","last_peered":"2024-03-18T00:25:25.360165+0000","last_clean":"2024-03-18T00:25:25.360165+0000","last_became_active":"2024-03-18T00:25:23.535620+0000","last_became_peered":"2024-03-18T00:25:23.535620+0000","last_unstale":"2024-03-18T00:25:25.360165+0000","last_undegraded":"2024-03-18T00:25:25.360165+0000","last_fullsized":"2024-03-18T00:25:25.360165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527350+0000","last_change":"2024-03-18T00:25:23.526470+0000","last_active":"2024-03-18T00:25:24.527350+0000","last_peered":"2024-03-18T00:25:24.527350+0000","last_clean":"2024-03-18T00:25:24.527350+0000","last_became_active":"2024-03-18T00:25:23.526181+0000","last_became_peered":"2024-03-18T00:25:23.526181+0000","last_unstale":"2024-03-18T00:25:24.527350+0000","last_undegraded":"2024-03-18T00:25:24.527350+0000","last_fullsized":"2024-03-18T00:25:24.527350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933336+0000","last_change":"2024-03-18T00:25:23.529914+0000","last_active":"2024-03-18T00:25:24.933336+0000","last_peered":"2024-03-18T00:25:24.933336+0000","last_clean":"2024-03-18T00:25:24.933336+0000","last_became_active":"2024-03-18T00:25:23.529601+0000","last_became_peered":"2024-03-18T00:25:23.529601+0000","last_unstale":"2024-03-18T00:25:24.933336+0000","last_undegraded":"2024-03-18T00:25:24.933336+0000","last_fullsized":"2024-03-18T00:25:24.933336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:42:59.751721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360378+0000","last_change":"2024-03-18T00:25:23.543302+0000","last_active":"2024-03-18T00:25:25.360378+0000","last_peered":"2024-03-18T00:25:25.360378+0000","last_clean":"2024-03-18T00:25:25.360378+0000","last_became_active":"2024-03-18T00:25:23.542926+0000","last_became_peered":"2024-03-18T00:25:23.542926+0000","last_unstale":"2024-03-18T00:25:25.360378+0000","last_undegraded":"2024-03-18T00:25:25.360378+0000","last_fullsized":"2024-03-18T00:25:25.360378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360045+0000","last_change":"2024-03-18T00:25:23.539758+0000","last_active":"2024-03-18T00:25:25.360045+0000","last_peered":"2024-03-18T00:25:25.360045+0000","last_clean":"2024-03-18T00:25:25.360045+0000","last_became_active":"2024-03-18T00:25:23.537575+0000","last_became_peered":"2024-03-18T00:25:23.537575+0000","last_unstale":"2024-03-18T00:25:25.360045+0000","last_undegraded":"2024-03-18T00:25:25.360045+0000","last_fullsized":"2024-03-18T00:25:25.360045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360144+0000","last_change":"2024-03-18T00:25:23.528725+0000","last_active":"2024-03-18T00:25:25.360144+0000","last_peered":"2024-03-18T00:25:25.360144+0000","last_clean":"2024-03-18T00:25:25.360144+0000","last_became_active":"2024-03-18T00:25:23.528456+0000","last_became_peered":"2024-03-18T00:25:23.528456+0000","last_unstale":"2024-03-18T00:25:25.360144+0000","last_undegraded":"2024-03-18T00:25:25.360144+0000","last_fullsized":"2024-03-18T00:25:25.360144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359549+0000","last_change":"2024-03-18T00:25:23.532811+0000","last_active":"2024-03-18T00:25:25.359549+0000","last_peered":"2024-03-18T00:25:25.359549+0000","last_clean":"2024-03-18T00:25:25.359549+0000","last_became_active":"2024-03-18T00:25:23.530841+0000","last_became_peered":"2024-03-18T00:25:23.530841+0000","last_unstale":"2024-03-18T00:25:25.359549+0000","last_undegraded":"2024-03-18T00:25:25.359549+0000","last_fullsized":"2024-03-18T00:25:25.359549+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524831+0000","last_change":"2024-03-18T00:25:23.536908+0000","last_active":"2024-03-18T00:25:24.524831+0000","last_peered":"2024-03-18T00:25:24.524831+0000","last_clean":"2024-03-18T00:25:24.524831+0000","last_became_active":"2024-03-18T00:25:23.536369+0000","last_became_peered":"2024-03-18T00:25:23.536369+0000","last_unstale":"2024-03-18T00:25:24.524831+0000","last_undegraded":"2024-03-18T00:25:24.524831+0000","last_fullsized":"2024-03-18T00:25:24.524831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360205+0000","last_change":"2024-03-18T00:25:23.535358+0000","last_active":"2024-03-18T00:25:25.360205+0000","last_peered":"2024-03-18T00:25:25.360205+0000","last_clean":"2024-03-18T00:25:25.360205+0000","last_became_active":"2024-03-18T00:25:23.535099+0000","last_became_peered":"2024-03-18T00:25:23.535099+0000","last_unstale":"2024-03-18T00:25:25.360205+0000","last_undegraded":"2024-03-18T00:25:25.360205+0000","last_fullsized":"2024-03-18T00:25:25.360205+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525233+0000","last_change":"2024-03-18T00:25:23.524721+0000","last_active":"2024-03-18T00:25:24.525233+0000","last_peered":"2024-03-18T00:25:24.525233+0000","last_clean":"2024-03-18T00:25:24.525233+0000","last_became_active":"2024-03-18T00:25:23.524434+0000","last_became_peered":"2024-03-18T00:25:23.524434+0000","last_unstale":"2024-03-18T00:25:24.525233+0000","last_undegraded":"2024-03-18T00:25:24.525233+0000","last_fullsized":"2024-03-18T00:25:24.525233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525031+0000","last_change":"2024-03-18T00:25:23.525372+0000","last_active":"2024-03-18T00:25:24.525031+0000","last_peered":"2024-03-18T00:25:24.525031+0000","last_clean":"2024-03-18T00:25:24.525031+0000","last_became_active":"2024-03-18T00:25:23.524989+0000","last_became_peered":"2024-03-18T00:25:23.524989+0000","last_unstale":"2024-03-18T00:25:24.525031+0000","last_undegraded":"2024-03-18T00:25:24.525031+0000","last_fullsized":"2024-03-18T00:25:24.525031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859513+0000","last_change":"2024-03-18T00:25:23.536156+0000","last_active":"2024-03-18T00:25:24.859513+0000","last_peered":"2024-03-18T00:25:24.859513+0000","last_clean":"2024-03-18T00:25:24.859513+0000","last_became_active":"2024-03-18T00:25:23.535858+0000","last_became_peered":"2024-03-18T00:25:23.535858+0000","last_unstale":"2024-03-18T00:25:24.859513+0000","last_undegraded":"2024-03-18T00:25:24.859513+0000","last_fullsized":"2024-03-18T00:25:24.859513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524955+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.524955+0000","last_peered":"2024-03-18T00:25:24.524955+0000","last_clean":"2024-03-18T00:25:24.524955+0000","last_became_active":"2024-03-18T00:25:23.537444+0000","last_became_peered":"2024-03-18T00:25:23.537444+0000","last_unstale":"2024-03-18T00:25:24.524955+0000","last_undegraded":"2024-03-18T00:25:24.524955+0000","last_fullsized":"2024-03-18T00:25:24.524955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933313+0000","last_change":"2024-03-18T00:25:23.528214+0000","last_active":"2024-03-18T00:25:24.933313+0000","last_peered":"2024-03-18T00:25:24.933313+0000","last_clean":"2024-03-18T00:25:24.933313+0000","last_became_active":"2024-03-18T00:25:23.527939+0000","last_became_peered":"2024-03-18T00:25:23.527939+0000","last_unstale":"2024-03-18T00:25:24.933313+0000","last_undegraded":"2024-03-18T00:25:24.933313+0000","last_fullsized":"2024-03-18T00:25:24.933313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:48.321776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527062+0000","last_change":"2024-03-18T00:25:23.539451+0000","last_active":"2024-03-18T00:25:24.527062+0000","last_peered":"2024-03-18T00:25:24.527062+0000","last_clean":"2024-03-18T00:25:24.527062+0000","last_became_active":"2024-03-18T00:25:23.539183+0000","last_became_peered":"2024-03-18T00:25:23.539183+0000","last_unstale":"2024-03-18T00:25:24.527062+0000","last_undegraded":"2024-03-18T00:25:24.527062+0000","last_fullsized":"2024-03-18T00:25:24.527062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359583+0000","last_change":"2024-03-18T00:25:23.529121+0000","last_active":"2024-03-18T00:25:25.359583+0000","last_peered":"2024-03-18T00:25:25.359583+0000","last_clean":"2024-03-18T00:25:25.359583+0000","last_became_active":"2024-03-18T00:25:23.528826+0000","last_became_peered":"2024-03-18T00:25:23.528826+0000","last_unstale":"2024-03-18T00:25:25.359583+0000","last_undegraded":"2024-03-18T00:25:25.359583+0000","last_fullsized":"2024-03-18T00:25:25.359583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360000+0000","last_change":"2024-03-18T00:25:23.532218+0000","last_active":"2024-03-18T00:25:25.360000+0000","last_peered":"2024-03-18T00:25:25.360000+0000","last_clean":"2024-03-18T00:25:25.360000+0000","last_became_active":"2024-03-18T00:25:23.531962+0000","last_became_peered":"2024-03-18T00:25:23.531962+0000","last_unstale":"2024-03-18T00:25:25.360000+0000","last_undegraded":"2024-03-18T00:25:25.360000+0000","last_fullsized":"2024-03-18T00:25:25.360000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359804+0000","last_change":"2024-03-18T00:25:23.531016+0000","last_active":"2024-03-18T00:25:25.359804+0000","last_peered":"2024-03-18T00:25:25.359804+0000","last_clean":"2024-03-18T00:25:25.359804+0000","last_became_active":"2024-03-18T00:25:23.530710+0000","last_became_peered":"2024-03-18T00:25:23.530710+0000","last_unstale":"2024-03-18T00:25:25.359804+0000","last_undegraded":"2024-03-18T00:25:25.359804+0000","last_fullsized":"2024-03-18T00:25:25.359804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:37.646881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360675+0000","last_change":"2024-03-18T00:25:23.532105+0000","last_active":"2024-03-18T00:25:25.360675+0000","last_peered":"2024-03-18T00:25:25.360675+0000","last_clean":"2024-03-18T00:25:25.360675+0000","last_became_active":"2024-03-18T00:25:23.531767+0000","last_became_peered":"2024-03-18T00:25:23.531767+0000","last_unstale":"2024-03-18T00:25:25.360675+0000","last_undegraded":"2024-03-18T00:25:25.360675+0000","last_fullsized":"2024-03-18T00:25:25.360675+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:03.624129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525483+0000","last_change":"2024-03-18T00:25:23.535568+0000","last_active":"2024-03-18T00:25:24.525483+0000","last_peered":"2024-03-18T00:25:24.525483+0000","last_clean":"2024-03-18T00:25:24.525483+0000","last_became_active":"2024-03-18T00:25:23.535301+0000","last_became_peered":"2024-03-18T00:25:23.535301+0000","last_unstale":"2024-03-18T00:25:24.525483+0000","last_undegraded":"2024-03-18T00:25:24.525483+0000","last_fullsized":"2024-03-18T00:25:24.525483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.531923+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.531605+0000","last_became_peered":"2024-03-18T00:25:23.531605+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360278+0000","last_change":"2024-03-18T00:25:23.540875+0000","last_active":"2024-03-18T00:25:25.360278+0000","last_peered":"2024-03-18T00:25:25.360278+0000","last_clean":"2024-03-18T00:25:25.360278+0000","last_became_active":"2024-03-18T00:25:23.540621+0000","last_became_peered":"2024-03-18T00:25:23.540621+0000","last_unstale":"2024-03-18T00:25:25.360278+0000","last_undegraded":"2024-03-18T00:25:25.360278+0000","last_fullsized":"2024-03-18T00:25:25.360278+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524925+0000","last_change":"2024-03-18T00:25:23.540944+0000","last_active":"2024-03-18T00:25:24.524925+0000","last_peered":"2024-03-18T00:25:24.524925+0000","last_clean":"2024-03-18T00:25:24.524925+0000","last_became_active":"2024-03-18T00:25:23.540662+0000","last_became_peered":"2024-03-18T00:25:23.540662+0000","last_unstale":"2024-03-18T00:25:24.524925+0000","last_undegraded":"2024-03-18T00:25:24.524925+0000","last_fullsized":"2024-03-18T00:25:24.524925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359780+0000","last_change":"2024-03-18T00:25:23.538366+0000","last_active":"2024-03-18T00:25:25.359780+0000","last_peered":"2024-03-18T00:25:25.359780+0000","last_clean":"2024-03-18T00:25:25.359780+0000","last_became_active":"2024-03-18T00:25:23.538091+0000","last_became_peered":"2024-03-18T00:25:23.538091+0000","last_unstale":"2024-03-18T00:25:25.359780+0000","last_undegraded":"2024-03-18T00:25:25.359780+0000","last_fullsized":"2024-03-18T00:25:25.359780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525286+0000","last_change":"2024-03-18T00:25:23.539971+0000","last_active":"2024-03-18T00:25:24.525286+0000","last_peered":"2024-03-18T00:25:24.525286+0000","last_clean":"2024-03-18T00:25:24.525286+0000","last_became_active":"2024-03-18T00:25:23.539703+0000","last_became_peered":"2024-03-18T00:25:23.539703+0000","last_unstale":"2024-03-18T00:25:24.525286+0000","last_undegraded":"2024-03-18T00:25:24.525286+0000","last_fullsized":"2024-03-18T00:25:24.525286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525354+0000","last_change":"2024-03-18T00:25:23.528213+0000","last_active":"2024-03-18T00:25:24.525354+0000","last_peered":"2024-03-18T00:25:24.525354+0000","last_clean":"2024-03-18T00:25:24.525354+0000","last_became_active":"2024-03-18T00:25:23.527957+0000","last_became_peered":"2024-03-18T00:25:23.527957+0000","last_unstale":"2024-03-18T00:25:24.525354+0000","last_undegraded":"2024-03-18T00:25:24.525354+0000","last_fullsized":"2024-03-18T00:25:24.525354+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527277+0000","last_change":"2024-03-18T00:25:23.538220+0000","last_active":"2024-03-18T00:25:24.527277+0000","last_peered":"2024-03-18T00:25:24.527277+0000","last_clean":"2024-03-18T00:25:24.527277+0000","last_became_active":"2024-03-18T00:25:23.537965+0000","last_became_peered":"2024-03-18T00:25:23.537965+0000","last_unstale":"2024-03-18T00:25:24.527277+0000","last_undegraded":"2024-03-18T00:25:24.527277+0000","last_fullsized":"2024-03-18T00:25:24.527277+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525245+0000","last_change":"2024-03-18T00:25:23.540936+0000","last_active":"2024-03-18T00:25:24.525245+0000","last_peered":"2024-03-18T00:25:24.525245+0000","last_clean":"2024-03-18T00:25:24.525245+0000","last_became_active":"2024-03-18T00:25:23.540679+0000","last_became_peered":"2024-03-18T00:25:23.540679+0000","last_unstale":"2024-03-18T00:25:24.525245+0000","last_undegraded":"2024-03-18T00:25:24.525245+0000","last_fullsized":"2024-03-18T00:25:24.525245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:19:05.489358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933579+0000","last_change":"2024-03-18T00:25:23.538218+0000","last_active":"2024-03-18T00:25:24.933579+0000","last_peered":"2024-03-18T00:25:24.933579+0000","last_clean":"2024-03-18T00:25:24.933579+0000","last_became_active":"2024-03-18T00:25:23.537892+0000","last_became_peered":"2024-03-18T00:25:23.537892+0000","last_unstale":"2024-03-18T00:25:24.933579+0000","last_undegraded":"2024-03-18T00:25:24.933579+0000","last_fullsized":"2024-03-18T00:25:24.933579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360411+0000","last_change":"2024-03-18T00:25:23.539202+0000","last_active":"2024-03-18T00:25:25.360411+0000","last_peered":"2024-03-18T00:25:25.360411+0000","last_clean":"2024-03-18T00:25:25.360411+0000","last_became_active":"2024-03-18T00:25:23.538922+0000","last_became_peered":"2024-03-18T00:25:23.538922+0000","last_unstale":"2024-03-18T00:25:25.360411+0000","last_undegraded":"2024-03-18T00:25:25.360411+0000","last_fullsized":"2024-03-18T00:25:25.360411+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359685+0000","last_change":"2024-03-18T00:25:23.529487+0000","last_active":"2024-03-18T00:25:25.359685+0000","last_peered":"2024-03-18T00:25:25.359685+0000","last_clean":"2024-03-18T00:25:25.359685+0000","last_became_active":"2024-03-18T00:25:23.529211+0000","last_became_peered":"2024-03-18T00:25:23.529211+0000","last_unstale":"2024-03-18T00:25:25.359685+0000","last_undegraded":"2024-03-18T00:25:25.359685+0000","last_fullsized":"2024-03-18T00:25:25.359685+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524820+0000","last_change":"2024-03-18T00:25:23.526131+0000","last_active":"2024-03-18T00:25:24.524820+0000","last_peered":"2024-03-18T00:25:24.524820+0000","last_clean":"2024-03-18T00:25:24.524820+0000","last_became_active":"2024-03-18T00:25:23.525869+0000","last_became_peered":"2024-03-18T00:25:23.525869+0000","last_unstale":"2024-03-18T00:25:24.524820+0000","last_undegraded":"2024-03-18T00:25:24.524820+0000","last_fullsized":"2024-03-18T00:25:24.524820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859267+0000","last_change":"2024-03-18T00:25:23.528904+0000","last_active":"2024-03-18T00:25:24.859267+0000","last_peered":"2024-03-18T00:25:24.859267+0000","last_clean":"2024-03-18T00:25:24.859267+0000","last_became_active":"2024-03-18T00:25:23.528637+0000","last_became_peered":"2024-03-18T00:25:23.528637+0000","last_unstale":"2024-03-18T00:25:24.859267+0000","last_undegraded":"2024-03-18T00:25:24.859267+0000","last_fullsized":"2024-03-18T00:25:24.859267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:50.372929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525171+0000","last_change":"2024-03-18T00:25:22.525633+0000","last_active":"2024-03-18T00:25:24.525171+0000","last_peered":"2024-03-18T00:25:24.525171+0000","last_clean":"2024-03-18T00:25:24.525171+0000","last_became_active":"2024-03-18T00:25:22.525293+0000","last_became_peered":"2024-03-18T00:25:22.525293+0000","last_unstale":"2024-03-18T00:25:24.525171+0000","last_undegraded":"2024-03-18T00:25:24.525171+0000","last_fullsized":"2024-03-18T00:25:24.525171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:29:02.213393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933633+0000","last_change":"2024-03-18T00:25:23.532009+0000","last_active":"2024-03-18T00:25:24.933633+0000","last_peered":"2024-03-18T00:25:24.933633+0000","last_clean":"2024-03-18T00:25:24.933633+0000","last_became_active":"2024-03-18T00:25:23.531736+0000","last_became_peered":"2024-03-18T00:25:23.531736+0000","last_unstale":"2024-03-18T00:25:24.933633+0000","last_undegraded":"2024-03-18T00:25:24.933633+0000","last_fullsized":"2024-03-18T00:25:24.933633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524921+0000","last_change":"2024-03-18T00:25:22.521332+0000","last_active":"2024-03-18T00:25:24.524921+0000","last_peered":"2024-03-18T00:25:24.524921+0000","last_clean":"2024-03-18T00:25:24.524921+0000","last_became_active":"2024-03-18T00:25:22.520113+0000","last_became_peered":"2024-03-18T00:25:22.520113+0000","last_unstale":"2024-03-18T00:25:24.524921+0000","last_undegraded":"2024-03-18T00:25:24.524921+0000","last_fullsized":"2024-03-18T00:25:24.524921+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524901+0000","last_change":"2024-03-18T00:25:22.525936+0000","last_active":"2024-03-18T00:25:24.524901+0000","last_peered":"2024-03-18T00:25:24.524901+0000","last_clean":"2024-03-18T00:25:24.524901+0000","last_became_active":"2024-03-18T00:25:22.525688+0000","last_became_peered":"2024-03-18T00:25:22.525688+0000","last_unstale":"2024-03-18T00:25:24.524901+0000","last_undegraded":"2024-03-18T00:25:24.524901+0000","last_fullsized":"2024-03-18T00:25:24.524901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524904+0000","last_change":"2024-03-18T00:25:23.537268+0000","last_active":"2024-03-18T00:25:24.524904+0000","last_peered":"2024-03-18T00:25:24.524904+0000","last_clean":"2024-03-18T00:25:24.524904+0000","last_became_active":"2024-03-18T00:25:23.536747+0000","last_became_peered":"2024-03-18T00:25:23.536747+0000","last_unstale":"2024-03-18T00:25:24.524904+0000","last_undegraded":"2024-03-18T00:25:24.524904+0000","last_fullsized":"2024-03-18T00:25:24.524904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359815+0000","last_change":"2024-03-18T00:25:22.525372+0000","last_active":"2024-03-18T00:25:25.359815+0000","last_peered":"2024-03-18T00:25:25.359815+0000","last_clean":"2024-03-18T00:25:25.359815+0000","last_became_active":"2024-03-18T00:25:22.525058+0000","last_became_peered":"2024-03-18T00:25:22.525058+0000","last_unstale":"2024-03-18T00:25:25.359815+0000","last_undegraded":"2024-03-18T00:25:25.359815+0000","last_fullsized":"2024-03-18T00:25:25.359815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526925+0000","last_change":"2024-03-18T00:25:23.538275+0000","last_active":"2024-03-18T00:25:24.526925+0000","last_peered":"2024-03-18T00:25:24.526925+0000","last_clean":"2024-03-18T00:25:24.526925+0000","last_became_active":"2024-03-18T00:25:23.538003+0000","last_became_peered":"2024-03-18T00:25:23.538003+0000","last_unstale":"2024-03-18T00:25:24.526925+0000","last_undegraded":"2024-03-18T00:25:24.526925+0000","last_fullsized":"2024-03-18T00:25:24.526925+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525197+0000","last_change":"2024-03-18T00:25:22.512527+0000","last_active":"2024-03-18T00:25:24.525197+0000","last_peered":"2024-03-18T00:25:24.525197+0000","last_clean":"2024-03-18T00:25:24.525197+0000","last_became_active":"2024-03-18T00:25:22.512256+0000","last_became_peered":"2024-03-18T00:25:22.512256+0000","last_unstale":"2024-03-18T00:25:24.525197+0000","last_undegraded":"2024-03-18T00:25:24.525197+0000","last_fullsized":"2024-03-18T00:25:24.525197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360064+0000","last_change":"2024-03-18T00:25:23.536878+0000","last_active":"2024-03-18T00:25:25.360064+0000","last_peered":"2024-03-18T00:25:25.360064+0000","last_clean":"2024-03-18T00:25:25.360064+0000","last_became_active":"2024-03-18T00:25:23.536571+0000","last_became_peered":"2024-03-18T00:25:23.536571+0000","last_unstale":"2024-03-18T00:25:25.360064+0000","last_undegraded":"2024-03-18T00:25:25.360064+0000","last_fullsized":"2024-03-18T00:25:25.360064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:35:56.376429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360235+0000","last_change":"2024-03-18T00:25:22.516162+0000","last_active":"2024-03-18T00:25:25.360235+0000","last_peered":"2024-03-18T00:25:25.360235+0000","last_clean":"2024-03-18T00:25:25.360235+0000","last_became_active":"2024-03-18T00:25:22.515844+0000","last_became_peered":"2024-03-18T00:25:22.515844+0000","last_unstale":"2024-03-18T00:25:25.360235+0000","last_undegraded":"2024-03-18T00:25:25.360235+0000","last_fullsized":"2024-03-18T00:25:25.360235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933519+0000","last_change":"2024-03-18T00:25:23.529085+0000","last_active":"2024-03-18T00:25:24.933519+0000","last_peered":"2024-03-18T00:25:24.933519+0000","last_clean":"2024-03-18T00:25:24.933519+0000","last_became_active":"2024-03-18T00:25:23.528662+0000","last_became_peered":"2024-03-18T00:25:23.528662+0000","last_unstale":"2024-03-18T00:25:24.933519+0000","last_undegraded":"2024-03-18T00:25:24.933519+0000","last_fullsized":"2024-03-18T00:25:24.933519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:00:54.587624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527254+0000","last_change":"2024-03-18T00:25:22.521602+0000","last_active":"2024-03-18T00:25:24.527254+0000","last_peered":"2024-03-18T00:25:24.527254+0000","last_clean":"2024-03-18T00:25:24.527254+0000","last_became_active":"2024-03-18T00:25:22.521328+0000","last_became_peered":"2024-03-18T00:25:22.521328+0000","last_unstale":"2024-03-18T00:25:24.527254+0000","last_undegraded":"2024-03-18T00:25:24.527254+0000","last_fullsized":"2024-03-18T00:25:24.527254+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859580+0000","last_change":"2024-03-18T00:25:23.543862+0000","last_active":"2024-03-18T00:25:24.859580+0000","last_peered":"2024-03-18T00:25:24.859580+0000","last_clean":"2024-03-18T00:25:24.859580+0000","last_became_active":"2024-03-18T00:25:23.543558+0000","last_became_peered":"2024-03-18T00:25:23.543558+0000","last_unstale":"2024-03-18T00:25:24.859580+0000","last_undegraded":"2024-03-18T00:25:24.859580+0000","last_fullsized":"2024-03-18T00:25:24.859580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:14.829023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525576+0000","last_change":"2024-03-18T00:25:22.525827+0000","last_active":"2024-03-18T00:25:24.525576+0000","last_peered":"2024-03-18T00:25:24.525576+0000","last_clean":"2024-03-18T00:25:24.525576+0000","last_became_active":"2024-03-18T00:25:22.525551+0000","last_became_peered":"2024-03-18T00:25:22.525551+0000","last_unstale":"2024-03-18T00:25:24.525576+0000","last_undegraded":"2024-03-18T00:25:24.525576+0000","last_fullsized":"2024-03-18T00:25:24.525576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360412+0000","last_change":"2024-03-18T00:25:23.543586+0000","last_active":"2024-03-18T00:25:25.360412+0000","last_peered":"2024-03-18T00:25:25.360412+0000","last_clean":"2024-03-18T00:25:25.360412+0000","last_became_active":"2024-03-18T00:25:23.543343+0000","last_became_peered":"2024-03-18T00:25:23.543343+0000","last_unstale":"2024-03-18T00:25:25.360412+0000","last_undegraded":"2024-03-18T00:25:25.360412+0000","last_fullsized":"2024-03-18T00:25:25.360412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:39:37.708353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933641+0000","last_change":"2024-03-18T00:25:22.525005+0000","last_active":"2024-03-18T00:25:24.933641+0000","last_peered":"2024-03-18T00:25:24.933641+0000","last_clean":"2024-03-18T00:25:24.933641+0000","last_became_active":"2024-03-18T00:25:22.524742+0000","last_became_peered":"2024-03-18T00:25:22.524742+0000","last_unstale":"2024-03-18T00:25:24.933641+0000","last_undegraded":"2024-03-18T00:25:24.933641+0000","last_fullsized":"2024-03-18T00:25:24.933641+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933361+0000","last_change":"2024-03-18T00:25:23.525230+0000","last_active":"2024-03-18T00:25:24.933361+0000","last_peered":"2024-03-18T00:25:24.933361+0000","last_clean":"2024-03-18T00:25:24.933361+0000","last_became_active":"2024-03-18T00:25:23.524978+0000","last_became_peered":"2024-03-18T00:25:23.524978+0000","last_unstale":"2024-03-18T00:25:24.933361+0000","last_undegraded":"2024-03-18T00:25:24.933361+0000","last_fullsized":"2024-03-18T00:25:24.933361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:24:31.097329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360495+0000","last_change":"2024-03-18T00:25:22.524729+0000","last_active":"2024-03-18T00:25:25.360495+0000","last_peered":"2024-03-18T00:25:25.360495+0000","last_clean":"2024-03-18T00:25:25.360495+0000","last_became_active":"2024-03-18T00:25:22.524455+0000","last_became_peered":"2024-03-18T00:25:22.524455+0000","last_unstale":"2024-03-18T00:25:25.360495+0000","last_undegraded":"2024-03-18T00:25:25.360495+0000","last_fullsized":"2024-03-18T00:25:25.360495+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:23.541999+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:23.541593+0000","last_became_peered":"2024-03-18T00:25:23.541593+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:44.212408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524819+0000","last_change":"2024-03-18T00:25:22.519877+0000","last_active":"2024-03-18T00:25:24.524819+0000","last_peered":"2024-03-18T00:25:24.524819+0000","last_clean":"2024-03-18T00:25:24.524819+0000","last_became_active":"2024-03-18T00:25:22.519396+0000","last_became_peered":"2024-03-18T00:25:22.519396+0000","last_unstale":"2024-03-18T00:25:24.524819+0000","last_undegraded":"2024-03-18T00:25:24.524819+0000","last_fullsized":"2024-03-18T00:25:24.524819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.526752+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.526434+0000","last_became_peered":"2024-03-18T00:25:23.526434+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359803+0000","last_change":"2024-03-18T00:25:22.518260+0000","last_active":"2024-03-18T00:25:25.359803+0000","last_peered":"2024-03-18T00:25:25.359803+0000","last_clean":"2024-03-18T00:25:25.359803+0000","last_became_active":"2024-03-18T00:25:22.517930+0000","last_became_peered":"2024-03-18T00:25:22.517930+0000","last_unstale":"2024-03-18T00:25:25.359803+0000","last_undegraded":"2024-03-18T00:25:25.359803+0000","last_fullsized":"2024-03-18T00:25:25.359803+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359692+0000","last_change":"2024-03-18T00:25:23.541873+0000","last_active":"2024-03-18T00:25:25.359692+0000","last_peered":"2024-03-18T00:25:25.359692+0000","last_clean":"2024-03-18T00:25:25.359692+0000","last_became_active":"2024-03-18T00:25:23.541574+0000","last_became_peered":"2024-03-18T00:25:23.541574+0000","last_unstale":"2024-03-18T00:25:25.359692+0000","last_undegraded":"2024-03-18T00:25:25.359692+0000","last_fullsized":"2024-03-18T00:25:25.359692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:05:21.147807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859586+0000","last_change":"2024-03-18T00:25:22.524063+0000","last_active":"2024-03-18T00:25:24.859586+0000","last_peered":"2024-03-18T00:25:24.859586+0000","last_clean":"2024-03-18T00:25:24.859586+0000","last_became_active":"2024-03-18T00:25:22.523714+0000","last_became_peered":"2024-03-18T00:25:22.523714+0000","last_unstale":"2024-03-18T00:25:24.859586+0000","last_undegraded":"2024-03-18T00:25:24.859586+0000","last_fullsized":"2024-03-18T00:25:24.859586+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:19:25.284585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360141+0000","last_change":"2024-03-18T00:25:23.542168+0000","last_active":"2024-03-18T00:25:25.360141+0000","last_peered":"2024-03-18T00:25:25.360141+0000","last_clean":"2024-03-18T00:25:25.360141+0000","last_became_active":"2024-03-18T00:25:23.541579+0000","last_became_peered":"2024-03-18T00:25:23.541579+0000","last_unstale":"2024-03-18T00:25:25.360141+0000","last_undegraded":"2024-03-18T00:25:25.360141+0000","last_fullsized":"2024-03-18T00:25:25.360141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359774+0000","last_change":"2024-03-18T00:25:22.525864+0000","last_active":"2024-03-18T00:25:25.359774+0000","last_peered":"2024-03-18T00:25:25.359774+0000","last_clean":"2024-03-18T00:25:25.359774+0000","last_became_active":"2024-03-18T00:25:22.525582+0000","last_became_peered":"2024-03-18T00:25:22.525582+0000","last_unstale":"2024-03-18T00:25:25.359774+0000","last_undegraded":"2024-03-18T00:25:25.359774+0000","last_fullsized":"2024-03-18T00:25:25.359774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360294+0000","last_change":"2024-03-18T00:25:23.542371+0000","last_active":"2024-03-18T00:25:25.360294+0000","last_peered":"2024-03-18T00:25:25.360294+0000","last_clean":"2024-03-18T00:25:25.360294+0000","last_became_active":"2024-03-18T00:25:23.542030+0000","last_became_peered":"2024-03-18T00:25:23.542030+0000","last_unstale":"2024-03-18T00:25:25.360294+0000","last_undegraded":"2024-03-18T00:25:25.360294+0000","last_fullsized":"2024-03-18T00:25:25.360294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:34:40.152850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527312+0000","last_change":"2024-03-18T00:25:22.527178+0000","last_active":"2024-03-18T00:25:24.527312+0000","last_peered":"2024-03-18T00:25:24.527312+0000","last_clean":"2024-03-18T00:25:24.527312+0000","last_became_active":"2024-03-18T00:25:22.526891+0000","last_became_peered":"2024-03-18T00:25:22.526891+0000","last_unstale":"2024-03-18T00:25:24.527312+0000","last_undegraded":"2024-03-18T00:25:24.527312+0000","last_fullsized":"2024-03-18T00:25:24.527312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360509+0000","last_change":"2024-03-18T00:25:23.537093+0000","last_active":"2024-03-18T00:25:25.360509+0000","last_peered":"2024-03-18T00:25:25.360509+0000","last_clean":"2024-03-18T00:25:25.360509+0000","last_became_active":"2024-03-18T00:25:23.536816+0000","last_became_peered":"2024-03-18T00:25:23.536816+0000","last_unstale":"2024-03-18T00:25:25.360509+0000","last_undegraded":"2024-03-18T00:25:25.360509+0000","last_fullsized":"2024-03-18T00:25:25.360509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:30:59.437205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359667+0000","last_change":"2024-03-18T00:25:22.522241+0000","last_active":"2024-03-18T00:25:25.359667+0000","last_peered":"2024-03-18T00:25:25.359667+0000","last_clean":"2024-03-18T00:25:25.359667+0000","last_became_active":"2024-03-18T00:25:22.521959+0000","last_became_peered":"2024-03-18T00:25:22.521959+0000","last_unstale":"2024-03-18T00:25:25.359667+0000","last_undegraded":"2024-03-18T00:25:25.359667+0000","last_fullsized":"2024-03-18T00:25:25.359667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360544+0000","last_change":"2024-03-18T00:25:23.533012+0000","last_active":"2024-03-18T00:25:25.360544+0000","last_peered":"2024-03-18T00:25:25.360544+0000","last_clean":"2024-03-18T00:25:25.360544+0000","last_became_active":"2024-03-18T00:25:23.532746+0000","last_became_peered":"2024-03-18T00:25:23.532746+0000","last_unstale":"2024-03-18T00:25:25.360544+0000","last_undegraded":"2024-03-18T00:25:25.360544+0000","last_fullsized":"2024-03-18T00:25:25.360544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:06:47.892309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359515+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:25:25.359515+0000","last_peered":"2024-03-18T00:25:25.359515+0000","last_clean":"2024-03-18T00:25:25.359515+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:25:25.359515+0000","last_undegraded":"2024-03-18T00:25:25.359515+0000","last_fullsized":"2024-03-18T00:25:25.359515+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359893+0000","last_change":"2024-03-18T00:25:22.518151+0000","last_active":"2024-03-18T00:25:25.359893+0000","last_peered":"2024-03-18T00:25:25.359893+0000","last_clean":"2024-03-18T00:25:25.359893+0000","last_became_active":"2024-03-18T00:25:22.517836+0000","last_became_peered":"2024-03-18T00:25:22.517836+0000","last_unstale":"2024-03-18T00:25:25.359893+0000","last_undegraded":"2024-03-18T00:25:25.359893+0000","last_fullsized":"2024-03-18T00:25:25.359893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524976+0000","last_change":"2024-03-18T00:25:23.542819+0000","last_active":"2024-03-18T00:25:24.524976+0000","last_peered":"2024-03-18T00:25:24.524976+0000","last_clean":"2024-03-18T00:25:24.524976+0000","last_became_active":"2024-03-18T00:25:23.541993+0000","last_became_peered":"2024-03-18T00:25:23.541993+0000","last_unstale":"2024-03-18T00:25:24.524976+0000","last_undegraded":"2024-03-18T00:25:24.524976+0000","last_fullsized":"2024-03-18T00:25:24.524976+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:53:57.185365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359453+0000","last_change":"2024-03-18T00:25:22.526454+0000","last_active":"2024-03-18T00:25:25.359453+0000","last_peered":"2024-03-18T00:25:25.359453+0000","last_clean":"2024-03-18T00:25:25.359453+0000","last_became_active":"2024-03-18T00:25:22.525824+0000","last_became_peered":"2024-03-18T00:25:22.525824+0000","last_unstale":"2024-03-18T00:25:25.359453+0000","last_undegraded":"2024-03-18T00:25:25.359453+0000","last_fullsized":"2024-03-18T00:25:25.359453+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:49:36.641923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933234+0000","last_change":"2024-03-18T00:25:23.533610+0000","last_active":"2024-03-18T00:25:24.933234+0000","last_peered":"2024-03-18T00:25:24.933234+0000","last_clean":"2024-03-18T00:25:24.933234+0000","last_became_active":"2024-03-18T00:25:23.531816+0000","last_became_peered":"2024-03-18T00:25:23.531816+0000","last_unstale":"2024-03-18T00:25:24.933234+0000","last_undegraded":"2024-03-18T00:25:24.933234+0000","last_fullsized":"2024-03-18T00:25:24.933234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:51:00.174852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359686+0000","last_change":"2024-03-18T00:25:22.524836+0000","last_active":"2024-03-18T00:25:25.359686+0000","last_peered":"2024-03-18T00:25:25.359686+0000","last_clean":"2024-03-18T00:25:25.359686+0000","last_became_active":"2024-03-18T00:25:22.524559+0000","last_became_peered":"2024-03-18T00:25:22.524559+0000","last_unstale":"2024-03-18T00:25:25.359686+0000","last_undegraded":"2024-03-18T00:25:25.359686+0000","last_fullsized":"2024-03-18T00:25:25.359686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.526935+0000","last_change":"2024-03-18T00:25:23.530154+0000","last_active":"2024-03-18T00:25:24.526935+0000","last_peered":"2024-03-18T00:25:24.526935+0000","last_clean":"2024-03-18T00:25:24.526935+0000","last_became_active":"2024-03-18T00:25:23.529909+0000","last_became_peered":"2024-03-18T00:25:23.529909+0000","last_unstale":"2024-03-18T00:25:24.526935+0000","last_undegraded":"2024-03-18T00:25:24.526935+0000","last_fullsized":"2024-03-18T00:25:24.526935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360581+0000","last_change":"2024-03-18T00:25:22.522580+0000","last_active":"2024-03-18T00:25:25.360581+0000","last_peered":"2024-03-18T00:25:25.360581+0000","last_clean":"2024-03-18T00:25:25.360581+0000","last_became_active":"2024-03-18T00:25:22.522157+0000","last_became_peered":"2024-03-18T00:25:22.522157+0000","last_unstale":"2024-03-18T00:25:25.360581+0000","last_undegraded":"2024-03-18T00:25:25.360581+0000","last_fullsized":"2024-03-18T00:25:25.360581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:52.911420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859361+0000","last_change":"2024-03-18T00:25:23.539763+0000","last_active":"2024-03-18T00:25:24.859361+0000","last_peered":"2024-03-18T00:25:24.859361+0000","last_clean":"2024-03-18T00:25:24.859361+0000","last_became_active":"2024-03-18T00:25:23.539502+0000","last_became_peered":"2024-03-18T00:25:23.539502+0000","last_unstale":"2024-03-18T00:25:24.859361+0000","last_undegraded":"2024-03-18T00:25:24.859361+0000","last_fullsized":"2024-03-18T00:25:24.859361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:05.469473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527211+0000","last_change":"2024-03-18T00:25:22.520229+0000","last_active":"2024-03-18T00:25:24.527211+0000","last_peered":"2024-03-18T00:25:24.527211+0000","last_clean":"2024-03-18T00:25:24.527211+0000","last_became_active":"2024-03-18T00:25:22.519955+0000","last_became_peered":"2024-03-18T00:25:22.519955+0000","last_unstale":"2024-03-18T00:25:24.527211+0000","last_undegraded":"2024-03-18T00:25:24.527211+0000","last_fullsized":"2024-03-18T00:25:24.527211+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360629+0000","last_change":"2024-03-18T00:25:23.538375+0000","last_active":"2024-03-18T00:25:25.360629+0000","last_peered":"2024-03-18T00:25:25.360629+0000","last_clean":"2024-03-18T00:25:25.360629+0000","last_became_active":"2024-03-18T00:25:23.538114+0000","last_became_peered":"2024-03-18T00:25:23.538114+0000","last_unstale":"2024-03-18T00:25:25.360629+0000","last_undegraded":"2024-03-18T00:25:25.360629+0000","last_fullsized":"2024-03-18T00:25:25.360629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:10:23.564914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360706+0000","last_change":"2024-03-18T00:25:22.527522+0000","last_active":"2024-03-18T00:25:25.360706+0000","last_peered":"2024-03-18T00:25:25.360706+0000","last_clean":"2024-03-18T00:25:25.360706+0000","last_became_active":"2024-03-18T00:25:22.527170+0000","last_became_peered":"2024-03-18T00:25:22.527170+0000","last_unstale":"2024-03-18T00:25:25.360706+0000","last_undegraded":"2024-03-18T00:25:25.360706+0000","last_fullsized":"2024-03-18T00:25:25.360706+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:50:59.169893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527236+0000","last_change":"2024-03-18T00:25:23.529557+0000","last_active":"2024-03-18T00:25:24.527236+0000","last_peered":"2024-03-18T00:25:24.527236+0000","last_clean":"2024-03-18T00:25:24.527236+0000","last_became_active":"2024-03-18T00:25:23.529316+0000","last_became_peered":"2024-03-18T00:25:23.529316+0000","last_unstale":"2024-03-18T00:25:24.527236+0000","last_undegraded":"2024-03-18T00:25:24.527236+0000","last_fullsized":"2024-03-18T00:25:24.527236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.528528+0000","last_change":"2024-03-18T00:25:22.520956+0000","last_active":"2024-03-18T00:25:24.528528+0000","last_peered":"2024-03-18T00:25:24.528528+0000","last_clean":"2024-03-18T00:25:24.528528+0000","last_became_active":"2024-03-18T00:25:22.520708+0000","last_became_peered":"2024-03-18T00:25:22.520708+0000","last_unstale":"2024-03-18T00:25:24.528528+0000","last_undegraded":"2024-03-18T00:25:24.528528+0000","last_fullsized":"2024-03-18T00:25:24.528528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:58:44.969006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525346+0000","last_change":"2024-03-18T00:25:23.543671+0000","last_active":"2024-03-18T00:25:24.525346+0000","last_peered":"2024-03-18T00:25:24.525346+0000","last_clean":"2024-03-18T00:25:24.525346+0000","last_became_active":"2024-03-18T00:25:23.543393+0000","last_became_peered":"2024-03-18T00:25:23.543393+0000","last_unstale":"2024-03-18T00:25:24.525346+0000","last_undegraded":"2024-03-18T00:25:24.525346+0000","last_fullsized":"2024-03-18T00:25:24.525346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:20:24.520924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525281+0000","last_change":"2024-03-18T00:25:22.521876+0000","last_active":"2024-03-18T00:25:24.525281+0000","last_peered":"2024-03-18T00:25:24.525281+0000","last_clean":"2024-03-18T00:25:24.525281+0000","last_became_active":"2024-03-18T00:25:22.521555+0000","last_became_peered":"2024-03-18T00:25:22.521555+0000","last_unstale":"2024-03-18T00:25:24.525281+0000","last_undegraded":"2024-03-18T00:25:24.525281+0000","last_fullsized":"2024-03-18T00:25:24.525281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:16.514848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933490+0000","last_change":"2024-03-18T00:25:23.528031+0000","last_active":"2024-03-18T00:25:24.933490+0000","last_peered":"2024-03-18T00:25:24.933490+0000","last_clean":"2024-03-18T00:25:24.933490+0000","last_became_active":"2024-03-18T00:25:23.527711+0000","last_became_peered":"2024-03-18T00:25:23.527711+0000","last_unstale":"2024-03-18T00:25:24.933490+0000","last_undegraded":"2024-03-18T00:25:24.933490+0000","last_fullsized":"2024-03-18T00:25:24.933490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359454+0000","last_change":"2024-03-18T00:25:22.526660+0000","last_active":"2024-03-18T00:25:25.359454+0000","last_peered":"2024-03-18T00:25:25.359454+0000","last_clean":"2024-03-18T00:25:25.359454+0000","last_became_active":"2024-03-18T00:25:22.526187+0000","last_became_peered":"2024-03-18T00:25:22.526187+0000","last_unstale":"2024-03-18T00:25:25.359454+0000","last_undegraded":"2024-03-18T00:25:25.359454+0000","last_fullsized":"2024-03-18T00:25:25.359454+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:10:04.464515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.859319+0000","last_change":"2024-03-18T00:25:23.532831+0000","last_active":"2024-03-18T00:25:24.859319+0000","last_peered":"2024-03-18T00:25:24.859319+0000","last_clean":"2024-03-18T00:25:24.859319+0000","last_became_active":"2024-03-18T00:25:23.532560+0000","last_became_peered":"2024-03-18T00:25:23.532560+0000","last_unstale":"2024-03-18T00:25:24.859319+0000","last_undegraded":"2024-03-18T00:25:24.859319+0000","last_fullsized":"2024-03-18T00:25:24.859319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:23:53.916378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527047+0000","last_change":"2024-03-18T00:25:22.519545+0000","last_active":"2024-03-18T00:25:24.527047+0000","last_peered":"2024-03-18T00:25:24.527047+0000","last_clean":"2024-03-18T00:25:24.527047+0000","last_became_active":"2024-03-18T00:25:22.519310+0000","last_became_peered":"2024-03-18T00:25:22.519310+0000","last_unstale":"2024-03-18T00:25:24.527047+0000","last_undegraded":"2024-03-18T00:25:24.527047+0000","last_fullsized":"2024-03-18T00:25:24.527047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:21:45.825143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524965+0000","last_change":"2024-03-18T00:25:23.537154+0000","last_active":"2024-03-18T00:25:24.524965+0000","last_peered":"2024-03-18T00:25:24.524965+0000","last_clean":"2024-03-18T00:25:24.524965+0000","last_became_active":"2024-03-18T00:25:23.536652+0000","last_became_peered":"2024-03-18T00:25:23.536652+0000","last_unstale":"2024-03-18T00:25:24.524965+0000","last_undegraded":"2024-03-18T00:25:24.524965+0000","last_fullsized":"2024-03-18T00:25:24.524965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:03:16.862367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.527167+0000","last_change":"2024-03-18T00:25:22.526658+0000","last_active":"2024-03-18T00:25:24.527167+0000","last_peered":"2024-03-18T00:25:24.527167+0000","last_clean":"2024-03-18T00:25:24.527167+0000","last_became_active":"2024-03-18T00:25:22.526284+0000","last_became_peered":"2024-03-18T00:25:22.526284+0000","last_unstale":"2024-03-18T00:25:24.527167+0000","last_undegraded":"2024-03-18T00:25:24.527167+0000","last_fullsized":"2024-03-18T00:25:24.527167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:31:49.367970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525137+0000","last_change":"2024-03-18T00:25:23.537415+0000","last_active":"2024-03-18T00:25:24.525137+0000","last_peered":"2024-03-18T00:25:24.525137+0000","last_clean":"2024-03-18T00:25:24.525137+0000","last_became_active":"2024-03-18T00:25:23.537145+0000","last_became_peered":"2024-03-18T00:25:23.537145+0000","last_unstale":"2024-03-18T00:25:24.525137+0000","last_undegraded":"2024-03-18T00:25:24.525137+0000","last_fullsized":"2024-03-18T00:25:24.525137+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:35:49.558800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359988+0000","last_change":"2024-03-18T00:25:22.525503+0000","last_active":"2024-03-18T00:25:25.359988+0000","last_peered":"2024-03-18T00:25:25.359988+0000","last_clean":"2024-03-18T00:25:25.359988+0000","last_became_active":"2024-03-18T00:25:22.525243+0000","last_became_peered":"2024-03-18T00:25:22.525243+0000","last_unstale":"2024-03-18T00:25:25.359988+0000","last_undegraded":"2024-03-18T00:25:25.359988+0000","last_fullsized":"2024-03-18T00:25:25.359988+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:52:47.316817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.524823+0000","last_change":"2024-03-18T00:25:23.530235+0000","last_active":"2024-03-18T00:25:24.524823+0000","last_peered":"2024-03-18T00:25:24.524823+0000","last_clean":"2024-03-18T00:25:24.524823+0000","last_became_active":"2024-03-18T00:25:23.529957+0000","last_became_peered":"2024-03-18T00:25:23.529957+0000","last_unstale":"2024-03-18T00:25:24.524823+0000","last_undegraded":"2024-03-18T00:25:24.524823+0000","last_fullsized":"2024-03-18T00:25:24.524823+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:18:31.728001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360510+0000","last_change":"2024-03-18T00:25:23.542945+0000","last_active":"2024-03-18T00:25:25.360510+0000","last_peered":"2024-03-18T00:25:25.360510+0000","last_clean":"2024-03-18T00:25:25.360510+0000","last_became_active":"2024-03-18T00:25:23.541198+0000","last_became_peered":"2024-03-18T00:25:23.541198+0000","last_unstale":"2024-03-18T00:25:25.360510+0000","last_undegraded":"2024-03-18T00:25:25.360510+0000","last_fullsized":"2024-03-18T00:25:25.360510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:14:47.999286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.359960+0000","last_change":"2024-03-18T00:25:22.524744+0000","last_active":"2024-03-18T00:25:25.359960+0000","last_peered":"2024-03-18T00:25:25.359960+0000","last_clean":"2024-03-18T00:25:25.359960+0000","last_became_active":"2024-03-18T00:25:22.524471+0000","last_became_peered":"2024-03-18T00:25:22.524471+0000","last_unstale":"2024-03-18T00:25:25.359960+0000","last_undegraded":"2024-03-18T00:25:25.359960+0000","last_fullsized":"2024-03-18T00:25:25.359960+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T07:01:13.824065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360483+0000","last_change":"2024-03-18T00:25:23.535099+0000","last_active":"2024-03-18T00:25:25.360483+0000","last_peered":"2024-03-18T00:25:25.360483+0000","last_clean":"2024-03-18T00:25:25.360483+0000","last_became_active":"2024-03-18T00:25:23.534782+0000","last_became_peered":"2024-03-18T00:25:23.534782+0000","last_unstale":"2024-03-18T00:25:25.360483+0000","last_undegraded":"2024-03-18T00:25:25.360483+0000","last_fullsized":"2024-03-18T00:25:25.360483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:21.825156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:25.360610+0000","last_change":"2024-03-18T00:25:22.524438+0000","last_active":"2024-03-18T00:25:25.360610+0000","last_peered":"2024-03-18T00:25:25.360610+0000","last_clean":"2024-03-18T00:25:25.360610+0000","last_became_active":"2024-03-18T00:25:22.524084+0000","last_became_peered":"2024-03-18T00:25:22.524084+0000","last_unstale":"2024-03-18T00:25:25.360610+0000","last_undegraded":"2024-03-18T00:25:25.360610+0000","last_fullsized":"2024-03-18T00:25:25.360610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:28:12.762540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933449+0000","last_change":"2024-03-18T00:25:23.529284+0000","last_active":"2024-03-18T00:25:24.933449+0000","last_peered":"2024-03-18T00:25:24.933449+0000","last_clean":"2024-03-18T00:25:24.933449+0000","last_became_active":"2024-03-18T00:25:23.529022+0000","last_became_peered":"2024-03-18T00:25:23.529022+0000","last_unstale":"2024-03-18T00:25:24.933449+0000","last_undegraded":"2024-03-18T00:25:24.933449+0000","last_fullsized":"2024-03-18T00:25:24.933449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:51:40.994745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525414+0000","last_change":"2024-03-18T00:25:22.524838+0000","last_active":"2024-03-18T00:25:24.525414+0000","last_peered":"2024-03-18T00:25:24.525414+0000","last_clean":"2024-03-18T00:25:24.525414+0000","last_became_active":"2024-03-18T00:25:22.524532+0000","last_became_peered":"2024-03-18T00:25:22.524532+0000","last_unstale":"2024-03-18T00:25:24.525414+0000","last_undegraded":"2024-03-18T00:25:24.525414+0000","last_fullsized":"2024-03-18T00:25:24.525414+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:50:11.206814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.525427+0000","last_change":"2024-03-18T00:25:23.541815+0000","last_active":"2024-03-18T00:25:24.525427+0000","last_peered":"2024-03-18T00:25:24.525427+0000","last_clean":"2024-03-18T00:25:24.525427+0000","last_became_active":"2024-03-18T00:25:23.541486+0000","last_became_peered":"2024-03-18T00:25:23.541486+0000","last_unstale":"2024-03-18T00:25:24.525427+0000","last_undegraded":"2024-03-18T00:25:24.525427+0000","last_fullsized":"2024-03-18T00:25:24.525427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:22.502686+0000","last_clean_scrub_stamp":"2024-03-18T00:25:22.502686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:57:52.707173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":18,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T00:25:24.933609+0000","last_change":"2024-03-18T00:25:22.520313+0000","last_active":"2024-03-18T00:25:24.933609+0000","last_peered":"2024-03-18T00:25:24.933609+0000","last_clean":"2024-03-18T00:25:24.933609+0000","last_became_active":"2024-03-18T00:25:22.520019+0000","last_became_peered":"2024-03-18T00:25:22.520019+0000","last_unstale":"2024-03-18T00:25:24.933609+0000","last_undegraded":"2024-03-18T00:25:24.933609+0000","last_fullsized":"2024-03-18T00:25:24.933609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:21.497728+0000","last_clean_scrub_stamp":"2024-03-18T00:25:21.497728+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:33:23.237486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":661884,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":217088,"data_stored":71060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72546,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":70934,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":661940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:25:34.288 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T00:25:34.288 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T00:25:34.288 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T00:25:34.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T00:25:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.423+0000 7f8f974a7640 1 Processor -- start 2024-03-18T00:25:34.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.423+0000 7f8f974a7640 1 -- start start 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.423+0000 7f8f974a7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f90145a80 0x7f8f90160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.423+0000 7f8f974a7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8f9006d360 0x7f8f9006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f974a7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8f9015c5f0 0x7f8f9015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f974a7640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8f900cfbf0 con 0x7f8f9015c5f0 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f974a7640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8f9006dd00 con 0x7f8f9006d360 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f974a7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8f901602d0 con 0x7f8f90145a80 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8f9015c5f0 0x7f8f9015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8f9015c5f0 0x7f8f9015ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59586/0 (socket says 172.21.15.81:59586) 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 -- 172.21.15.81:0/611457464 learned_addr learned my addr 172.21.15.81:0/611457464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f94a42640 1 --2- 172.21.15.81:0/611457464 >> v2:172.21.15.136:3300/0 conn(0x7f8f9006d360 0x7f8f9006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95243640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f90145a80 0x7f8f90160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 -- 172.21.15.81:0/611457464 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f90145a80 msgr2=0x7f8f90160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f90145a80 0x7f8f90160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 -- 172.21.15.81:0/611457464 >> v2:172.21.15.136:3300/0 conn(0x7f8f9006d360 msgr2=0x7f8f9006d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 --2- 172.21.15.81:0/611457464 >> v2:172.21.15.136:3300/0 conn(0x7f8f9006d360 0x7f8f9006d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.424+0000 7f8f95a44640 1 -- 172.21.15.81:0/611457464 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f9015cfc0 con 0x7f8f9015c5f0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f95a44640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9015c5f0 0x7f8f9015ca80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f900b5290 tx=0x7f8f8802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a8de64d49e0a4fb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f87fff640 1 -- 172.21.15.81:0/611457464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8802c9e0 con 0x7f8f9015c5f0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f87fff640 1 -- 172.21.15.81:0/611457464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8802cb80 con 0x7f8f9015c5f0 2024-03-18T00:25:34.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f87fff640 1 -- 172.21.15.81:0/611457464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f880343f0 con 0x7f8f9015c5f0 2024-03-18T00:25:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 -- 172.21.15.81:0/611457464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9015c5f0 msgr2=0x7f8f9015ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9015c5f0 0x7f8f9015ca80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8f900b5290 tx=0x7f8f8802be40 comp rx=0 tx=0).stop 2024-03-18T00:25:34.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 -- 172.21.15.81:0/611457464 shutdown_connections 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9015c5f0 0x7f8f9015ca80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 --2- 172.21.15.81:0/611457464 >> v2:172.21.15.136:3300/0 conn(0x7f8f9006d360 0x7f8f9006d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 --2- 172.21.15.81:0/611457464 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f90145a80 0x7f8f90160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 -- 172.21.15.81:0/611457464 >> 172.21.15.81:0/611457464 conn(0x7f8f9006b3a0 msgr2=0x7f8f9006b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 -- 172.21.15.81:0/611457464 shutdown_connections 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.425+0000 7f8f974a7640 1 -- 172.21.15.81:0/611457464 wait complete. 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.426+0000 7f8f974a7640 1 Processor -- start 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 -- start start 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 0x7f8f90144620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9015c5f0 0x7f8f90144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9015fc80 con 0x7f8f9006d360 2024-03-18T00:25:34.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9015d520 con 0x7f8f90145a80 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f974a7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8f9015ff60 con 0x7f8f9015c5f0 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59592/0 (socket says 172.21.15.81:59592) 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 -- 172.21.15.81:0/446402130 learned_addr learned my addr 172.21.15.81:0/446402130 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f94a42640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 0x7f8f90144620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95a44640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9015c5f0 0x7f8f90144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 -- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9015c5f0 msgr2=0x7f8f90144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9015c5f0 0x7f8f90144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 -- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 msgr2=0x7f8f90144620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 0x7f8f90144620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f95243640 1 -- 172.21.15.81:0/446402130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f90142aa0 con 0x7f8f9006d360 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.427+0000 7f8f94a42640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 0x7f8f90144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f95243640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e9b0 tx=0x7f8f8000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f80017070 con 0x7f8f9006d360 2024-03-18T00:25:34.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f8000c9a0 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f90142d80 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8000cd90 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.428+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f90143620 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.429+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f90069050 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.429+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8f8001a070 con 0x7f8f9006d360 2024-03-18T00:25:34.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.430+0000 7f8f85ffb640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 0x7f8f7406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.430+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8f8008ae50 con 0x7f8f9006d360 2024-03-18T00:25:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.430+0000 7f8f94a42640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 0x7f8f7406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.430+0000 7f8f94a42640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 0x7f8f7406e090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f901e8ad0 tx=0x7f8f8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.434+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8f80059940 con 0x7f8f9006d360 2024-03-18T00:25:34.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.645+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f8f9006ea50 con 0x7f8f9006d360 2024-03-18T00:25:34.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.646+0000 7f8f85ffb640 1 -- 172.21.15.81:0/446402130 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f8f80059240 con 0x7f8f9006d360 2024-03-18T00:25:34.646 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:34.646 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T00:25:34.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 msgr2=0x7f8f7406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 0x7f8f7406e090 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f901e8ad0 tx=0x7f8f8c008040 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 msgr2=0x7f8f900b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e9b0 tx=0x7f8f8000ee70 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 shutdown_connections 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8f9015c5f0 0x7f8f90144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8f90145a80 0x7f8f90144620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8f7406bbd0 0x7f8f7406e090 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 --2- 172.21.15.81:0/446402130 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f9006d360 0x7f8f900b0fc0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 >> 172.21.15.81:0/446402130 conn(0x7f8f9006b3a0 msgr2=0x7f8f90140840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 shutdown_connections 2024-03-18T00:25:34.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.648+0000 7f8f974a7640 1 -- 172.21.15.81:0/446402130 wait complete. 2024-03-18T00:25:34.659 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T00:25:34.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.758+0000 7f8df368c640 1 Processor -- start 2024-03-18T00:25:34.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.758+0000 7f8df368c640 1 -- start start 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df368c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec15e390 0x7f8dec15f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df368c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8dec0cec00 0x7f8dec0d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df368c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dec0cf4e0 con 0x7f8dec0cf060 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df368c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8dec0d0060 con 0x7f8dec0cec00 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df368c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec0d2fd0 con 0x7f8dec15e390 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8dec0cec00 0x7f8dec0d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8dec0cec00 0x7f8dec0d0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59596/0 (socket says 172.21.15.81:59596) 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 -- 172.21.15.81:0/3134738338 learned_addr learned my addr 172.21.15.81:0/3134738338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:34.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df1428640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec15e390 0x7f8dec15f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 -- 172.21.15.81:0/3134738338 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec15e390 msgr2=0x7f8dec15f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec15e390 0x7f8dec15f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8df0c27640 1 -- 172.21.15.81:0/3134738338 >> v1:172.21.15.136:6789/0 conn(0x7f8dec0cf060 legacy=0x7f8dec1610c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.760+0000 7f8df0c27640 1 -- 172.21.15.81:0/3134738338 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec0cf7c0 con 0x7f8dec0cec00 2024-03-18T00:25:34.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.759+0000 7f8de3fff640 1 -- 172.21.15.81:0/3134738338 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4202267936 0 0) 0x7f8dec0cf4e0 con 0x7f8dec0cf060 2024-03-18T00:25:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.760+0000 7f8df0c27640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0d0a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ed69791d99c125 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.760+0000 7f8de3fff640 1 -- 172.21.15.81:0/3134738338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc035020 con 0x7f8dec0cec00 2024-03-18T00:25:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.760+0000 7f8de3fff640 1 -- 172.21.15.81:0/3134738338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ddc031640 con 0x7f8dec0cec00 2024-03-18T00:25:34.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.760+0000 7f8de3fff640 1 -- 172.21.15.81:0/3134738338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ddc02d040 con 0x7f8dec0cec00 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 -- 172.21.15.81:0/3134738338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 msgr2=0x7f8dec0d0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0d0a90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc009870 tx=0x7f8ddc02b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 -- 172.21.15.81:0/3134738338 shutdown_connections 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0d0a90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 --2- 172.21.15.81:0/3134738338 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec15e390 0x7f8dec15f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 -- 172.21.15.81:0/3134738338 >> 172.21.15.81:0/3134738338 conn(0x7f8dec09d3c0 msgr2=0x7f8dec0d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 -- 172.21.15.81:0/3134738338 shutdown_connections 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.761+0000 7f8df368c640 1 -- 172.21.15.81:0/3134738338 wait complete. 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.762+0000 7f8df368c640 1 Processor -- start 2024-03-18T00:25:34.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.762+0000 7f8df368c640 1 -- start start 2024-03-18T00:25:34.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec0cf060 0x7f8dec0cda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dec15e390 0x7f8dec0b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec15e770 con 0x7f8dec0cec00 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8dec0cfd80 con 0x7f8dec15e390 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8dec15fcf0 con 0x7f8dec0cf060 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59610/0 (socket says 172.21.15.81:59610) 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 -- 172.21.15.81:0/2328166201 learned_addr learned my addr 172.21.15.81:0/2328166201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df0c27640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec0cf060 0x7f8dec0cda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1c29640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dec15e390 0x7f8dec0b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 -- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec0cf060 msgr2=0x7f8dec0cda80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec0cf060 0x7f8dec0cda80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 -- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dec15e390 msgr2=0x7f8dec0b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dec15e390 0x7f8dec0b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 -- 172.21.15.81:0/2328166201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dec0b8b90 con 0x7f8dec0cec00 2024-03-18T00:25:34.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df1428640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8de800e9b0 tx=0x7f8de800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de8017070 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8de800c9a0 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dec0b8e70 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.763+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8de800cd90 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.764+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dec1f5730 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.765+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dec04f5b0 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.765+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8de801a070 con 0x7f8dec0cec00 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.765+0000 7f8de1ffb640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 0x7f8dd006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:34.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.765+0000 7f8df0c27640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 0x7f8dd006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.765+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8de808ad10 con 0x7f8dec0cec00 2024-03-18T00:25:34.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.766+0000 7f8df0c27640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 0x7f8dd006e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc036000 tx=0x7f8ddc03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:34.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.770+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8de8059240 con 0x7f8dec0cec00 2024-03-18T00:25:34.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.945+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dec0d4790 con 0x7f8dec0cec00 2024-03-18T00:25:34.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.946+0000 7f8de1ffb640 1 -- 172.21.15.81:0/2328166201 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f8de805d2e0 con 0x7f8dec0cec00 2024-03-18T00:25:34.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:34.947 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:34.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 msgr2=0x7f8dd006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 0x7f8dd006e090 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8ddc036000 tx=0x7f8ddc03c040 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 msgr2=0x7f8dec0b9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8de800e9b0 tx=0x7f8de800ee70 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 shutdown_connections 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8dec15e390 0x7f8dec0b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8dec0cf060 0x7f8dec0cda80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8dd006bbd0 0x7f8dd006e090 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 --2- 172.21.15.81:0/2328166201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8dec0cec00 0x7f8dec0b9950 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 >> 172.21.15.81:0/2328166201 conn(0x7f8dec09d3c0 msgr2=0x7f8dec06c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 shutdown_connections 2024-03-18T00:25:34.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:34.948+0000 7f8df368c640 1 -- 172.21.15.81:0/2328166201 wait complete. 2024-03-18T00:25:34.959 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:34.960 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:35.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.062+0000 7f63b9e63640 1 Processor -- start 2024-03-18T00:25:35.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.062+0000 7f63b9e63640 1 -- start start 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b9e63640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b40d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b9e63640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f63b40b1ea0 0x7f63b40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b9e63640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b40ce2d0 con 0x7f63b406c490 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b9e63640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f63b406c970 con 0x7f63b40b1ea0 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b9e63640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63b406cc50 con 0x7f63b40cdef0 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b2ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f63b406c490 0x7f63b40b1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55832/0 (socket says 172.21.15.81:55832) 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b2ffd640 1 -- 172.21.15.81:0/2086151815 learned_addr learned my addr 172.21.15.81:0/2086151815 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b3fff640 1 --2- 172.21.15.81:0/2086151815 >> v2:172.21.15.136:3300/0 conn(0x7f63b40b1ea0 0x7f63b40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.063+0000 7f63b37fe640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b40d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b27fc640 1 -- 172.21.15.81:0/2086151815 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2318227679 0 0) 0x7f63b40ce2d0 con 0x7f63b406c490 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b27fc640 1 -- 172.21.15.81:0/2086151815 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639c003520 con 0x7f63b406c490 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b3fff640 1 -- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 msgr2=0x7f63b40d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b3fff640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b40d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b3fff640 1 -- 172.21.15.81:0/2086151815 >> v1:172.21.15.81:6789/0 conn(0x7f63b406c490 legacy=0x7f63b40b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b3fff640 1 -- 172.21.15.81:0/2086151815 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b406cf30 con 0x7f63b40b1ea0 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b37fe640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b40d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.064+0000 7f63b3fff640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b40b1ea0 0x7f63b40d0380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009d90 tx=0x7f63ac02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=399aa4b248fbb17c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b27fc640 1 -- 172.21.15.81:0/2086151815 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac039070 con 0x7f63b40b1ea0 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b27fc640 1 -- 172.21.15.81:0/2086151815 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63ac02cc50 con 0x7f63b40b1ea0 2024-03-18T00:25:35.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b27fc640 1 -- 172.21.15.81:0/2086151815 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63ac034440 con 0x7f63b40b1ea0 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 -- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b40b1ea0 msgr2=0x7f63b40d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b40b1ea0 0x7f63b40d0380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f63ac009d90 tx=0x7f63ac02bea0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 -- 172.21.15.81:0/2086151815 shutdown_connections 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b40b1ea0 0x7f63b40d0380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2086151815 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b40d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 -- 172.21.15.81:0/2086151815 >> 172.21.15.81:0/2086151815 conn(0x7f63b40d1ea0 msgr2=0x7f63b40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 -- 172.21.15.81:0/2086151815 shutdown_connections 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.065+0000 7f63b9e63640 1 -- 172.21.15.81:0/2086151815 wait complete. 2024-03-18T00:25:35.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.066+0000 7f63b9e63640 1 Processor -- start 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 -- start start 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b406c490 0x7f63b4158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b409c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63b40b31f0 con 0x7f63b40b1ea0 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f63b406d4f0 con 0x7f63b406c490 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b9e63640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63b40cc4f0 con 0x7f63b40cdef0 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59620/0 (socket says 172.21.15.81:59620) 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b2ffd640 1 -- 172.21.15.81:0/2119026312 learned_addr learned my addr 172.21.15.81:0/2119026312 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b3fff640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b409c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.067+0000 7f63b37fe640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b406c490 0x7f63b4158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 -- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 msgr2=0x7f63b409c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b409c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 -- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b406c490 msgr2=0x7f63b4158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b406c490 0x7f63b4158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 -- 172.21.15.81:0/2119026312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b4158e80 con 0x7f63b40b1ea0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b2ffd640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c410 tx=0x7f63a800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a8017070 con 0x7f63b40b1ea0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63a8005ce0 con 0x7f63b40b1ea0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63b41f8130 con 0x7f63b40b1ea0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63a80072f0 con 0x7f63b40b1ea0 2024-03-18T00:25:35.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.068+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63b4158140 con 0x7f63b40b1ea0 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.069+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63b40684e0 con 0x7f63b40b1ea0 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.069+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f63a801a070 con 0x7f63b40b1ea0 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.070+0000 7f639bfff640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 0x7f63a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.070+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f63a8089e70 con 0x7f63b40b1ea0 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.070+0000 7f63b37fe640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 0x7f63a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.070+0000 7f63b37fe640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 0x7f63a006e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009560 tx=0x7f63a4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.074+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f63b40684e0 con 0x7f63b40b1ea0 2024-03-18T00:25:35.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.248+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f63b40b2560 con 0x7f63b40b1ea0 2024-03-18T00:25:35.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.248+0000 7f639bfff640 1 -- 172.21.15.81:0/2119026312 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f63b40b2560 con 0x7f63b40b1ea0 2024-03-18T00:25:35.249 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:35.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 msgr2=0x7f63a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 0x7f63a006e090 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f63a4009560 tx=0x7f63a4009190 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 msgr2=0x7f63b40caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f63a800c410 tx=0x7f63a800c8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 shutdown_connections 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63b40cdef0 0x7f63b409c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f63a006bbd0 0x7f63a006e090 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63b40b1ea0 0x7f63b40caa90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 --2- 172.21.15.81:0/2119026312 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f63b406c490 0x7f63b4158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 >> 172.21.15.81:0/2119026312 conn(0x7f63b40d1ea0 msgr2=0x7f63b40b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 shutdown_connections 2024-03-18T00:25:35.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.250+0000 7f63b9e63640 1 -- 172.21.15.81:0/2119026312 wait complete. 2024-03-18T00:25:35.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.364+0000 7f317ef1b640 1 Processor -- start 2024-03-18T00:25:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.364+0000 7f317ef1b640 1 -- start start 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317ef1b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f317815c430 0x7f317806ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317ef1b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f317806bb00 0x7f31780704d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317ef1b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f317815c8b0 con 0x7f317815c050 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317ef1b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3178070a10 con 0x7f317806bb00 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317ef1b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f317815cb90 con 0x7f317815c430 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f317806bb00 0x7f31780704d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f317806bb00 0x7f31780704d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59626/0 (socket says 172.21.15.81:59626) 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 -- 172.21.15.81:0/1321270780 learned_addr learned my addr 172.21.15.81:0/1321270780 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f3177fff640 1 --2- 172.21.15.81:0/1321270780 >> v2:172.21.15.136:3300/0 conn(0x7f317815c430 0x7f317806ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 -- 172.21.15.81:0/1321270780 >> v2:172.21.15.136:3300/0 conn(0x7f317815c430 msgr2=0x7f317806ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:35.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 --2- 172.21.15.81:0/1321270780 >> v2:172.21.15.136:3300/0 conn(0x7f317815c430 0x7f317806ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 -- 172.21.15.81:0/1321270780 >> v1:172.21.15.136:6789/0 conn(0x7f317815c050 legacy=0x7f317806b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.365+0000 7f317d4b8640 1 -- 172.21.15.81:0/1321270780 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317815ce70 con 0x7f317806bb00 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.366+0000 7f317d4b8640 1 --2- 172.21.15.81:0/1321270780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317806bb00 0x7f31780704d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f317809f150 tx=0x7f317002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf380d58f53dfe8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.366+0000 7f31777fe640 1 -- 172.21.15.81:0/1321270780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317002cb20 con 0x7f317806bb00 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.366+0000 7f31777fe640 1 -- 172.21.15.81:0/1321270780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f317002ccc0 con 0x7f317806bb00 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.366+0000 7f31777fe640 1 -- 172.21.15.81:0/1321270780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3170034610 con 0x7f317806bb00 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 -- 172.21.15.81:0/1321270780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317806bb00 msgr2=0x7f31780704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 --2- 172.21.15.81:0/1321270780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317806bb00 0x7f31780704d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f317809f150 tx=0x7f317002bf80 comp rx=0 tx=0).stop 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 -- 172.21.15.81:0/1321270780 shutdown_connections 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 --2- 172.21.15.81:0/1321270780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317806bb00 0x7f31780704d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 --2- 172.21.15.81:0/1321270780 >> v2:172.21.15.136:3300/0 conn(0x7f317815c430 0x7f317806ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 -- 172.21.15.81:0/1321270780 >> 172.21.15.81:0/1321270780 conn(0x7f31780b2b20 msgr2=0x7f31780b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 -- 172.21.15.81:0/1321270780 shutdown_connections 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.367+0000 7f317ef1b640 1 -- 172.21.15.81:0/1321270780 wait complete. 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.368+0000 7f317ef1b640 1 Processor -- start 2024-03-18T00:25:35.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.368+0000 7f317ef1b640 1 -- start start 2024-03-18T00:25:35.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f317806bb00 0x7f31780b61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f317815c430 0x7f31780c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f31780720d0 con 0x7f317815c050 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f317815d430 con 0x7f317806bb00 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3178072250 con 0x7f317815c430 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59628/0 (socket says 172.21.15.81:59628) 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 -- 172.21.15.81:0/3973506946 learned_addr learned my addr 172.21.15.81:0/3973506946 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ccb7640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f317806bb00 0x7f31780b61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317d4b8640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f317815c430 0x7f31780c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 -- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f317815c430 msgr2=0x7f31780c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f317815c430 0x7f31780c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 -- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f317806bb00 msgr2=0x7f31780b61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f317806bb00 0x7f31780b61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 -- 172.21.15.81:0/3973506946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31780cad00 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f3177fff640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f316400e870 tx=0x7f316400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3164017070 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f316400c940 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316400cd30 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31780c8200 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.369+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31780c87c0 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.370+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317804f540 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.371+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f316401a070 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.371+0000 7f31757fa640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 0x7f315c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.371+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f316408a890 con 0x7f317815c050 2024-03-18T00:25:35.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.371+0000 7f317ccb7640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 0x7f315c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.372+0000 7f317ccb7640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 0x7f315c06e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f316c001780 tx=0x7f316c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.376+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3164058d30 con 0x7f317815c050 2024-03-18T00:25:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.546+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f317815d9f0 con 0x7f317815c050 2024-03-18T00:25:35.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.547+0000 7f31757fa640 1 -- 172.21.15.81:0/3973506946 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f316405cdd0 con 0x7f317815c050 2024-03-18T00:25:35.548 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 msgr2=0x7f315c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 0x7f315c06e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f316c001780 tx=0x7f316c009040 comp rx=0 tx=0).stop 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 msgr2=0x7f31780c75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f316400e870 tx=0x7f316400ed30 comp rx=0 tx=0).stop 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 shutdown_connections 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f317815c430 0x7f31780c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f315c06bbd0 0x7f315c06e090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f317815c050 0x7f31780c75a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 --2- 172.21.15.81:0/3973506946 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f317806bb00 0x7f31780b61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 >> 172.21.15.81:0/3973506946 conn(0x7f31780b2b20 msgr2=0x7f317815df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 shutdown_connections 2024-03-18T00:25:35.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.549+0000 7f317ef1b640 1 -- 172.21.15.81:0/3973506946 wait complete. 2024-03-18T00:25:35.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.663+0000 7f2918353640 1 Processor -- start 2024-03-18T00:25:35.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.663+0000 7f2918353640 1 -- start start 2024-03-18T00:25:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f2918353640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f2918353640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29100cda10 con 0x7f2910145700 2024-03-18T00:25:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f2918353640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29100cdcf0 con 0x7f2910072d40 2024-03-18T00:25:35.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f2918353640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f29100cd7c0 con 0x7f2910160170 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f29160ef640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2910145700 0x7f291015fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43640/0 (socket says 172.21.15.81:43640) 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f29160ef640 1 -- 172.21.15.81:0/855505603 learned_addr learned my addr 172.21.15.81:0/855505603 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f29158ee640 1 --2- 172.21.15.81:0/855505603 >> v2:172.21.15.136:3300/0 conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347679829 0 0) 0x7f29100cda10 con 0x7f2910145700 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.664+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28fc003520 con 0x7f2910145700 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104262174 0 0) 0x7f29100cdcf0 con 0x7f2910072d40 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f29100cda10 con 0x7f2910072d40 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29158ee640 1 -- 172.21.15.81:0/855505603 >> v1:172.21.15.136:6789/0 conn(0x7f2910072d40 legacy=0x7f29100cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29158ee640 1 -- 172.21.15.81:0/855505603 >> v1:172.21.15.81:6789/0 conn(0x7f2910145700 legacy=0x7f291015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2815182071 0 0) 0x7f28fc003520 con 0x7f2910145700 2024-03-18T00:25:35.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29158ee640 1 -- 172.21.15.81:0/855505603 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29100cdfd0 con 0x7f2910160170 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.665+0000 7f29158ee640 1 --2- 172.21.15.81:0/855505603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29100cd940 tx=0x7f290002b6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973bbd48c92378c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900037070 con 0x7f2910160170 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2900030510 con 0x7f2910160170 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f29150ed640 1 -- 172.21.15.81:0/855505603 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29080019f0 con 0x7f2910160170 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 -- 172.21.15.81:0/855505603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 msgr2=0x7f291006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 --2- 172.21.15.81:0/855505603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f29100cd940 tx=0x7f290002b6f0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 -- 172.21.15.81:0/855505603 shutdown_connections 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 --2- 172.21.15.81:0/855505603 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 -- 172.21.15.81:0/855505603 >> 172.21.15.81:0/855505603 conn(0x7f29100cfbf0 msgr2=0x7f29100cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 -- 172.21.15.81:0/855505603 shutdown_connections 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.666+0000 7f2918353640 1 -- 172.21.15.81:0/855505603 wait complete. 2024-03-18T00:25:35.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.667+0000 7f2918353640 1 Processor -- start 2024-03-18T00:25:35.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.667+0000 7f2918353640 1 -- start start 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2910145700 0x7f29100b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29100ce7d0 con 0x7f2910072d40 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f29100ce340 con 0x7f2910160170 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f2918353640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f29100ce950 con 0x7f2910145700 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60054/0 (socket says 172.21.15.81:60054) 2024-03-18T00:25:35.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 -- 172.21.15.81:0/511998678 learned_addr learned my addr 172.21.15.81:0/511998678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29158ee640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2910145700 0x7f29100b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29168f0640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 -- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2910145700 msgr2=0x7f29100b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2910145700 0x7f29100b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 -- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 msgr2=0x7f291006cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 -- 172.21.15.81:0/511998678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f291015c540 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.668+0000 7f29160ef640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2908001f30 tx=0x7f290800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.669+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908017070 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.669+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2908012400 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.669+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2908012870 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.669+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291015c7e0 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.669+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f291015cda0 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.670+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f291004f540 con 0x7f2910072d40 2024-03-18T00:25:35.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.670+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f290801a070 con 0x7f2910072d40 2024-03-18T00:25:35.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.670+0000 7f2906ffd640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 0x7f28f406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.671+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f290808aa30 con 0x7f2910072d40 2024-03-18T00:25:35.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.671+0000 7f29158ee640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 0x7f28f406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.671+0000 7f29158ee640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 0x7f28f406e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2900034000 tx=0x7f2900008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.675+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2908058ed0 con 0x7f2910072d40 2024-03-18T00:25:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.847+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f29100af7f0 con 0x7f2910072d40 2024-03-18T00:25:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.848+0000 7f2906ffd640 1 -- 172.21.15.81:0/511998678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f290805cf70 con 0x7f2910072d40 2024-03-18T00:25:35.849 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 msgr2=0x7f28f406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 0x7f28f406e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2900034000 tx=0x7f2900008030 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 msgr2=0x7f291015b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2908001f30 tx=0x7f290800a430 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 shutdown_connections 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2910160170 0x7f291006cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2910145700 0x7f29100b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28f406bc00 0x7f28f406e0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 --2- 172.21.15.81:0/511998678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2910072d40 0x7f291015b6c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 >> 172.21.15.81:0/511998678 conn(0x7f29100cfbf0 msgr2=0x7f291006dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 shutdown_connections 2024-03-18T00:25:35.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.850+0000 7f2918353640 1 -- 172.21.15.81:0/511998678 wait complete. 2024-03-18T00:25:35.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 Processor -- start 2024-03-18T00:25:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 -- start start 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f71ac1622b0 0x7f71ac0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 0x7f71ac162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71ac0b3440 con 0x7f71ac0cec80 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f71ac0d16c0 con 0x7f71ac1622b0 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.961+0000 7f71b1473640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac0d2660 con 0x7f71ac162690 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71ab7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f71ac0cec80 0x7f71ac0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43654/0 (socket says 172.21.15.81:43654) 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aaffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f71ac1622b0 0x7f71ac0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71ab7fe640 1 -- 172.21.15.81:0/4058540813 learned_addr learned my addr 172.21.15.81:0/4058540813 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aa7fc640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 0x7f71ac162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71a9ffb640 1 -- 172.21.15.81:0/4058540813 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519979548 0 0) 0x7f71ac0b3440 con 0x7f71ac0cec80 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aaffd640 1 -- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 msgr2=0x7f71ac162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aaffd640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 0x7f71ac162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aaffd640 1 -- 172.21.15.81:0/4058540813 >> v1:172.21.15.81:6789/0 conn(0x7f71ac0cec80 legacy=0x7f71ac0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aaffd640 1 -- 172.21.15.81:0/4058540813 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac0d20a0 con 0x7f71ac1622b0 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.962+0000 7f71aa7fc640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 0x7f71ac162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71aaffd640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac1622b0 0x7f71ac0d10d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24ec5ed920dd1ee6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71a9ffb640 1 -- 172.21.15.81:0/4058540813 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4039070 con 0x7f71ac1622b0 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71a9ffb640 1 -- 172.21.15.81:0/4058540813 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a402cb30 con 0x7f71ac1622b0 2024-03-18T00:25:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71a9ffb640 1 -- 172.21.15.81:0/4058540813 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a4034440 con 0x7f71ac1622b0 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 -- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac1622b0 msgr2=0x7f71ac0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac1622b0 0x7f71ac0d10d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f71a4009d90 tx=0x7f71a402bd80 comp rx=0 tx=0).stop 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 -- 172.21.15.81:0/4058540813 shutdown_connections 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac162690 0x7f71ac162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 --2- 172.21.15.81:0/4058540813 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac1622b0 0x7f71ac0d10d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 -- 172.21.15.81:0/4058540813 >> 172.21.15.81:0/4058540813 conn(0x7f71ac0d4070 msgr2=0x7f71ac0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 -- 172.21.15.81:0/4058540813 shutdown_connections 2024-03-18T00:25:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.963+0000 7f71b1473640 1 -- 172.21.15.81:0/4058540813 wait complete. 2024-03-18T00:25:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 Processor -- start 2024-03-18T00:25:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 -- start start 2024-03-18T00:25:35.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac0cec80 0x7f71ac156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac162690 0x7f71ac157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac15faa0 con 0x7f71ac1622b0 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f71ac0d2ab0 con 0x7f71ac162690 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71b1473640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f71ac15fc20 con 0x7f71ac0cec80 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60066/0 (socket says 172.21.15.81:60066) 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71aa7fc640 1 -- 172.21.15.81:0/1200168374 learned_addr learned my addr 172.21.15.81:0/1200168374 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71aaffd640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac0cec80 0x7f71ac156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.965+0000 7f71ab7fe640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac162690 0x7f71ac157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 -- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac0cec80 msgr2=0x7f71ac156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac0cec80 0x7f71ac156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 -- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac162690 msgr2=0x7f71ac157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:35.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac162690 0x7f71ac157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 -- 172.21.15.81:0/1200168374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71ac0b5410 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71aa7fc640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71a000e960 tx=0x7f71a000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a0017070 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71a000ca00 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71a000cdd0 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71ac1f7e80 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.966+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71ac1f8440 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.967+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71ac04f5b0 con 0x7f71ac1622b0 2024-03-18T00:25:35.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.967+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f71a001a070 con 0x7f71ac1622b0 2024-03-18T00:25:35.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.968+0000 7f71937fe640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 0x7f719806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:35.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.968+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f71a008a940 con 0x7f71ac1622b0 2024-03-18T00:25:35.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.968+0000 7f71aaffd640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 0x7f719806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:35.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.968+0000 7f71aaffd640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 0x7f719806e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:35.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:35.972+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f71a0058d60 con 0x7f71ac1622b0 2024-03-18T00:25:36.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.182+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71ac0d18d0 con 0x7f71ac1622b0 2024-03-18T00:25:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.182+0000 7f71937fe640 1 -- 172.21.15.81:0/1200168374 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f71a005ce00 con 0x7f71ac1622b0 2024-03-18T00:25:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:36.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:25:36.183 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 msgr2=0x7f719806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 0x7f719806e090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71a4036000 tx=0x7f71a4030000 comp rx=0 tx=0).stop 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 msgr2=0x7f71ac0b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f71a000e960 tx=0x7f71a000ee20 comp rx=0 tx=0).stop 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 shutdown_connections 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f71ac162690 0x7f71ac157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f719806bbd0 0x7f719806e090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71ac1622b0 0x7f71ac0b4a30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 --2- 172.21.15.81:0/1200168374 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f71ac0cec80 0x7f71ac156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 >> 172.21.15.81:0/1200168374 conn(0x7f71ac0d4070 msgr2=0x7f71ac0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 shutdown_connections 2024-03-18T00:25:36.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.184+0000 7f71b1473640 1 -- 172.21.15.81:0/1200168374 wait complete. 2024-03-18T00:25:36.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 Processor -- start 2024-03-18T00:25:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 -- start start 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff92015c3a0 0x7ff9200d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 0x7ff9200af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9200cd510 con 0x7ff92015c780 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff9200cd7f0 con 0x7ff92015c3a0 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.295+0000 7ff926c85640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200cdad0 con 0x7ff9200cef80 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff91ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff92015c780 0x7ff9200ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43668/0 (socket says 172.21.15.81:43668) 2024-03-18T00:25:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff91ffff640 1 -- 172.21.15.81:0/2548555313 learned_addr learned my addr 172.21.15.81:0/2548555313 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff925222640 1 --2- 172.21.15.81:0/2548555313 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 0x7ff9200af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff924a21640 1 --2- 172.21.15.81:0/2548555313 >> v2:172.21.15.136:3300/0 conn(0x7ff92015c3a0 0x7ff9200d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff91f7fe640 1 -- 172.21.15.81:0/2548555313 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500472474 0 0) 0x7ff9200cd510 con 0x7ff92015c780 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff91f7fe640 1 -- 172.21.15.81:0/2548555313 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff908003520 con 0x7ff92015c780 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff925222640 1 -- 172.21.15.81:0/2548555313 >> v2:172.21.15.136:3300/0 conn(0x7ff92015c3a0 msgr2=0x7ff9200d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff925222640 1 --2- 172.21.15.81:0/2548555313 >> v2:172.21.15.136:3300/0 conn(0x7ff92015c3a0 0x7ff9200d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff925222640 1 -- 172.21.15.81:0/2548555313 >> v1:172.21.15.81:6789/0 conn(0x7ff92015c780 legacy=0x7ff9200ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.296+0000 7ff925222640 1 -- 172.21.15.81:0/2548555313 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9200cddb0 con 0x7ff9200cef80 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff925222640 1 --2- 172.21.15.81:0/2548555313 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 0x7ff9200af000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097a0 tx=0x7ff91002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=943d99945f67c607 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff91f7fe640 1 -- 172.21.15.81:0/2548555313 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910035020 con 0x7ff9200cef80 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff91f7fe640 1 -- 172.21.15.81:0/2548555313 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff910031830 con 0x7ff9200cef80 2024-03-18T00:25:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff91f7fe640 1 -- 172.21.15.81:0/2548555313 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff910031c00 con 0x7ff9200cef80 2024-03-18T00:25:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 -- 172.21.15.81:0/2548555313 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 msgr2=0x7ff9200af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 --2- 172.21.15.81:0/2548555313 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 0x7ff9200af000 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff9100097a0 tx=0x7ff91002b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 -- 172.21.15.81:0/2548555313 shutdown_connections 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 --2- 172.21.15.81:0/2548555313 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff9200cef80 0x7ff9200af000 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 --2- 172.21.15.81:0/2548555313 >> v2:172.21.15.136:3300/0 conn(0x7ff92015c3a0 0x7ff9200d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 -- 172.21.15.81:0/2548555313 >> 172.21.15.81:0/2548555313 conn(0x7ff9200d1e60 msgr2=0x7ff9200d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 -- 172.21.15.81:0/2548555313 shutdown_connections 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.297+0000 7ff926c85640 1 -- 172.21.15.81:0/2548555313 wait complete. 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.298+0000 7ff926c85640 1 Processor -- start 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 -- start start 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff92015c3a0 0x7ff9200ca510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff92015c780 0x7ff9200c6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200cf590 con 0x7ff9200cef80 2024-03-18T00:25:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff9200cf410 con 0x7ff92015c780 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff926c85640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff9200af540 con 0x7ff92015c3a0 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.299+0000 7ff924a21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60080/0 (socket says 172.21.15.81:60080) 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 -- 172.21.15.81:0/4081968120 learned_addr learned my addr 172.21.15.81:0/4081968120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff925222640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff92015c780 0x7ff9200c6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff91ffff640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff92015c3a0 0x7ff9200ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 -- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff92015c3a0 msgr2=0x7ff9200ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff92015c3a0 0x7ff9200ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 -- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff92015c780 msgr2=0x7ff9200c6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff92015c780 0x7ff9200c6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 -- 172.21.15.81:0/4081968120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff92014e7e0 con 0x7ff9200cef80 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff924a21640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff918009db0 tx=0x7ff91800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918018020 con 0x7ff9200cef80 2024-03-18T00:25:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff918014480 con 0x7ff9200cef80 2024-03-18T00:25:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9201f55d0 con 0x7ff9200cef80 2024-03-18T00:25:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff918014850 con 0x7ff9200cef80 2024-03-18T00:25:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.300+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9201f5b90 con 0x7ff9200cef80 2024-03-18T00:25:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.301+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff92004f5b0 con 0x7ff9200cef80 2024-03-18T00:25:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.301+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff918005d10 con 0x7ff9200cef80 2024-03-18T00:25:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.302+0000 7ff91d7fa640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 0x7ff90c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.302+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff91808b430 con 0x7ff9200cef80 2024-03-18T00:25:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.302+0000 7ff91ffff640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 0x7ff90c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.302+0000 7ff91ffff640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 0x7ff90c06e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9200c8250 tx=0x7ff914009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.306+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff918022070 con 0x7ff9200cef80 2024-03-18T00:25:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.482+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff9200ccc70 con 0x7ff9200cef80 2024-03-18T00:25:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.483+0000 7ff91d7fa640 1 -- 172.21.15.81:0/4081968120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7ff918010040 con 0x7ff9200cef80 2024-03-18T00:25:36.484 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:36.484 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 msgr2=0x7ff90c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 0x7ff90c06e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff9200c8250 tx=0x7ff914009040 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 msgr2=0x7ff92014e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff918009db0 tx=0x7ff91800c490 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 shutdown_connections 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff92015c780 0x7ff9200c6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff92015c3a0 0x7ff9200ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff90c06bbd0 0x7ff90c06e090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 --2- 172.21.15.81:0/4081968120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9200cef80 0x7ff92014e2a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 >> 172.21.15.81:0/4081968120 conn(0x7ff9200d1e60 msgr2=0x7ff9200d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 shutdown_connections 2024-03-18T00:25:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.486+0000 7ff926c85640 1 -- 172.21.15.81:0/4081968120 wait complete. 2024-03-18T00:25:36.497 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:36.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:36.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.601+0000 7f1e02ccc640 1 Processor -- start 2024-03-18T00:25:36.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.601+0000 7f1e02ccc640 1 -- start start 2024-03-18T00:25:36.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.601+0000 7f1e02ccc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1dfc06c490 0x7f1dfc0d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e02ccc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dfc0b1ea0 0x7f1dfc0d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e02ccc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dfc0ce2d0 con 0x7f1dfc0cdef0 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e02ccc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc06c970 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e02ccc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1dfc06cc50 con 0x7f1dfc06c490 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e01269640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1dfc0b1ea0 0x7f1dfc0d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e00a68640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1dfc0cdef0 0x7f1dfc0b1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43676/0 (socket says 172.21.15.81:43676) 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e00a68640 1 -- 172.21.15.81:0/412811108 learned_addr learned my addr 172.21.15.81:0/412811108 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1dfbfff640 1 --2- 172.21.15.81:0/412811108 >> v2:172.21.15.136:3300/0 conn(0x7f1dfc06c490 0x7f1dfc0d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e01269640 1 -- 172.21.15.81:0/412811108 >> v2:172.21.15.136:3300/0 conn(0x7f1dfc06c490 msgr2=0x7f1dfc0d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e01269640 1 --2- 172.21.15.81:0/412811108 >> v2:172.21.15.136:3300/0 conn(0x7f1dfc06c490 0x7f1dfc0d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e01269640 1 -- 172.21.15.81:0/412811108 >> v1:172.21.15.81:6789/0 conn(0x7f1dfc0cdef0 legacy=0x7f1dfc0b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1dfb7fe640 1 -- 172.21.15.81:0/412811108 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957562154 0 0) 0x7f1dfc0ce2d0 con 0x7f1dfc0cdef0 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.602+0000 7f1e01269640 1 -- 172.21.15.81:0/412811108 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc06cf30 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e01269640 1 --2- 172.21.15.81:0/412811108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0d0380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc073430 tx=0x7f1df402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8bb18a9c3b800e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1dfb7fe640 1 -- 172.21.15.81:0/412811108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4039070 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1dfb7fe640 1 -- 172.21.15.81:0/412811108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df402cc80 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1dfb7fe640 1 -- 172.21.15.81:0/412811108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4034660 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 -- 172.21.15.81:0/412811108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc0b1ea0 msgr2=0x7f1dfc0d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/412811108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0d0380 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc073430 tx=0x7f1df402bed0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 -- 172.21.15.81:0/412811108 shutdown_connections 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/412811108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0d0380 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/412811108 >> v2:172.21.15.136:3300/0 conn(0x7f1dfc06c490 0x7f1dfc0d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 -- 172.21.15.81:0/412811108 >> 172.21.15.81:0/412811108 conn(0x7f1dfc0d1ea0 msgr2=0x7f1dfc0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 -- 172.21.15.81:0/412811108 shutdown_connections 2024-03-18T00:25:36.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.603+0000 7f1e02ccc640 1 -- 172.21.15.81:0/412811108 wait complete. 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.604+0000 7f1e02ccc640 1 Processor -- start 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 -- start start 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0b00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 0x7f1dfc15c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc0b31f0 con 0x7f1dfc06c490 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1dfc06d4f0 con 0x7f1dfc0b1ea0 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e02ccc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1dfc0cc4f0 con 0x7f1dfc0cdef0 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e00a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e00a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60096/0 (socket says 172.21.15.81:60096) 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.605+0000 7f1e00a68640 1 -- 172.21.15.81:0/1572809998 learned_addr learned my addr 172.21.15.81:0/1572809998 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1dfbfff640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0b00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e01269640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 0x7f1dfc15c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 -- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 msgr2=0x7f1dfc15c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 0x7f1dfc15c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 -- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dfc0b1ea0 msgr2=0x7f1dfc0b00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0b00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 -- 172.21.15.81:0/1572809998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dfc0b77f0 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e01269640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 0x7f1dfc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e00a68640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c4d0 tx=0x7f1df000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0018070 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1df0007500 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df0004a20 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dfc0b7510 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.606+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dfc0cba30 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.607+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dfc04f540 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.607+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1df001b070 con 0x7f1dfc06c490 2024-03-18T00:25:36.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.608+0000 7f1df97fa640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 0x7f1de006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.608+0000 7f1dfbfff640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 0x7f1de006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.608+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1df0089c30 con 0x7f1dfc06c490 2024-03-18T00:25:36.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.608+0000 7f1dfbfff640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 0x7f1de006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc1f7050 tx=0x7f1de8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.612+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1df0058160 con 0x7f1dfc06c490 2024-03-18T00:25:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.787+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1dfc0b3770 con 0x7f1dfc06c490 2024-03-18T00:25:36.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.788+0000 7f1df97fa640 1 -- 172.21.15.81:0/1572809998 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1df005c200 con 0x7f1dfc06c490 2024-03-18T00:25:36.788 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 msgr2=0x7f1de006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 0x7f1de006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc1f7050 tx=0x7f1de8009190 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 msgr2=0x7f1dfc0afb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1df000c4d0 tx=0x7f1df000c990 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 shutdown_connections 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1dfc0cdef0 0x7f1dfc15c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1dfc0b1ea0 0x7f1dfc0b00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1de006bbd0 0x7f1de006e090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 --2- 172.21.15.81:0/1572809998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dfc06c490 0x7f1dfc0afb90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 >> 172.21.15.81:0/1572809998 conn(0x7f1dfc0d1ea0 msgr2=0x7f1dfc0d0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 shutdown_connections 2024-03-18T00:25:36.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.790+0000 7f1e02ccc640 1 -- 172.21.15.81:0/1572809998 wait complete. 2024-03-18T00:25:36.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:36.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 Processor -- start 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 -- start start 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 0x7fcc480d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc480ce2d0 con 0x7fcc480b1ea0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc4806c970 con 0x7fcc480cdef0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4d17e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcc4806cc50 con 0x7fcc4806c490 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.904+0000 7fcc4759e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcc480b1ea0 0x7fcc480d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43682/0 (socket says 172.21.15.81:43682) 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc4759e640 1 -- 172.21.15.81:0/2874800200 learned_addr learned my addr 172.21.15.81:0/2874800200 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc3ffff640 1 --2- 172.21.15.81:0/2874800200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 0x7fcc480d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387585552 0 0) 0x7fcc480ce2d0 con 0x7fcc480b1ea0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc34003520 con 0x7fcc480b1ea0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330108554 0 0) 0x7fcc4806c970 con 0x7fcc480cdef0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc480ce2d0 con 0x7fcc480cdef0 2024-03-18T00:25:36.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc3ffff640 1 -- 172.21.15.81:0/2874800200 >> v1:172.21.15.136:6789/0 conn(0x7fcc480cdef0 legacy=0x7fcc480b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc3ffff640 1 -- 172.21.15.81:0/2874800200 >> v1:172.21.15.81:6789/0 conn(0x7fcc480b1ea0 legacy=0x7fcc480d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.905+0000 7fcc3ffff640 1 -- 172.21.15.81:0/2874800200 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc4806cf30 con 0x7fcc4806c490 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc3ffff640 1 --2- 172.21.15.81:0/2874800200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 0x7fcc480d29c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc300097d0 tx=0x7fcc3002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a989fe90a2daba server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30035020 con 0x7fcc4806c490 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc30031890 con 0x7fcc4806c490 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4659c640 1 -- 172.21.15.81:0/2874800200 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc30031c40 con 0x7fcc4806c490 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2874800200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 msgr2=0x7fcc480d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2874800200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 0x7fcc480d29c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcc300097d0 tx=0x7fcc3002b930 comp rx=0 tx=0).stop 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2874800200 shutdown_connections 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2874800200 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc4806c490 0x7fcc480d29c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2874800200 >> 172.21.15.81:0/2874800200 conn(0x7fcc480d1ea0 msgr2=0x7fcc480d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:36.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2874800200 shutdown_connections 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.906+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2874800200 wait complete. 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 Processor -- start 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 -- start start 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc480b1ea0 0x7fcc480b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc480cdef0 0x7fcc480b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc480b31f0 con 0x7fcc4806c490 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcc4806d4f0 con 0x7fcc480b1ea0 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4d17e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcc480cc4f0 con 0x7fcc480cdef0 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc46d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60104/0 (socket says 172.21.15.81:60104) 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc46d9d640 1 -- 172.21.15.81:0/2451730026 learned_addr learned my addr 172.21.15.81:0/2451730026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:36.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc3ffff640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc480b1ea0 0x7fcc480b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.908+0000 7fcc4759e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc480cdef0 0x7fcc480b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 -- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc480cdef0 msgr2=0x7fcc480b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc480cdef0 0x7fcc480b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 -- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc480b1ea0 msgr2=0x7fcc480b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc480b1ea0 0x7fcc480b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 -- 172.21.15.81:0/2451730026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc481f3ff0 con 0x7fcc4806c490 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc46d9d640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c460 tx=0x7fcc3800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38017070 con 0x7fcc4806c490 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc380052f0 con 0x7fcc4806c490 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc4809f760 con 0x7fcc4806c490 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc38003830 con 0x7fcc4806c490 2024-03-18T00:25:36.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.909+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc480ca3c0 con 0x7fcc4806c490 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.910+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc480cf9d0 con 0x7fcc4806c490 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.910+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fcc3801a070 con 0x7fcc4806c490 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.911+0000 7fcc3f7fe640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 0x7fcc2806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.911+0000 7fcc3ffff640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 0x7fcc2806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.911+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fcc38089eb0 con 0x7fcc4806c490 2024-03-18T00:25:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.911+0000 7fcc3ffff640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 0x7fcc2806e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:36.915+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fcc38058240 con 0x7fcc4806c490 2024-03-18T00:25:37.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.086+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fcc4804f540 con 0x7fcc4806c490 2024-03-18T00:25:37.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.087+0000 7fcc3f7fe640 1 -- 172.21.15.81:0/2451730026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fcc3805c2e0 con 0x7fcc4806c490 2024-03-18T00:25:37.087 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.088+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 msgr2=0x7fcc2806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.088+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 0x7fcc2806e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcc30036000 tx=0x7fcc30008030 comp rx=0 tx=0).stop 2024-03-18T00:25:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.088+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 msgr2=0x7fcc48157490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.088+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800c460 tx=0x7fcc3800c920 comp rx=0 tx=0).stop 2024-03-18T00:25:37.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.088+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 shutdown_connections 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc480cdef0 0x7fcc480b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc480b1ea0 0x7fcc480b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc2806bbd0 0x7fcc2806e090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 --2- 172.21.15.81:0/2451730026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc4806c490 0x7fcc48157490 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 >> 172.21.15.81:0/2451730026 conn(0x7fcc480d1ea0 msgr2=0x7fcc4806f2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 shutdown_connections 2024-03-18T00:25:37.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.089+0000 7fcc4d17e640 1 -- 172.21.15.81:0/2451730026 wait complete. 2024-03-18T00:25:37.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.202+0000 7f59c4812640 1 Processor -- start 2024-03-18T00:25:37.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.202+0000 7f59c4812640 1 -- start start 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59c4812640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59c0160170 0x7f59c006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59c4812640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f59c0072d40 0x7f59c00cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59c4812640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59c00cb790 con 0x7f59c0145700 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59c4812640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f59c00cd7c0 con 0x7f59c0160170 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59c4812640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f59c00ce340 con 0x7f59c0072d40 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59be59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f59c0145700 0x7f59c015fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43698/0 (socket says 172.21.15.81:43698) 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59b5d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f59c0160170 0x7f59c006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59be59c640 1 -- 172.21.15.81:0/3580696347 learned_addr learned my addr 172.21.15.81:0/3580696347 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59bed9d640 1 --2- 172.21.15.81:0/3580696347 >> v2:172.21.15.136:3300/0 conn(0x7f59c0072d40 0x7f59c00cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59b5d9b640 1 -- 172.21.15.81:0/3580696347 >> v2:172.21.15.136:3300/0 conn(0x7f59c0072d40 msgr2=0x7f59c00cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59b5d9b640 1 --2- 172.21.15.81:0/3580696347 >> v2:172.21.15.136:3300/0 conn(0x7f59c0072d40 0x7f59c00cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59b5d9b640 1 -- 172.21.15.81:0/3580696347 >> v1:172.21.15.81:6789/0 conn(0x7f59c0145700 legacy=0x7f59c015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59bdd9b640 1 -- 172.21.15.81:0/3580696347 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685620078 0 0) 0x7f59c00cb790 con 0x7f59c0145700 2024-03-18T00:25:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.203+0000 7f59b5d9b640 1 -- 172.21.15.81:0/3580696347 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00cda10 con 0x7f59c0160170 2024-03-18T00:25:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.204+0000 7f59b5d9b640 1 --2- 172.21.15.81:0/3580696347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0160170 0x7f59c006cdc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59c00af730 tx=0x7f59a802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a646d2c0ce5424e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.204+0000 7f59bdd9b640 1 -- 172.21.15.81:0/3580696347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8038070 con 0x7f59c0160170 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.204+0000 7f59bdd9b640 1 -- 172.21.15.81:0/3580696347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a8031710 con 0x7f59c0160170 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.204+0000 7f59bdd9b640 1 -- 172.21.15.81:0/3580696347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a8031ae0 con 0x7f59c0160170 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 -- 172.21.15.81:0/3580696347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0160170 msgr2=0x7f59c006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 --2- 172.21.15.81:0/3580696347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0160170 0x7f59c006cdc0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f59c00af730 tx=0x7f59a802b7b0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 -- 172.21.15.81:0/3580696347 shutdown_connections 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 --2- 172.21.15.81:0/3580696347 >> v2:172.21.15.136:3300/0 conn(0x7f59c0072d40 0x7f59c00cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 --2- 172.21.15.81:0/3580696347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0160170 0x7f59c006cdc0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 -- 172.21.15.81:0/3580696347 >> 172.21.15.81:0/3580696347 conn(0x7f59c00cfbf0 msgr2=0x7f59c00cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 -- 172.21.15.81:0/3580696347 shutdown_connections 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.205+0000 7f59c4812640 1 -- 172.21.15.81:0/3580696347 wait complete. 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.206+0000 7f59c4812640 1 Processor -- start 2024-03-18T00:25:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.206+0000 7f59c4812640 1 -- start start 2024-03-18T00:25:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59c0145700 0x7f59c00b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c0160170 0x7f59c0131f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59c0145ae0 con 0x7f59c0072d40 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f59c00cdfd0 con 0x7f59c0160170 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59c4812640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f59c0145c60 con 0x7f59c0145700 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60110/0 (socket says 172.21.15.81:60110) 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 -- 172.21.15.81:0/2305678892 learned_addr learned my addr 172.21.15.81:0/2305678892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59b5d9b640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59c0145700 0x7f59c00b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59bed9d640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c0160170 0x7f59c0131f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 -- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59c0145700 msgr2=0x7f59c00b38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59c0145700 0x7f59c00b38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 -- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c0160170 msgr2=0x7f59c0131f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c0160170 0x7f59c0131f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 -- 172.21.15.81:0/2305678892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c00b4280 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.207+0000 7f59be59c640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c4d0 tx=0x7f59b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.208+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0018070 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.208+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b0007500 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.208+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b0004a20 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.208+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c00b4560 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.208+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c0132bd0 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.209+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c004f540 con 0x7f59c0072d40 2024-03-18T00:25:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.209+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f59b001b070 con 0x7f59c0072d40 2024-03-18T00:25:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.209+0000 7f59b77fe640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 0x7f59a006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.210+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f59b0089c60 con 0x7f59c0072d40 2024-03-18T00:25:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.210+0000 7f59b5d9b640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 0x7f59a006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.210+0000 7f59b5d9b640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 0x7f59a006e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59a8035000 tx=0x7f59a8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.214+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f59b0058190 con 0x7f59c0072d40 2024-03-18T00:25:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.388+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f59c00d0420 con 0x7f59c0072d40 2024-03-18T00:25:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.388+0000 7f59b77fe640 1 -- 172.21.15.81:0/2305678892 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f59b005c230 con 0x7f59c0072d40 2024-03-18T00:25:37.389 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 msgr2=0x7f59a006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 0x7f59a006e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f59a8035000 tx=0x7f59a8008030 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 msgr2=0x7f59c00ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f59b000c4d0 tx=0x7f59b000c990 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 shutdown_connections 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f59c0160170 0x7f59c0131f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f59c0145700 0x7f59c00b38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f59a006bbd0 0x7f59a006e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 --2- 172.21.15.81:0/2305678892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59c0072d40 0x7f59c00ca460 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 >> 172.21.15.81:0/2305678892 conn(0x7f59c00cfbf0 msgr2=0x7f59c006e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 shutdown_connections 2024-03-18T00:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.390+0000 7f59c4812640 1 -- 172.21.15.81:0/2305678892 wait complete. 2024-03-18T00:25:37.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.501+0000 7fc1bb0c6640 1 Processor -- start 2024-03-18T00:25:37.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.501+0000 7fc1bb0c6640 1 -- start start 2024-03-18T00:25:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1bb0c6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc1b415e110 0x7fc1b40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1bb0c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1b415e4f0 0x7fc1b40cfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1bb0c6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b4071930 con 0x7fc1b406e9d0 2024-03-18T00:25:37.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1bb0c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b40d00a0 con 0x7fc1b415e4f0 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1bb0c6640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b4071c10 con 0x7fc1b415e110 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc1b415e4f0 0x7fc1b40cfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b9663640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc1b406e9d0 0x7fc1b406ee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43708/0 (socket says 172.21.15.81:43708) 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b9663640 1 -- 172.21.15.81:0/2267959207 learned_addr learned my addr 172.21.15.81:0/2267959207 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b8e62640 1 --2- 172.21.15.81:0/2267959207 >> v2:172.21.15.136:3300/0 conn(0x7fc1b415e110 0x7fc1b40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b3fff640 1 -- 172.21.15.81:0/2267959207 >> v2:172.21.15.136:3300/0 conn(0x7fc1b415e110 msgr2=0x7fc1b40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b3fff640 1 --2- 172.21.15.81:0/2267959207 >> v2:172.21.15.136:3300/0 conn(0x7fc1b415e110 0x7fc1b40cf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b3fff640 1 -- 172.21.15.81:0/2267959207 >> v1:172.21.15.81:6789/0 conn(0x7fc1b406e9d0 legacy=0x7fc1b406ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b3fff640 1 -- 172.21.15.81:0/2267959207 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b4071ef0 con 0x7fc1b415e4f0 2024-03-18T00:25:37.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.502+0000 7fc1b37fe640 1 -- 172.21.15.81:0/2267959207 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 652758661 0 0) 0x7fc1b4071930 con 0x7fc1b406e9d0 2024-03-18T00:25:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1b3fff640 1 --2- 172.21.15.81:0/2267959207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40cfb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc1b406d3c0 tx=0x7fc1a002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35d857d745b3813 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1b37fe640 1 -- 172.21.15.81:0/2267959207 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0035020 con 0x7fc1b415e4f0 2024-03-18T00:25:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1b37fe640 1 -- 172.21.15.81:0/2267959207 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a0031830 con 0x7fc1b415e4f0 2024-03-18T00:25:37.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1b37fe640 1 -- 172.21.15.81:0/2267959207 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0031c00 con 0x7fc1b415e4f0 2024-03-18T00:25:37.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/2267959207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e4f0 msgr2=0x7fc1b40cfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.503+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/2267959207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40cfb60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc1b406d3c0 tx=0x7fc1a002b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/2267959207 shutdown_connections 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/2267959207 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40cfb60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/2267959207 >> v2:172.21.15.136:3300/0 conn(0x7fc1b415e110 0x7fc1b40cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/2267959207 >> 172.21.15.81:0/2267959207 conn(0x7fc1b40ccfb0 msgr2=0x7fc1b40cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/2267959207 shutdown_connections 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.504+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/2267959207 wait complete. 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.505+0000 7fc1bb0c6640 1 Processor -- start 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.505+0000 7fc1bb0c6640 1 -- start start 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.505+0000 7fc1bb0c6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc1b406e9d0 0x7fc1b414d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40b4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40ada40 con 0x7fc1b415e110 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b40ad8c0 con 0x7fc1b415e4f0 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b40adbc0 con 0x7fc1b406e9d0 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60116/0 (socket says 172.21.15.81:60116) 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 -- 172.21.15.81:0/3762289447 learned_addr learned my addr 172.21.15.81:0/3762289447 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b8e62640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc1b406e9d0 0x7fc1b414d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b9663640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 -- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc1b406e9d0 msgr2=0x7fc1b414d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc1b406e9d0 0x7fc1b414d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 -- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 msgr2=0x7fc1b40b4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40b4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 -- 172.21.15.81:0/3762289447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b41f4190 con 0x7fc1b415e110 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b9663640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b3fff640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0000c00 tx=0x7fc1a00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0040070 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1a003a8f0 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0035040 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b41f4470 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.506+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b41f4a30 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.507+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1b404f5b0 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.508+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc1a004b060 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.508+0000 7fc1b17fa640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 0x7fc19806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.508+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc1a00ac240 con 0x7fc1b415e110 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.508+0000 7fc1b8e62640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 0x7fc19806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.508+0000 7fc1b8e62640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 0x7fc19806e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc1b406e220 tx=0x7fc1a8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.512+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc1a007ad30 con 0x7fc1b415e110 2024-03-18T00:25:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.724+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1b415d500 con 0x7fc1b415e110 2024-03-18T00:25:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.725+0000 7fc1b17fa640 1 -- 172.21.15.81:0/3762289447 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7fc1a007a630 con 0x7fc1b415e110 2024-03-18T00:25:37.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:37.726 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:25:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 msgr2=0x7fc19806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 0x7fc19806e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc1b406e220 tx=0x7fc1a8009190 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 msgr2=0x7fc1b40c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0000c00 tx=0x7fc1a00046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 shutdown_connections 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc1b415e4f0 0x7fc1b40b4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc19806bbd0 0x7fc19806e090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1b415e110 0x7fc1b40c54d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 --2- 172.21.15.81:0/3762289447 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc1b406e9d0 0x7fc1b414d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 >> 172.21.15.81:0/3762289447 conn(0x7fc1b40ccfb0 msgr2=0x7fc1b406ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 shutdown_connections 2024-03-18T00:25:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.727+0000 7fc1bb0c6640 1 -- 172.21.15.81:0/3762289447 wait complete. 2024-03-18T00:25:37.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:37.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.838+0000 7fb3a8f59640 1 Processor -- start 2024-03-18T00:25:37.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.838+0000 7fb3a8f59640 1 -- start start 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.838+0000 7fb3a8f59640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb3a40cda20 0x7fb3a406e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a8f59640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a40cf4f0 con 0x7fb3a40cde00 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a8f59640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3a415ec10 con 0x7fb3a406bf90 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a8f59640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb3a406b4f0 con 0x7fb3a40cda20 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a1d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb3a40cde00 0x7fb3a40cede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43724/0 (socket says 172.21.15.81:43724) 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a1d9b640 1 -- 172.21.15.81:0/3952655504 learned_addr learned my addr 172.21.15.81:0/3952655504 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a259c640 1 --2- 172.21.15.81:0/3952655504 >> v2:172.21.15.136:3300/0 conn(0x7fb3a40cda20 0x7fb3a406e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3823105497 0 0) 0x7fb398001110 con 0x7fb3a40cde00 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb38c003520 con 0x7fb3a40cde00 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a259c640 1 -- 172.21.15.81:0/3952655504 >> v1:172.21.15.136:6789/0 conn(0x7fb3a406bf90 legacy=0x7fb3a4162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470385502 0 0) 0x7fb3a415ec10 con 0x7fb3a406bf90 2024-03-18T00:25:37.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a259c640 1 -- 172.21.15.81:0/3952655504 >> v1:172.21.15.81:6789/0 conn(0x7fb3a40cde00 legacy=0x7fb3a40cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.839+0000 7fb3a259c640 1 -- 172.21.15.81:0/3952655504 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a415eef0 con 0x7fb3a40cda20 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.840+0000 7fb3a259c640 1 --2- 172.21.15.81:0/3952655504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a40cda20 0x7fb3a406e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42014f243fe196b5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.840+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c039070 con 0x7fb3a40cda20 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.840+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c02cd00 con 0x7fb3a40cda20 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.840+0000 7fb3a159a640 1 -- 172.21.15.81:0/3952655504 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c034660 con 0x7fb3a40cda20 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 -- 172.21.15.81:0/3952655504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a40cda20 msgr2=0x7fb3a406e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/3952655504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a40cda20 0x7fb3a406e680 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009d90 tx=0x7fb39c02bf50 comp rx=0 tx=0).stop 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 -- 172.21.15.81:0/3952655504 shutdown_connections 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/3952655504 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a40cda20 0x7fb3a406e680 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 -- 172.21.15.81:0/3952655504 >> 172.21.15.81:0/3952655504 conn(0x7fb3a40b2ab0 msgr2=0x7fb3a40b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 -- 172.21.15.81:0/3952655504 shutdown_connections 2024-03-18T00:25:37.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.841+0000 7fb3a8f59640 1 -- 172.21.15.81:0/3952655504 wait complete. 2024-03-18T00:25:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.842+0000 7fb3a8f59640 1 Processor -- start 2024-03-18T00:25:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.842+0000 7fb3a8f59640 1 -- start start 2024-03-18T00:25:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a40cda20 0x7fb3a414a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415f790 con 0x7fb3a40cde00 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a415f4b0 con 0x7fb3a406bf90 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb3a406ebc0 con 0x7fb3a40cda20 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:50348/0 (socket says 172.21.15.81:50348) 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60126/0 (socket says 172.21.15.81:60126) 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 -- 172.21.15.81:0/2870443033 learned_addr learned my addr 172.21.15.81:0/2870443033 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a1d9b640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a40cda20 0x7fb3a414a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 -- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a40cda20 msgr2=0x7fb3a414a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a40cda20 0x7fb3a414a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 -- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 msgr2=0x7fb3a40afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 -- 172.21.15.81:0/2870443033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a4158730 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a2d9d640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a259c640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c037040 tx=0x7fb39c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c039050 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb39c03a040 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a4158a10 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb39c003bd0 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.843+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a4158fd0 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.844+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a404f5b0 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.845+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb39c004030 con 0x7fb3a406bf90 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.845+0000 7fb392ffd640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 0x7fb38406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.845+0000 7fb3a1d9b640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 0x7fb38406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:37.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.845+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb39c0ad390 con 0x7fb3a406bf90 2024-03-18T00:25:37.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.846+0000 7fb3a1d9b640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 0x7fb38406e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb3a415a600 tx=0x7fb398009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:37.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:37.850+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb39c07b790 con 0x7fb3a406bf90 2024-03-18T00:25:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.025+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb3a415e950 con 0x7fb3a406bf90 2024-03-18T00:25:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.026+0000 7fb392ffd640 1 -- 172.21.15.81:0/2870443033 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fb39c07f830 con 0x7fb3a406bf90 2024-03-18T00:25:38.027 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:38.027 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.028+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 msgr2=0x7fb38406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.028+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 0x7fb38406e0c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb3a415a600 tx=0x7fb398009040 comp rx=0 tx=0).stop 2024-03-18T00:25:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.028+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 msgr2=0x7fb3a414b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.028+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb39c037040 tx=0x7fb39c004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:38.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 shutdown_connections 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb38406bc00 0x7fb38406e0c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3a40cde00 0x7fb3a40afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3a40cda20 0x7fb3a414a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 --2- 172.21.15.81:0/2870443033 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb3a406bf90 0x7fb3a414b090 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 >> 172.21.15.81:0/2870443033 conn(0x7fb3a40b2ab0 msgr2=0x7fb3a406f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 shutdown_connections 2024-03-18T00:25:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.029+0000 7fb3a8f59640 1 -- 172.21.15.81:0/2870443033 wait complete. 2024-03-18T00:25:38.040 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:25:38.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.139+0000 7fc4ac254640 1 Processor -- start 2024-03-18T00:25:38.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.139+0000 7fc4ac254640 1 -- start start 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4ac254640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a415e5a0 0x7fc4a40d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4ac254640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc4a40d1e40 0x7fc4a40d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4ac254640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4a40d1200 con 0x7fc4a40d2b80 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4ac254640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a40cff90 con 0x7fc4a415e5a0 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4ac254640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc4a40b34d0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4a9ff0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a415e5a0 0x7fc4a40d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4a9ff0640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc4a415e5a0 0x7fc4a40d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60132/0 (socket says 172.21.15.81:60132) 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/1275395129 learned_addr learned my addr 172.21.15.81:0/1275395129 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.140+0000 7fc4a97ef640 1 --2- 172.21.15.81:0/1275395129 >> v2:172.21.15.136:3300/0 conn(0x7fc4a40d1e40 0x7fc4a40d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/1275395129 >> v2:172.21.15.136:3300/0 conn(0x7fc4a40d1e40 msgr2=0x7fc4a40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a9ff0640 1 --2- 172.21.15.81:0/1275395129 >> v2:172.21.15.136:3300/0 conn(0x7fc4a40d1e40 0x7fc4a40d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/1275395129 >> v1:172.21.15.136:6789/0 conn(0x7fc4a40d2b80 legacy=0x7fc4a40ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/1275395129 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a40d14e0 con 0x7fc4a415e5a0 2024-03-18T00:25:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a9ff0640 1 --2- 172.21.15.81:0/1275395129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40d4b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc4a408ca10 tx=0x7fc4a002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a26858f7d7b311d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.141+0000 7fc4a8fee640 1 -- 172.21.15.81:0/1275395129 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a002ca80 con 0x7fc4a415e5a0 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4a8fee640 1 -- 172.21.15.81:0/1275395129 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a002cc20 con 0x7fc4a415e5a0 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4a8fee640 1 -- 172.21.15.81:0/1275395129 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00343f0 con 0x7fc4a415e5a0 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 -- 172.21.15.81:0/1275395129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a415e5a0 msgr2=0x7fc4a40d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 --2- 172.21.15.81:0/1275395129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40d4b80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc4a408ca10 tx=0x7fc4a002bee0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 -- 172.21.15.81:0/1275395129 shutdown_connections 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 --2- 172.21.15.81:0/1275395129 >> v2:172.21.15.136:3300/0 conn(0x7fc4a40d1e40 0x7fc4a40d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 --2- 172.21.15.81:0/1275395129 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40d4b80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 -- 172.21.15.81:0/1275395129 >> 172.21.15.81:0/1275395129 conn(0x7fc4a40d4060 msgr2=0x7fc4a40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 -- 172.21.15.81:0/1275395129 shutdown_connections 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.142+0000 7fc4ac254640 1 -- 172.21.15.81:0/1275395129 wait complete. 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.143+0000 7fc4ac254640 1 Processor -- start 2024-03-18T00:25:38.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.143+0000 7fc4ac254640 1 -- start start 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4a40d2b80 0x7fc4a4150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a40b4c50 con 0x7fc4a40d1e40 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc4a40d2fd0 con 0x7fc4a415e5a0 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4ac254640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc4a40b4dd0 con 0x7fc4a40d2b80 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60144/0 (socket says 172.21.15.81:60144) 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/230220996 learned_addr learned my addr 172.21.15.81:0/230220996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4aa7f1640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a97ef640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4a40d2b80 0x7fc4a4150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4a40d2b80 msgr2=0x7fc4a4150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4a40d2b80 0x7fc4a4150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 msgr2=0x7fc4a40cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4a9ff0640 1 -- 172.21.15.81:0/230220996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4a40b9800 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.144+0000 7fc4aa7f1640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc4a9ff0640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0036040 tx=0x7fc4a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0043020 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4a003e450 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4a40b9ae0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0009510 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.145+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4a40c80f0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.146+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4a404f5b0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.146+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc4a0046020 con 0x7fc4a40d1e40 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.146+0000 7fc49a7fc640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 0x7fc48806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.147+0000 7fc4a97ef640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 0x7fc48806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.147+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc4a00ad1d0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.147+0000 7fc4a97ef640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 0x7fc48806e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40cd590 tx=0x7fc494008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.151+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc4a004d030 con 0x7fc4a40d1e40 2024-03-18T00:25:38.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.360+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc4a40d05b0 con 0x7fc4a40d1e40 2024-03-18T00:25:38.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.361+0000 7fc49a7fc640 1 -- 172.21.15.81:0/230220996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7fc4a007bd50 con 0x7fc4a40d1e40 2024-03-18T00:25:38.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:38.361 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:25:38.362 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 msgr2=0x7fc48806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 0x7fc48806e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4a40cd590 tx=0x7fc494008040 comp rx=0 tx=0).stop 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 msgr2=0x7fc4a40b6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc4a0036040 tx=0x7fc4a0004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 shutdown_connections 2024-03-18T00:25:38.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc4a415e5a0 0x7fc4a40cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc4a40d2b80 0x7fc4a4150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc48806bbd0 0x7fc48806e090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.362+0000 7fc4ac254640 1 --2- 172.21.15.81:0/230220996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a40d1e40 0x7fc4a40b6be0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.363+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 >> 172.21.15.81:0/230220996 conn(0x7fc4a40d4060 msgr2=0x7fc4a406d5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.363+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 shutdown_connections 2024-03-18T00:25:38.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.363+0000 7fc4ac254640 1 -- 172.21.15.81:0/230220996 wait complete. 2024-03-18T00:25:38.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T00:25:22.854572+0000', 'modified': '2024-03-18T00:25:25.278427+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4278}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4278': {'gid': 4278, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6835/2230258880', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6833', 'nonce': 2230258880}, {'type': 'v1', 'addr': '172.21.15.136:6835', 'nonce': 2230258880}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4278, 'qdb_cluster': [4278]} 2024-03-18T00:25:38.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T00:25:38.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-18T00:25:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 Processor -- start 2024-03-18T00:25:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 -- start start 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f58c406f2b0 0x7f58c40d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f58c40d1300 0x7f58c40cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58c40b1750 con 0x7f58c406fab0 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f58c41629b0 con 0x7f58c406f2b0 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.879+0000 7f58ca085640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f58c4162ee0 con 0x7f58c40d1300 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f58c406fab0 0x7f58c406fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43740/0 (socket says 172.21.15.81:43740) 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c37fe640 1 -- 172.21.15.81:0/2906730173 learned_addr learned my addr 172.21.15.81:0/2906730173 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/2906730173 >> v2:172.21.15.81:3300/0 conn(0x7f58c406f2b0 0x7f58c40d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c3fff640 1 --2- 172.21.15.81:0/2906730173 >> v2:172.21.15.136:3300/0 conn(0x7f58c40d1300 0x7f58c40cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c27fc640 1 -- 172.21.15.81:0/2906730173 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2959980372 0 0) 0x7f58c40b1750 con 0x7f58c406fab0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c27fc640 1 -- 172.21.15.81:0/2906730173 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58ac003520 con 0x7f58c406fab0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c2ffd640 1 -- 172.21.15.81:0/2906730173 >> v2:172.21.15.136:3300/0 conn(0x7f58c40d1300 msgr2=0x7f58c40cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/2906730173 >> v2:172.21.15.136:3300/0 conn(0x7f58c40d1300 0x7f58c40cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c2ffd640 1 -- 172.21.15.81:0/2906730173 >> v1:172.21.15.81:6789/0 conn(0x7f58c406fab0 legacy=0x7f58c406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.880+0000 7f58c2ffd640 1 -- 172.21.15.81:0/2906730173 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c4162c00 con 0x7f58c406f2b0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/2906730173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c40d0dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b7e10 tx=0x7f58b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875a3ce24d40de0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58c27fc640 1 -- 172.21.15.81:0/2906730173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8035020 con 0x7f58c406f2b0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58c27fc640 1 -- 172.21.15.81:0/2906730173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b8031830 con 0x7f58c406f2b0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58c27fc640 1 -- 172.21.15.81:0/2906730173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b8031c00 con 0x7f58c406f2b0 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 -- 172.21.15.81:0/2906730173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 msgr2=0x7f58c40d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 --2- 172.21.15.81:0/2906730173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c40d0dc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58c40b7e10 tx=0x7f58b802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 -- 172.21.15.81:0/2906730173 shutdown_connections 2024-03-18T00:25:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 --2- 172.21.15.81:0/2906730173 >> v2:172.21.15.136:3300/0 conn(0x7f58c40d1300 0x7f58c40cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 --2- 172.21.15.81:0/2906730173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c40d0dc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 -- 172.21.15.81:0/2906730173 >> 172.21.15.81:0/2906730173 conn(0x7f58c40d1ee0 msgr2=0x7f58c40d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 -- 172.21.15.81:0/2906730173 shutdown_connections 2024-03-18T00:25:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.881+0000 7f58ca085640 1 -- 172.21.15.81:0/2906730173 wait complete. 2024-03-18T00:25:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.882+0000 7f58ca085640 1 Processor -- start 2024-03-18T00:25:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 -- start start 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 0x7f58c41e90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58c41e9620 0x7f58c409ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58c40d05c0 con 0x7f58c406f2b0 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f58c4161d70 con 0x7f58c41e9620 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58ca085640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f58c40d08a0 con 0x7f58c406fab0 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60164/0 (socket says 172.21.15.81:60164) 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.883+0000 7f58c37fe640 1 -- 172.21.15.81:0/3467010171 learned_addr learned my addr 172.21.15.81:0/3467010171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c3fff640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58c41e9620 0x7f58c409ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 0x7f58c41e90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 -- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 msgr2=0x7f58c41e90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 0x7f58c41e90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 -- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58c41e9620 msgr2=0x7f58c409ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58c41e9620 0x7f58c409ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 -- 172.21.15.81:0/3467010171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c41e7da0 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 0x7f58c41e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c460 tx=0x7f58b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58abfff640 1 -- 172.21.15.81:0/3467010171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4017070 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58abfff640 1 -- 172.21.15.81:0/3467010171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4005ce0 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58c41e8040 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58abfff640 1 -- 172.21.15.81:0/3467010171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40072f0 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.884+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58c41e8600 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.885+0000 7f58abfff640 1 -- 172.21.15.81:0/3467010171 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f58b401a070 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.886+0000 7f58abfff640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 0x7f58b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.886+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 0x7f58b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.886+0000 7f58abfff640 1 -- 172.21.15.81:0/3467010171 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58b4089ed0 con 0x7f58c406f2b0 2024-03-18T00:25:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.886+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 0x7f58b006e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58b8036000 tx=0x7f58b803c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.887+0000 7f58ccc79740 1 Processor -- start 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.887+0000 7f58ccc79740 1 -- start start 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1335060 0x55a3a1337a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1308160 0x55a3a1337f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3a1270c80 con 0x55a3a1334c80 2024-03-18T00:25:38.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a3a1219aa0 con 0x55a3a1335060 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55a3a126cd20 con 0x55a3a1308160 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60170/0 (socket says 172.21.15.81:60170) 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 -- 172.21.15.81:0/42555056 learned_addr learned my addr 172.21.15.81:0/42555056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1335060 0x55a3a1337a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c3fff640 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1308160 0x55a3a1337f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 -- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1308160 msgr2=0x55a3a1337f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1308160 0x55a3a1337f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 -- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1335060 msgr2=0x55a3a1337a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1335060 0x55a3a1337a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 -- 172.21.15.81:0/42555056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a123bff0 con 0x55a3a1334c80 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58c37fe640 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58b4060400 tx=0x7f58b4058450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8939fb04d638351a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58a97fa640 1 -- 172.21.15.81:0/42555056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b405c170 con 0x55a3a1334c80 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58a97fa640 1 -- 172.21.15.81:0/42555056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054940 con 0x55a3a1334c80 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.888+0000 7f58a97fa640 1 -- 172.21.15.81:0/42555056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40076d0 con 0x55a3a1334c80 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 -- 172.21.15.81:0/42555056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 msgr2=0x55a3a1307c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f58b4060400 tx=0x7f58b4058450 comp rx=0 tx=0).stop 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 -- 172.21.15.81:0/42555056 shutdown_connections 2024-03-18T00:25:38.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1308160 0x55a3a1337f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1335060 0x55a3a1337a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 --2- 172.21.15.81:0/42555056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1307c20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 -- 172.21.15.81:0/42555056 >> 172.21.15.81:0/42555056 conn(0x55a3a1309e90 msgr2=0x55a3a1352a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 -- 172.21.15.81:0/42555056 shutdown_connections 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.889+0000 7f58ccc79740 1 -- 172.21.15.81:0/42555056 wait complete. 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 -- start start 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 Processor -- start 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a1338de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1350e20 0x55a3a1335ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3a130c530 con 0x55a3a1335060 2024-03-18T00:25:38.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a3a122cef0 con 0x55a3a1334c80 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55a3a130ed70 con 0x55a3a1350e20 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58ccc79740 10 client.0 _ll_register_callbacks cb 0x55a3a1227dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.890+0000 7f58c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a1338de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60184/0 (socket says 172.21.15.81:60184) 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c2ffd640 1 -- 172.21.15.81:0/4293807197 learned_addr learned my addr 172.21.15.81:0/4293807197 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c3fff640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1350e20 0x55a3a1335ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 -- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1350e20 msgr2=0x55a3a1335ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1350e20 0x55a3a1335ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 -- 172.21.15.81:0/4293807197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 msgr2=0x55a3a1339320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 -- 172.21.15.81:0/4293807197 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a1239a30 con 0x55a3a1334c80 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58c37fe640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a1338de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58b4005880 tx=0x7f58b4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4caadb09177a40d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.136:3300/0 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b405c170 con 0x55a3a1334c80 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mon.1 v2:172.21.15.136:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58b405e310 con 0x55a3a1334c80 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b4054940 con 0x55a3a1334c80 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f58b4077170 con 0x55a3a1334c80 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58ccc79740 10 client.4654 fetch_fsmap learned FSMap version 7 2024-03-18T00:25:38.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a3a0f852d0 con 0x55a3a1334c80 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mon.1 v2:172.21.15.136:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054940 con 0x55a3a1334c80 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mon.1 v2:172.21.15.136:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f58b4054020 con 0x55a3a1334c80 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.891+0000 7f58ccc79740 10 client.4654 fetch_fsmap finished waiting for FSMap version 7 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58ccc79740 10 client.4654 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58ccc79740 20 client.4654 populate_metadata read hostname 'smithi081' 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1351db0 0x55a3a1352190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58ccc79740 4 client.4654 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 --> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3a127e1c0 con 0x55a3a1351db0 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1351db0 0x55a3a1352190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58a27fc640 10 client.4654 ms_handle_connect on v2:172.21.15.136:6833/2230258880 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.892+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1351db0 0x55a3a1352190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c99659b8357b980 server_cookie=fb493f1f1e7d3180 in_seq=0 out_seq=0 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58a27fc640 1 -- 172.21.15.81:0/4293807197 <== mds.0 v2:172.21.15.136:6833/2230258880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a3a127e1c0 con 0x55a3a1351db0 2024-03-18T00:25:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58a27fc640 10 client.4654 handle_command_reply: tid=0 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 client.4654 shutdown 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 msgr2=0x55a3a1338de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a1338de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f58b4005880 tx=0x7f58b4000bc0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 shutdown_connections 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1351db0 0x55a3a1352190 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1350e20 0x55a3a1335ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1335060 0x55a3a1339320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 --2- 172.21.15.81:0/4293807197 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a1338de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58a27fc640 0 client.4654 ms_handle_reset on v2:172.21.15.136:6833/2230258880 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 >> 172.21.15.81:0/4293807197 conn(0x55a3a1308160 msgr2=0x55a3a130bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 shutdown_connections 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 1 -- 172.21.15.81:0/4293807197 wait complete. 2024-03-18T00:25:38.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.893+0000 7f58ccc79740 20 client.4654 trim_cache size 0 max 16384 2024-03-18T00:25:38.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.911+0000 7f58ccc79740 1 Processor -- start 2024-03-18T00:25:38.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.911+0000 7f58ccc79740 1 -- start start 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a13371f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1350e20 0x55a3a1361e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f58c41f8200 con 0x55a3a1334c80 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f58c414dd40 con 0x55a3a1350e20 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f58c414e390 con 0x55a3a1335060 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60192/0 (socket says 172.21.15.81:60192) 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 -- 172.21.15.81:0/3146651192 learned_addr learned my addr 172.21.15.81:0/3146651192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c3fff640 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1350e20 0x55a3a1361e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c2ffd640 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a13371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 -- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 msgr2=0x55a3a13371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a13371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 -- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1350e20 msgr2=0x55a3a1361e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1350e20 0x55a3a1361e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.912+0000 7f58c37fe640 1 -- 172.21.15.81:0/3146651192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3a104f6b0 con 0x55a3a1334c80 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58c37fe640 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58b4056580 tx=0x7f58b406e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a1bb2bc5878ce7b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58a8ff9640 1 -- 172.21.15.81:0/3146651192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b4054570 con 0x55a3a1334c80 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58a8ff9640 1 -- 172.21.15.81:0/3146651192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054020 con 0x55a3a1334c80 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58a8ff9640 1 -- 172.21.15.81:0/3146651192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b405e310 con 0x55a3a1334c80 2024-03-18T00:25:38.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 -- 172.21.15.81:0/3146651192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 msgr2=0x55a3a1336cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f58b4056580 tx=0x7f58b406e070 comp rx=0 tx=0).stop 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 -- 172.21.15.81:0/3146651192 shutdown_connections 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1350e20 0x55a3a1361e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a13371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 --2- 172.21.15.81:0/3146651192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1334c80 0x55a3a1336cb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 -- 172.21.15.81:0/3146651192 >> 172.21.15.81:0/3146651192 conn(0x55a3a1308160 msgr2=0x55a3a132f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 -- 172.21.15.81:0/3146651192 shutdown_connections 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.913+0000 7f58ccc79740 1 -- 172.21.15.81:0/3146651192 wait complete. 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.914+0000 7f58ccc79740 1 -- start start 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.914+0000 7f58ccc79740 1 Processor -- start 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a130cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a1360e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a3a122cef0 con 0x55a3a1350e20 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x55a3a130c530 con 0x55a3a1334c80 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x55a3a13307d0 con 0x55a3a1335060 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 10 client.0 _ll_register_callbacks cb 0x7f58b406f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c37fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a130cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60196/0 (socket says 172.21.15.81:60196) 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 -- 172.21.15.81:0/1025011353 learned_addr learned my addr 172.21.15.81:0/1025011353 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c2ffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a1360e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 -- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 msgr2=0x55a3a1360e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a1360e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 -- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 msgr2=0x55a3a130cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a130cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 -- 172.21.15.81:0/1025011353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3a130cff0 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58c3fff640 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58c4072260 tx=0x7f58bc0046e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a916aaea7a0621eb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58bc017b00 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f58bc017ca0 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f58b4054020 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f58bc0203c0 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 10 client.4638 fetch_fsmap learned FSMap version 7 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.915+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x55a3a130d2e0 con 0x55a3a1350e20 2024-03-18T00:25:38.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58b4054020 con 0x55a3a1350e20 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3494+0+0 (secure 0 0 0) 0x7f58bc029050 con 0x55a3a1350e20 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 10 client.4638 fetch_fsmap finished waiting for FSMap version 7 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 10 client.4638 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 20 client.4638 populate_metadata read hostname 'smithi081' 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1353c40 0x55a3a1354020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 4 client.4638 mds_command: new command op to 4278 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 --> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] -- command(tid 0: {"prefix": "status"}) -- 0x55a3a1278510 con 0x55a3a1353c40 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58c37fe640 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1353c40 0x55a3a1354020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58c37fe640 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1353c40 0x55a3a1354020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f8253676c5bcd0b server_cookie=b8d5e7c1636fcd38 in_seq=0 out_seq=0 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 10 client.4638 ms_handle_connect on v2:172.21.15.136:6833/2230258880 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 1 -- 172.21.15.81:0/1025011353 <== mds.0 v2:172.21.15.136:6833/2230258880 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a3a1278510 con 0x55a3a1353c40 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 10 client.4638 handle_command_reply: tid=0 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 client.4638 shutdown 2024-03-18T00:25:38.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 msgr2=0x55a3a13d3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f58c4072260 tx=0x7f58bc0046e0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 shutdown_connections 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:6833/2230258880,v1:172.21.15.136:6835/2230258880] conn(0x55a3a1353c40 0x55a3a1354020 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a3a1350e20 0x55a3a13d3680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x55a3a1335060 0x55a3a1360e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58a27fc640 0 client.4638 ms_handle_reset on v2:172.21.15.136:6833/2230258880 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.916+0000 7f58ccc79740 1 --2- 172.21.15.81:0/1025011353 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x55a3a1334c80 0x55a3a130cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 >> 172.21.15.81:0/1025011353 conn(0x55a3a1308160 msgr2=0x55a3a1335920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 shutdown_connections 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ccc79740 1 -- 172.21.15.81:0/1025011353 wait complete. 2024-03-18T00:25:38.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ccc79740 20 client.4638 trim_cache size 0 max 16384 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a215fc89-10fc-4af5-b2ff-78f3e4709ee3", 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4278, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 15.397109939, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 20, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 20, 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 21.929811582999999 2024-03-18T00:25:38.926 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T00:25:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 msgr2=0x7f58b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 0x7f58b006e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f58b8036000 tx=0x7f58b803c040 comp rx=0 tx=0).stop 2024-03-18T00:25:38.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 msgr2=0x7f58c409dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c460 tx=0x7f58b400c920 comp rx=0 tx=0).stop 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 shutdown_connections 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f58c41e9620 0x7f58c409ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f58c406fab0 0x7f58c41e90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f58b006bbd0 0x7f58b006e090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 --2- 172.21.15.81:0/3467010171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58c406f2b0 0x7f58c409dd60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 >> 172.21.15.81:0/3467010171 conn(0x7f58c40d1ee0 msgr2=0x7f58c40af550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 shutdown_connections 2024-03-18T00:25:38.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:38.917+0000 7f58ca085640 1 -- 172.21.15.81:0/3467010171 wait complete. 2024-03-18T00:25:38.930 INFO:teuthology.run_tasks:Running task kclient... 2024-03-18T00:25:38.954 INFO:tasks.kclient:Mounting kernel clients... 2024-03-18T00:25:38.954 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-18T00:25:38.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:38.954 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T00:25:38.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:38.969 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-03-18T00:25:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-03-18T00:25:39.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:25:39.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.040 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T00:25:39.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-03-18T00:25:39.163 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-03-18T00:25:39.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:25:39.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.164 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T00:25:39.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.180 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-03-18T00:25:39.249 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-03-18T00:25:39.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:25:39.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.251 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T00:25:39.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-03-18T00:25:39.373 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-03-18T00:25:39.375 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T00:25:39.375 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-18T00:25:39.375 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T00:25:39.375 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T00:25:39.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T00:25:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.475+0000 7f1bc0774640 1 Processor -- start 2024-03-18T00:25:39.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.475+0000 7f1bc0774640 1 -- start start 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bc0774640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bb815ad40 0x7f1bb80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bc0774640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1bb80b3400 0x7f1bb80d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bc0774640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb815ee60 con 0x7f1bb80b3860 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bc0774640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb815f140 con 0x7f1bb815ad40 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bc0774640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb815f420 con 0x7f1bb80b3400 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbe510640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1bb815ad40 0x7f1bb80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbed11640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1bb80b3860 0x7f1bb806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43756/0 (socket says 172.21.15.81:43756) 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbed11640 1 -- 172.21.15.81:0/4090694976 learned_addr learned my addr 172.21.15.81:0/4090694976 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:39.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbdd0f640 1 --2- 172.21.15.81:0/4090694976 >> v2:172.21.15.136:3300/0 conn(0x7f1bb80b3400 0x7f1bb80d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbe510640 1 -- 172.21.15.81:0/4090694976 >> v2:172.21.15.136:3300/0 conn(0x7f1bb80b3400 msgr2=0x7f1bb80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbe510640 1 --2- 172.21.15.81:0/4090694976 >> v2:172.21.15.136:3300/0 conn(0x7f1bb80b3400 0x7f1bb80d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbe510640 1 -- 172.21.15.81:0/4090694976 >> v1:172.21.15.81:6789/0 conn(0x7f1bb80b3860 legacy=0x7f1bb806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.476+0000 7f1bbe510640 1 -- 172.21.15.81:0/4090694976 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb815f700 con 0x7f1bb815ad40 2024-03-18T00:25:39.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.477+0000 7f1bbe510640 1 --2- 172.21.15.81:0/4090694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb80ad800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb809e0d0 tx=0x7f1bb402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca977db0154644 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.477+0000 7f1bbd50e640 1 -- 172.21.15.81:0/4090694976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40315a0 con 0x7f1bb815ad40 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.477+0000 7f1bbd50e640 1 -- 172.21.15.81:0/4090694976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb4037070 con 0x7f1bb815ad40 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.477+0000 7f1bbd50e640 1 -- 172.21.15.81:0/4090694976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4031960 con 0x7f1bb815ad40 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 -- 172.21.15.81:0/4090694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 msgr2=0x7f1bb80ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 --2- 172.21.15.81:0/4090694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb80ad800 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1bb809e0d0 tx=0x7f1bb402b840 comp rx=0 tx=0).stop 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 -- 172.21.15.81:0/4090694976 shutdown_connections 2024-03-18T00:25:39.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 --2- 172.21.15.81:0/4090694976 >> v2:172.21.15.136:3300/0 conn(0x7f1bb80b3400 0x7f1bb80d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 --2- 172.21.15.81:0/4090694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb80ad800 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 -- 172.21.15.81:0/4090694976 >> 172.21.15.81:0/4090694976 conn(0x7f1bb806b5e0 msgr2=0x7f1bb806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 -- 172.21.15.81:0/4090694976 shutdown_connections 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.478+0000 7f1bc0774640 1 -- 172.21.15.81:0/4090694976 wait complete. 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 Processor -- start 2024-03-18T00:25:39.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 -- start start 2024-03-18T00:25:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 0x7f1bb815a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb80b3860 0x7f1bb8145f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.479+0000 7f1bc0774640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb815eb90 con 0x7f1bb815ad40 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bc0774640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb815ea10 con 0x7f1bb80b3860 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bc0774640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb80d0620 con 0x7f1bb80b3400 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60208/0 (socket says 172.21.15.81:60208) 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 -- 172.21.15.81:0/542021793 learned_addr learned my addr 172.21.15.81:0/542021793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbdd0f640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb80b3860 0x7f1bb8145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbe510640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 0x7f1bb815a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 -- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 msgr2=0x7f1bb815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 0x7f1bb815a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 -- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb80b3860 msgr2=0x7f1bb8145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb80b3860 0x7f1bb8145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 -- 172.21.15.81:0/542021793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb8156ed0 con 0x7f1bb815ad40 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbe510640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 0x7f1bb815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:39.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bbed11640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000cad0 tx=0x7f1bb000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0017070 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb000ac30 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb81571b0 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0012400 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.480+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb8157770 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.481+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bb8157970 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.482+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1bb001a070 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.482+0000 7f1baeffd640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 0x7f1b9c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.482+0000 7f1bbe510640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 0x7f1b9c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.482+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1bb008a6f0 con 0x7f1bb815ad40 2024-03-18T00:25:39.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.482+0000 7f1bbe510640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 0x7f1b9c06e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4036000 tx=0x7f1bb403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:39.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.487+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1bb8157970 con 0x7f1bb815ad40 2024-03-18T00:25:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.703+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1bb804f5b0 con 0x7f1bb815ad40 2024-03-18T00:25:39.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.704+0000 7f1baeffd640 1 -- 172.21.15.81:0/542021793 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f1bb0058b90 con 0x7f1bb815ad40 2024-03-18T00:25:39.704 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T00:25:39.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.705+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 msgr2=0x7f1b9c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 0x7f1b9c06e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4036000 tx=0x7f1bb403d040 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 msgr2=0x7f1bb809b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000cad0 tx=0x7f1bb000cf90 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 shutdown_connections 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b9c06bbd0 0x7f1b9c06e090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1bb815ad40 0x7f1bb809b460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1bb80b3860 0x7f1bb8145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 --2- 172.21.15.81:0/542021793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1bb80b3400 0x7f1bb815a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 >> 172.21.15.81:0/542021793 conn(0x7f1bb806b5e0 msgr2=0x7f1bb815d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 shutdown_connections 2024-03-18T00:25:39.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39.706+0000 7f1bc0774640 1 -- 172.21.15.81:0/542021793 wait complete. 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T00:25:39.717 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T00:25:39.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.717 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42635sec preferred_lft 42635sec 2024-03-18T00:25:39.733 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-03-18T00:25:39.734 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:39.734 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-03-18T00:25:39.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T00:25:39.735 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:39.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:39.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.925 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T00:25:39.951 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-03-18T00:25:39.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:39.953 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-03-18T00:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-03-18T00:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T00:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T00:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T00:25:40.028 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T00:25:40.029 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:40.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:40.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:40.358 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T00:25:40.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:40.373 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-03-18T00:25:40.428 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:40.428 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:40.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T00:25:40.428 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-18T00:25:40.428 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:40.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:40.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:40.553 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-18T00:25:40.553 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:40.553 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:40.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-18T00:25:40.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T00:25:40.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-18T00:25:40.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-18T00:25:40.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-18T00:25:40.554 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:40.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:40.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:40.693 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:40.693 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:40.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-03-18T00:25:40.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T00:25:40.694 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:40.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:40.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:40.775 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-18T00:25:40.789 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-18T00:25:40.789 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:40.790 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-18T00:25:40.843 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-18T00:25:40.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:40.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:40.929 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:40.929 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-03-18T00:25:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a215fc89-10fc-4af5-b2ff-78f3e4709ee3.cephfs=/ 2024-03-18T00:25:41.035 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-03-18T00:25:41.036 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-18T00:25:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-03-18T00:25:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T00:25:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T00:25:41.036 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T00:25:41.037 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T00:25:41.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:41.038 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-18T00:25:41.105 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:41.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:41.205 INFO:teuthology.orchestra.run.smithi081.stdout:client4669 2024-03-18T00:25:41.206 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:41.206 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:41.221 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:41.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:41.320 INFO:teuthology.orchestra.run.smithi081.stdout:client4669 2024-03-18T00:25:41.320 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:41.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:41.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:41.381 INFO:teuthology.orchestra.run.smithi081.stdout:client4669 2024-03-18T00:25:41.381 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a215fc89-10fc-4af5-b2ff-78f3e4709ee3.client4669/status') 2024-03-18T00:25:41.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:41.445 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4669 (3)172.21.15.81:0/3551959256 2024-03-18T00:25:41.445 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-03-18T00:25:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-03-18T00:25:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-03-18T00:25:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 1.9971e-05 s, 3.5 MB/s 2024-03-18T00:25:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:41.453 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-18T00:25:41.453 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T00:25:41.453 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-18T00:25:41.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T00:25:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.552+0000 7f6b6e236640 1 Processor -- start 2024-03-18T00:25:41.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.552+0000 7f6b6e236640 1 -- start start 2024-03-18T00:25:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b6e236640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b680ae8d0 0x7f6b6806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:41.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b6e236640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68071930 con 0x7f6b6815e110 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b6e236640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b68071c10 con 0x7f6b6815e4f0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b6e236640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6b68071ef0 con 0x7f6b680ae8d0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b67fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6b680ae8d0 0x7f6b6806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b677fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b6815e110 0x7f6b680cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43768/0 (socket says 172.21.15.81:43768) 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b677fe640 1 -- 172.21.15.81:0/3819787319 learned_addr learned my addr 172.21.15.81:0/3819787319 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b67fff640 1 -- 172.21.15.81:0/3819787319 >> v1:172.21.15.136:6789/0 conn(0x7f6b6815e4f0 legacy=0x7f6b6806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b67fff640 1 -- 172.21.15.81:0/3819787319 >> v1:172.21.15.81:6789/0 conn(0x7f6b6815e110 legacy=0x7f6b680cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b67fff640 1 -- 172.21.15.81:0/3819787319 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b680721d0 con 0x7f6b680ae8d0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.553+0000 7f6b667fc640 1 -- 172.21.15.81:0/3819787319 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619776148 0 0) 0x7f6b68071930 con 0x7f6b6815e110 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.554+0000 7f6b67fff640 1 --2- 172.21.15.81:0/3819787319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b680ae8d0 0x7f6b6806f0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53420c6add753de server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.554+0000 7f6b667fc640 1 -- 172.21.15.81:0/3819787319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60039070 con 0x7f6b680ae8d0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.554+0000 7f6b667fc640 1 -- 172.21.15.81:0/3819787319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6002cc60 con 0x7f6b680ae8d0 2024-03-18T00:25:41.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.554+0000 7f6b667fc640 1 -- 172.21.15.81:0/3819787319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b60034660 con 0x7f6b680ae8d0 2024-03-18T00:25:41.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 -- 172.21.15.81:0/3819787319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b680ae8d0 msgr2=0x7f6b6806f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 --2- 172.21.15.81:0/3819787319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b680ae8d0 0x7f6b6806f0e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6b60009d90 tx=0x7f6b6002beb0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 -- 172.21.15.81:0/3819787319 shutdown_connections 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 --2- 172.21.15.81:0/3819787319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b680ae8d0 0x7f6b6806f0e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 -- 172.21.15.81:0/3819787319 >> 172.21.15.81:0/3819787319 conn(0x7f6b680ccfb0 msgr2=0x7f6b680cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 -- 172.21.15.81:0/3819787319 shutdown_connections 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.555+0000 7f6b6e236640 1 -- 172.21.15.81:0/3819787319 wait complete. 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.556+0000 7f6b6e236640 1 Processor -- start 2024-03-18T00:25:41.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.556+0000 7f6b6e236640 1 -- start start 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b680ae8d0 0x7f6b680b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b6815e4f0 0x7f6b68154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b68168eb0 con 0x7f6b6815e110 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6b680d0000 con 0x7f6b680ae8d0 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b6e236640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6b68169030 con 0x7f6b6815e4f0 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b66ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:41.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b66ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60220/0 (socket says 172.21.15.81:60220) 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b66ffd640 1 -- 172.21.15.81:0/1289048344 learned_addr learned my addr 172.21.15.81:0/1289048344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b677fe640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b680ae8d0 0x7f6b680b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.557+0000 7f6b67fff640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b6815e4f0 0x7f6b68154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 -- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b6815e4f0 msgr2=0x7f6b68154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b6815e4f0 0x7f6b68154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 -- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b680ae8d0 msgr2=0x7f6b680b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b680ae8d0 0x7f6b680b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 -- 172.21.15.81:0/1289048344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b68158e10 con 0x7f6b6815e110 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b66ffd640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c430 tx=0x7f6b5c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c017070 con 0x7f6b6815e110 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0052d0 con 0x7f6b6815e110 2024-03-18T00:25:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b681590f0 con 0x7f6b6815e110 2024-03-18T00:25:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c003830 con 0x7f6b6815e110 2024-03-18T00:25:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.558+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b681596b0 con 0x7f6b6815e110 2024-03-18T00:25:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.559+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b68159ba0 con 0x7f6b6815e110 2024-03-18T00:25:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.559+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6b5c01a070 con 0x7f6b6815e110 2024-03-18T00:25:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.560+0000 7f6b4ffff640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 0x7f6b5406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.560+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b5c089dd0 con 0x7f6b6815e110 2024-03-18T00:25:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.560+0000 7f6b677fe640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 0x7f6b5406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:41.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.560+0000 7f6b677fe640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 0x7f6b5406e0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b580011e0 tx=0x7f6b58001130 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.564+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6b5c0581f0 con 0x7f6b6815e110 2024-03-18T00:25:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.774+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6b6804f5b0 con 0x7f6b6815e110 2024-03-18T00:25:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.775+0000 7f6b4ffff640 1 -- 172.21.15.81:0/1289048344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f6b5c08b060 con 0x7f6b6815e110 2024-03-18T00:25:41.775 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T00:25:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.776+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 msgr2=0x7f6b5406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.776+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 0x7f6b5406e0c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f6b580011e0 tx=0x7f6b58001130 comp rx=0 tx=0).stop 2024-03-18T00:25:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.776+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 msgr2=0x7f6b681584a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.776+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c00c430 tx=0x7f6b5c00c8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 shutdown_connections 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b6815e4f0 0x7f6b68154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6b5406bc00 0x7f6b5406e0c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6815e110 0x7f6b681584a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 --2- 172.21.15.81:0/1289048344 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b680ae8d0 0x7f6b680b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 >> 172.21.15.81:0/1289048344 conn(0x7f6b680ccfb0 msgr2=0x7f6b680aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 shutdown_connections 2024-03-18T00:25:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:41.777+0000 7f6b6e236640 1 -- 172.21.15.81:0/1289048344 wait complete. 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T00:25:41.788 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-18T00:25:41.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:41.788 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-03-18T00:25:41.803 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:41.803 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:41.803 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:41.803 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:41.804 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42633sec preferred_lft 42633sec 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ee:c8:ce:71:e8:a6 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4c51:5dff:fe57:7c/64 scope link 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ee:c8:ce:71:e8:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ecc8:ceff:fe71:e8a6/64 scope link tentative 2024-03-18T00:25:41.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:41.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:41.806 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T00:25:41.869 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-03-18T00:25:41.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:41.870 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-03-18T00:25:41.929 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-03-18T00:25:41.929 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T00:25:41.929 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T00:25:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T00:25:41.930 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T00:25:41.930 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:42.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:42.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.064 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T00:25:42.078 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T00:25:42.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.079 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-03-18T00:25:42.132 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-18T00:25:42.132 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:42.132 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:42.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T00:25:42.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-18T00:25:42.133 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:42.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:42.280 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 6e:c8:72:ca:52:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::6cc8:72ff:feca:5267/64 scope link tentative 2024-03-18T00:25:42.281 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:42.349 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 6e:c8:72:ca:52:67 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T00:25:42.350 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T00:25:42.350 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.350 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::6cc8:72ff:feca:5267/64 scope link tentative 2024-03-18T00:25:42.350 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:42.351 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-18T00:25:42.351 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:42.351 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:42.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-18T00:25:42.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-18T00:25:42.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-18T00:25:42.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-18T00:25:42.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-18T00:25:42.352 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:42.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.516 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:42.516 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:25:42.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-03-18T00:25:42.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-03-18T00:25:42.516 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:25:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:42.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.596 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:42.597 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-18T00:25:42.611 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-18T00:25:42.611 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:42.611 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-18T00:25:42.665 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-18T00:25:42.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:42.750 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:42.750 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:42.757 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:42.757 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 2@a215fc89-10fc-4af5-b2ff-78f3e4709ee3.cephfs=/ 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.81:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T00:25:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T00:25:42.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T00:25:42.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:42.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-18T00:25:42.786 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.881 INFO:teuthology.orchestra.run.smithi081.stdout:client4493 2024-03-18T00:25:42.881 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:42.881 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:42.896 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:42.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:42.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:42.991 INFO:teuthology.orchestra.run.smithi081.stdout:client4493 2024-03-18T00:25:42.991 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:43.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:43.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:43.046 INFO:teuthology.orchestra.run.smithi081.stdout:client4493 2024-03-18T00:25:43.046 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a215fc89-10fc-4af5-b2ff-78f3e4709ee3.client4493/status') 2024-03-18T00:25:43.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:43.106 INFO:teuthology.orchestra.run.smithi081.stdout:instance: client.4493 (3)172.21.15.81:0/1020321898 2024-03-18T00:25:43.106 INFO:teuthology.orchestra.run.smithi081.stdout:blocklisted: false 2024-03-18T00:25:43.106 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records in 2024-03-18T00:25:43.107 INFO:teuthology.orchestra.run.smithi081.stderr:0+1 records out 2024-03-18T00:25:43.107 INFO:teuthology.orchestra.run.smithi081.stderr:70 bytes copied, 2.0661e-05 s, 3.4 MB/s 2024-03-18T00:25:43.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:43.113 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-18T00:25:43.113 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T00:25:43.113 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T00:25:43.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T00:25:43.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.213+0000 7fa182c44640 1 Processor -- start 2024-03-18T00:25:43.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.213+0000 7fa182c44640 1 -- start start 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa182c44640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 0x7fa17c0b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa182c44640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c15fc70 con 0x7fa17c1598e0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa182c44640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa17c15ff50 con 0x7fa17c0d07f0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa182c44640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c0b3c80 con 0x7fa17c159cc0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1809e0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa17c1598e0 0x7fa17c0d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43772/0 (socket says 172.21.15.81:43772) 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1809e0640 1 -- 172.21.15.81:0/3901102820 learned_addr learned my addr 172.21.15.81:0/3901102820 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1811e1640 1 --2- 172.21.15.81:0/3901102820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 0x7fa17c0b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 721160981 0 0) 0x7fa17c15fc70 con 0x7fa17c1598e0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa16c003520 con 0x7fa17c1598e0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44265560 0 0) 0x7fa17c15ff50 con 0x7fa17c0d07f0 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1811e1640 1 -- 172.21.15.81:0/3901102820 >> v1:172.21.15.136:6789/0 conn(0x7fa17c0d07f0 legacy=0x7fa17c0ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1811e1640 1 -- 172.21.15.81:0/3901102820 >> v1:172.21.15.81:6789/0 conn(0x7fa17c1598e0 legacy=0x7fa17c0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.214+0000 7fa1811e1640 1 -- 172.21.15.81:0/3901102820 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c160230 con 0x7fa17c159cc0 2024-03-18T00:25:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.215+0000 7fa1811e1640 1 --2- 172.21.15.81:0/3901102820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 0x7fa17c0b3740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa174009dc0 tx=0x7fa17402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cde2a2c27ccff766 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.215+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174039070 con 0x7fa17c159cc0 2024-03-18T00:25:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.215+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa17402ccd0 con 0x7fa17c159cc0 2024-03-18T00:25:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.215+0000 7fa17b7fe640 1 -- 172.21.15.81:0/3901102820 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174034660 con 0x7fa17c159cc0 2024-03-18T00:25:43.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 -- 172.21.15.81:0/3901102820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 msgr2=0x7fa17c0b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 --2- 172.21.15.81:0/3901102820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 0x7fa17c0b3740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa174009dc0 tx=0x7fa17402bf20 comp rx=0 tx=0).stop 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 -- 172.21.15.81:0/3901102820 shutdown_connections 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 --2- 172.21.15.81:0/3901102820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c159cc0 0x7fa17c0b3740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 -- 172.21.15.81:0/3901102820 >> 172.21.15.81:0/3901102820 conn(0x7fa17c06b5e0 msgr2=0x7fa17c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 -- 172.21.15.81:0/3901102820 shutdown_connections 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.216+0000 7fa182c44640 1 -- 172.21.15.81:0/3901102820 wait complete. 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.217+0000 7fa182c44640 1 Processor -- start 2024-03-18T00:25:43.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.217+0000 7fa182c44640 1 -- start start 2024-03-18T00:25:43.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c0d07f0 0x7fa17c147590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c1598e0 0x7fa17c09c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c06cc70 con 0x7fa17c159cc0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c1607f0 con 0x7fa17c0d07f0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c06cdf0 con 0x7fa17c1598e0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60226/0 (socket says 172.21.15.81:60226) 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 -- 172.21.15.81:0/1606204062 learned_addr learned my addr 172.21.15.81:0/1606204062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1809e0640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c0d07f0 0x7fa17c147590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa17bfff640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c1598e0 0x7fa17c09c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 -- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c1598e0 msgr2=0x7fa17c09c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c1598e0 0x7fa17c09c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 -- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c0d07f0 msgr2=0x7fa17c147590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c0d07f0 0x7fa17c147590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 -- 172.21.15.81:0/1606204062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c1559e0 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1811e1640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa174037040 tx=0x7fa174004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174039050 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa174045070 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c155cc0 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa174009450 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.218+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c156280 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.219+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17c06b9c0 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.220+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa17403e830 con 0x7fa17c159cc0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.220+0000 7fa1797fa640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 0x7fa16006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.220+0000 7fa1809e0640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 0x7fa16006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:43.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.220+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa1740ad6f0 con 0x7fa17c159cc0 2024-03-18T00:25:43.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.221+0000 7fa1809e0640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 0x7fa16006e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa170001200 tx=0x7fa170000bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:43.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.225+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa17c06b9c0 con 0x7fa17c159cc0 2024-03-18T00:25:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.436+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa17c04f5b0 con 0x7fa17c159cc0 2024-03-18T00:25:43.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.436+0000 7fa1797fa640 1 -- 172.21.15.81:0/1606204062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7fa17407bd40 con 0x7fa17c159cc0 2024-03-18T00:25:43.437 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 msgr2=0x7fa16006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 0x7fa16006e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa170001200 tx=0x7fa170000bc0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 msgr2=0x7fa17c14c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa174037040 tx=0x7fa174004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 shutdown_connections 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa16006bbd0 0x7fa16006e090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c159cc0 0x7fa17c14c6f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa17c1598e0 0x7fa17c09c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 --2- 172.21.15.81:0/1606204062 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa17c0d07f0 0x7fa17c147590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 >> 172.21.15.81:0/1606204062 conn(0x7fa17c06b5e0 msgr2=0x7fa17c15ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 shutdown_connections 2024-03-18T00:25:43.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:43.438+0000 7fa182c44640 1 -- 172.21.15.81:0/1606204062 wait complete. 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T00:25:43.450 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-18T00:25:43.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:43.451 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:43.466 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-03-18T00:25:43.467 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:43.467 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T00:25:43.467 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add name ceph-brx type bridge 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr flush dev ceph-brx 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set ceph-brx up 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T00:25:43.468 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:43.554 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:43.665 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:43.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:43.671 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T00:25:43.699 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-03-18T00:25:43.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:43.701 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-03-18T00:25:43.778 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-03-18T00:25:43.778 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T00:25:43.778 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T00:25:43.778 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T00:25:43.778 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T00:25:43.778 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:43.778 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:43.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T00:25:43.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T00:25:43.779 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T00:25:43.779 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:43.866 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:44.098 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:44.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:44.104 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T00:25:44.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:44.119 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-03-18T00:25:44.177 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:44.177 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:44.177 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T00:25:44.178 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-18T00:25:44.178 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:44.266 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:44.299 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:44.307 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-18T00:25:44.308 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:44.366 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:44.462 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:44.468 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:44.468 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:44.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.0 up 2024-03-18T00:25:44.468 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T00:25:44.468 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:44.515 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:44.543 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:44.549 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:44.549 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-18T00:25:44.563 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-18T00:25:44.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:44.564 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-18T00:25:44.618 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-18T00:25:44.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:44.619 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:44.704 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:44.704 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-03-18T00:25:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 1@a215fc89-10fc-4af5-b2ff-78f3e4709ee3.cephfs=/ 2024-03-18T00:25:44.828 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.81:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-03-18T00:25:44.829 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-18T00:25:44.829 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-03-18T00:25:44.829 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T00:25:44.829 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T00:25:44.829 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T00:25:44.831 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T00:25:44.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:44.831 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-18T00:25:44.858 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:44.965 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:44.966 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:44.974 INFO:teuthology.orchestra.run.smithi136.stdout:client4502 2024-03-18T00:25:44.974 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:44.974 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:44.993 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:45.080 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:45.082 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:45.088 INFO:teuthology.orchestra.run.smithi136.stdout:client4502 2024-03-18T00:25:45.088 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:45.136 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:45.137 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:45.143 INFO:teuthology.orchestra.run.smithi136.stdout:client4502 2024-03-18T00:25:45.143 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a215fc89-10fc-4af5-b2ff-78f3e4709ee3.client4502/status') 2024-03-18T00:25:45.192 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:45.207 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4502 (3)192.168.0.1:0/4131205335 2024-03-18T00:25:45.207 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-03-18T00:25:45.207 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-03-18T00:25:45.207 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-03-18T00:25:45.208 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 2.1691e-05 s, 3.2 MB/s 2024-03-18T00:25:45.208 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:45.216 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-18T00:25:45.216 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T00:25:45.216 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-18T00:25:45.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T00:25:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.327+0000 7f7ef22de640 1 Processor -- start 2024-03-18T00:25:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.327+0000 7f7ef22de640 1 -- start start 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef22de640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7eec0d2a00 0x7f7eec0cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef22de640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eec0b1750 con 0x7f7eec06f2b0 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef22de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7eec0d14d0 con 0x7f7eec06fab0 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef22de640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f7eec1629b0 con 0x7f7eec0d2a00 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef087b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f7eec0d2a00 0x7f7eec0cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7eeb7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7eec06f2b0 0x7f7eec0d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43780/0 (socket says 172.21.15.81:43780) 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7eeb7fe640 1 -- 172.21.15.81:0/1201421919 learned_addr learned my addr 172.21.15.81:0/1201421919 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef087b640 1 -- 172.21.15.81:0/1201421919 >> v1:172.21.15.136:6789/0 conn(0x7f7eec06fab0 legacy=0x7f7eec06fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef087b640 1 -- 172.21.15.81:0/1201421919 >> v1:172.21.15.81:6789/0 conn(0x7f7eec06f2b0 legacy=0x7f7eec0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7eeaffd640 1 -- 172.21.15.81:0/1201421919 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 800859583 0 0) 0x7f7eec0b1750 con 0x7f7eec06f2b0 2024-03-18T00:25:45.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.328+0000 7f7ef087b640 1 -- 172.21.15.81:0/1201421919 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec162c00 con 0x7f7eec0d2a00 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.329+0000 7f7ef087b640 1 --2- 172.21.15.81:0/1201421919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec0cc530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009d90 tx=0x7f7ee402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea60b1253aa0bf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.329+0000 7f7eeaffd640 1 -- 172.21.15.81:0/1201421919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4039070 con 0x7f7eec0d2a00 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.329+0000 7f7eeaffd640 1 -- 172.21.15.81:0/1201421919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee402cd00 con 0x7f7eec0d2a00 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.329+0000 7f7eeaffd640 1 -- 172.21.15.81:0/1201421919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4034660 con 0x7f7eec0d2a00 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 -- 172.21.15.81:0/1201421919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 msgr2=0x7f7eec0cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1201421919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec0cc530 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009d90 tx=0x7f7ee402bf50 comp rx=0 tx=0).stop 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 -- 172.21.15.81:0/1201421919 shutdown_connections 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1201421919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec0cc530 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 -- 172.21.15.81:0/1201421919 >> 172.21.15.81:0/1201421919 conn(0x7f7eec0d1ee0 msgr2=0x7f7eec0d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 -- 172.21.15.81:0/1201421919 shutdown_connections 2024-03-18T00:25:45.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.330+0000 7f7ef22de640 1 -- 172.21.15.81:0/1201421919 wait complete. 2024-03-18T00:25:45.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.331+0000 7f7ef22de640 1 Processor -- start 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.331+0000 7f7ef22de640 1 -- start start 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7eec06f2b0 0x7f7eec14e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7eec06fab0 0x7f7eec15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec161d70 con 0x7f7eec0d2a00 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7eec162ee0 con 0x7f7eec06f2b0 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef22de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7eec0d05c0 con 0x7f7eec06fab0 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60240/0 (socket says 172.21.15.81:60240) 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 -- 172.21.15.81:0/1378935528 learned_addr learned my addr 172.21.15.81:0/1378935528 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7eeb7fe640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7eec06fab0 0x7f7eec15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7eebfff640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7eec06f2b0 0x7f7eec14e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:45.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 -- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7eec06fab0 msgr2=0x7f7eec15a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7eec06fab0 0x7f7eec15a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 -- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7eec06f2b0 msgr2=0x7f7eec14e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7eec06f2b0 0x7f7eec14e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 -- 172.21.15.81:0/1378935528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eec09cf90 con 0x7f7eec0d2a00 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.332+0000 7f7ef087b640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4037040 tx=0x7f7ee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.333+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4044020 con 0x7f7eec0d2a00 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.333+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ee403a040 con 0x7f7eec0d2a00 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.333+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7eec15b1d0 con 0x7f7eec0d2a00 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.333+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4039050 con 0x7f7eec0d2a00 2024-03-18T00:25:45.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.333+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7eec15b790 con 0x7f7eec0d2a00 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.334+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7eec04f5b0 con 0x7f7eec0d2a00 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.334+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7ee402cbc0 con 0x7f7eec0d2a00 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.335+0000 7f7ee8ff9640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 0x7f7ed806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.335+0000 7f7eebfff640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 0x7f7ed806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.335+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ee40ad020 con 0x7f7eec0d2a00 2024-03-18T00:25:45.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.335+0000 7f7eebfff640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 0x7f7ed806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000f60 tx=0x7f7edc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:45.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.339+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7ee404e060 con 0x7f7eec0d2a00 2024-03-18T00:25:45.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.548+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7eec06f890 con 0x7f7eec0d2a00 2024-03-18T00:25:45.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.549+0000 7f7ee8ff9640 1 -- 172.21.15.81:0/1378935528 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f7ee407b550 con 0x7f7eec0d2a00 2024-03-18T00:25:45.549 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T00:25:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 msgr2=0x7f7ed806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 0x7f7ed806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7edc000f60 tx=0x7f7edc009040 comp rx=0 tx=0).stop 2024-03-18T00:25:45.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 msgr2=0x7f7eec160a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4037040 tx=0x7f7ee4004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 shutdown_connections 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7ed806bbd0 0x7f7ed806e090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7eec0d2a00 0x7f7eec160a90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7eec06fab0 0x7f7eec15a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 --2- 172.21.15.81:0/1378935528 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7eec06f2b0 0x7f7eec14e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 >> 172.21.15.81:0/1378935528 conn(0x7f7eec0d1ee0 msgr2=0x7f7eec0b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 shutdown_connections 2024-03-18T00:25:45.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:45.551+0000 7f7ef22de640 1 -- 172.21.15.81:0/1378935528 wait complete. 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi136.front.sepia.ceph.com 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T00:25:45.562 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-18T00:25:45.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:45.563 DEBUG:teuthology.orchestra.run.smithi136:> ip addr 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1a brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f0 2024-03-18T00:25:45.578 INFO:teuthology.orchestra.run.smithi136.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:d9:3b:1b brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: altname enp7s0f1 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:42 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 0c:c4:7a:88:6e:43 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: inet 172.21.15.136/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft 42744sec preferred_lft 42744sec 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::ec4:7aff:fe88:6e43/64 scope link 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether a6:38:af:46:61:70 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.579 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::c3e:bcff:fe0f:5bd/64 scope link 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run.smithi136.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether a6:38:af:46:61:70 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::a438:afff:fe46:6170/64 scope link tentative 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:45.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:45.580 DEBUG:teuthology.orchestra.run.smithi136:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T00:25:45.643 INFO:teuthology.orchestra.run.smithi136.stdout:1 2024-03-18T00:25:45.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:45.645 DEBUG:teuthology.orchestra.run.smithi136:> route 2024-03-18T00:25:45.701 INFO:teuthology.orchestra.run.smithi136.stdout:Kernel IP routing table 2024-03-18T00:25:45.701 INFO:teuthology.orchestra.run.smithi136.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T00:25:45.701 INFO:teuthology.orchestra.run.smithi136.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T00:25:45.701 INFO:teuthology.orchestra.run.smithi136.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T00:25:45.701 INFO:teuthology.orchestra.run.smithi136.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T00:25:45.702 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:45.789 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:45.830 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:45.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:45.836 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T00:25:45.852 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-18T00:25:45.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:45.852 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list-id 2024-03-18T00:25:45.907 INFO:teuthology.orchestra.run.smithi136.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-18T00:25:45.907 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:45.907 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:45.907 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-18T00:25:45.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-18T00:25:45.908 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:45.995 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:45 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:46.023 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:46.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-18T00:25:46.057 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 72:c1:59:5d:cb:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::70c1:59ff:fe5d:cb8f/64 scope link 2024-03-18T00:25:46.058 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:46.059 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-18T00:25:46.129 INFO:teuthology.orchestra.run.smithi136.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:25:46.129 INFO:teuthology.orchestra.run.smithi136.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:25:46.129 INFO:teuthology.orchestra.run.smithi136.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:25:46.129 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.129 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 ::1/128 scope host 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: link/ether 72:c1:59:5d:cb:8f brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: inet6 fe80::70c1:59ff:fe5d:cb8f/64 scope link 2024-03-18T00:25:46.130 INFO:teuthology.orchestra.run.smithi136.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:25:46.131 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-18T00:25:46.131 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:46.131 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:46.131 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-18T00:25:46.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-18T00:25:46.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-18T00:25:46.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-18T00:25:46.132 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-18T00:25:46.132 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:46.219 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:46.289 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.295 DEBUG:teuthology.orchestra.run.smithi136:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:25:46.295 DEBUG:teuthology.orchestra.run.smithi136:> set -e 2024-03-18T00:25:46.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set brx.1 up 2024-03-18T00:25:46.296 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link set dev brx.1 master ceph-brx 2024-03-18T00:25:46.296 DEBUG:teuthology.orchestra.run.smithi136:> ') 2024-03-18T00:25:46.343 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:46.372 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:46.378 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-18T00:25:46.405 INFO:teuthology.orchestra.run.smithi136.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-18T00:25:46.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:25:46.405 DEBUG:teuthology.orchestra.run.smithi136:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-18T00:25:46.459 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-18T00:25:46.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:46.460 DEBUG:teuthology.orchestra.run.smithi136:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:46.546 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:46.546 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:25:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:25:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-03-18T00:25:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: trying mount with new device syntax: 3@a215fc89-10fc-4af5-b2ff-78f3e4709ee3.cephfs=/ 2024-03-18T00:25:46.553 INFO:teuthology.orchestra.run.smithi136.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.81:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-03-18T00:25:46.554 INFO:teuthology.orchestra.run.smithi136.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-18T00:25:46.554 INFO:teuthology.orchestra.run.smithi136.stdout: You just mounted a file system that supports labels which does not 2024-03-18T00:25:46.554 INFO:teuthology.orchestra.run.smithi136.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T00:25:46.554 INFO:teuthology.orchestra.run.smithi136.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T00:25:46.554 INFO:teuthology.orchestra.run.smithi136.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T00:25:46.555 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T00:25:46.555 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:46.555 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-18T00:25:46.583 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:46.671 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:46.673 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.678 INFO:teuthology.orchestra.run.smithi136.stdout:client4508 2024-03-18T00:25:46.679 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:46.679 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:46.694 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:46.781 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:46.782 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.788 INFO:teuthology.orchestra.run.smithi136.stdout:client4508 2024-03-18T00:25:46.788 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:25:46.836 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:25:46.837 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.843 INFO:teuthology.orchestra.run.smithi136.stdout:client4508 2024-03-18T00:25:46.843 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/a215fc89-10fc-4af5-b2ff-78f3e4709ee3.client4508/status') 2024-03-18T00:25:46.891 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:25:46.904 INFO:teuthology.orchestra.run.smithi136.stdout:instance: client.4508 (3)192.168.0.2:0/2901137067 2024-03-18T00:25:46.904 INFO:teuthology.orchestra.run.smithi136.stdout:blocklisted: false 2024-03-18T00:25:46.904 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records in 2024-03-18T00:25:46.904 INFO:teuthology.orchestra.run.smithi136.stderr:0+1 records out 2024-03-18T00:25:46.904 INFO:teuthology.orchestra.run.smithi136.stderr:69 bytes copied, 2.1621e-05 s, 3.2 MB/s 2024-03-18T00:25:46.905 INFO:teuthology.orchestra.run.smithi136.stderr:2024-03-18T00:25:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:25:46.913 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-18T00:25:46.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.043+0000 7f2576eea640 1 Processor -- start 2024-03-18T00:25:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.043+0000 7f2576eea640 1 -- start start 2024-03-18T00:25:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2576eea640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f257015e5a0 0x7f25700d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2576eea640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25700d1e40 0x7f25700d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2576eea640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25700d1200 con 0x7f25700d2b80 2024-03-18T00:25:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2576eea640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f25700cff90 con 0x7f25700d1e40 2024-03-18T00:25:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2576eea640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f25700b34d0 con 0x7f257015e5a0 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2575487640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f25700d2b80 0x7f25700ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34518/0 (socket says 172.21.15.81:34518) 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f25700d1e40 0x7f25700d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2575487640 1 -- 172.21.15.81:0/4217113180 learned_addr learned my addr 172.21.15.81:0/4217113180 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f2574c86640 1 --2- 172.21.15.81:0/4217113180 >> v2:172.21.15.136:3300/0 conn(0x7f257015e5a0 0x7f25700d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256f7fe640 1 -- 172.21.15.81:0/4217113180 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3744980908 0 0) 0x7f25700d1200 con 0x7f25700d2b80 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256f7fe640 1 -- 172.21.15.81:0/4217113180 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2560003520 con 0x7f25700d2b80 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256ffff640 1 -- 172.21.15.81:0/4217113180 >> v2:172.21.15.136:3300/0 conn(0x7f257015e5a0 msgr2=0x7f25700d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256ffff640 1 --2- 172.21.15.81:0/4217113180 >> v2:172.21.15.136:3300/0 conn(0x7f257015e5a0 0x7f25700d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256ffff640 1 -- 172.21.15.81:0/4217113180 >> v1:172.21.15.81:6789/0 conn(0x7f25700d2b80 legacy=0x7f25700ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.044+0000 7f256ffff640 1 -- 172.21.15.81:0/4217113180 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25700d14e0 con 0x7f25700d1e40 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.045+0000 7f256ffff640 1 --2- 172.21.15.81:0/4217113180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d1e40 0x7f25700d2640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25700d1b60 tx=0x7f255c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8dafe5a5f78900e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.045+0000 7f256f7fe640 1 -- 172.21.15.81:0/4217113180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c0315a0 con 0x7f25700d1e40 2024-03-18T00:25:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.045+0000 7f256f7fe640 1 -- 172.21.15.81:0/4217113180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c037070 con 0x7f25700d1e40 2024-03-18T00:25:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.045+0000 7f256f7fe640 1 -- 172.21.15.81:0/4217113180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c031960 con 0x7f25700d1e40 2024-03-18T00:25:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 -- 172.21.15.81:0/4217113180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d1e40 msgr2=0x7f25700d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 --2- 172.21.15.81:0/4217113180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d1e40 0x7f25700d2640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f25700d1b60 tx=0x7f255c02b840 comp rx=0 tx=0).stop 2024-03-18T00:25:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 -- 172.21.15.81:0/4217113180 shutdown_connections 2024-03-18T00:25:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 --2- 172.21.15.81:0/4217113180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d1e40 0x7f25700d2640 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 --2- 172.21.15.81:0/4217113180 >> v2:172.21.15.136:3300/0 conn(0x7f257015e5a0 0x7f25700d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 -- 172.21.15.81:0/4217113180 >> 172.21.15.81:0/4217113180 conn(0x7f25700d4060 msgr2=0x7f25700d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 -- 172.21.15.81:0/4217113180 shutdown_connections 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.046+0000 7f2576eea640 1 -- 172.21.15.81:0/4217113180 wait complete. 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.047+0000 7f2576eea640 1 Processor -- start 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.047+0000 7f2576eea640 1 -- start start 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25700d1e40 0x7f25701f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257015e5a0 0x7f25700cb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25700b4c50 con 0x7f25700d2b80 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f25700d2fd0 con 0x7f25700d1e40 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f25700b4dd0 con 0x7f257015e5a0 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60796/0 (socket says 172.21.15.81:60796) 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 -- 172.21.15.81:0/3951381059 learned_addr learned my addr 172.21.15.81:0/3951381059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2574c86640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25700d1e40 0x7f25701f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2575487640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257015e5a0 0x7f25700cb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 -- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257015e5a0 msgr2=0x7f25700cb960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257015e5a0 0x7f25700cb960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 -- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25700d1e40 msgr2=0x7f25701f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25700d1e40 0x7f25701f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 -- 172.21.15.81:0/3951381059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25700cb1d0 con 0x7f25700d2b80 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256ffff640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f255c009890 tx=0x7f255c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c032630 con 0x7f25700d2b80 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255c0327d0 con 0x7f25700d2b80 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255c032bc0 con 0x7f25700d2b80 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.048+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25701f7c30 con 0x7f25700d2b80 2024-03-18T00:25:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.049+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25701f7940 con 0x7f25700d2b80 2024-03-18T00:25:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.049+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f257004f5b0 con 0x7f25700d2b80 2024-03-18T00:25:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.050+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f255c03b3f0 con 0x7f25700d2b80 2024-03-18T00:25:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.050+0000 7f256d7fa640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 0x7f255406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.050+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f255c02f030 con 0x7f25700d2b80 2024-03-18T00:25:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.050+0000 7f2574c86640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 0x7f255406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.051+0000 7f2574c86640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 0x7f255406e0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2564009b40 tx=0x7f2564009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.055+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f255c040070 con 0x7f25700d2b80 2024-03-18T00:25:47.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.230+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f25700cf920 con 0x7f25700d2b80 2024-03-18T00:25:47.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.231+0000 7f256d7fa640 1 -- 172.21.15.81:0/3951381059 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f255c07aad0 con 0x7f25700d2b80 2024-03-18T00:25:47.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:47.232 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 msgr2=0x7f255406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 0x7f255406e0c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2564009b40 tx=0x7f2564009190 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 msgr2=0x7f257006bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f255c009890 tx=0x7f255c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 shutdown_connections 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f257015e5a0 0x7f25700cb960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f255406bc00 0x7f255406e0c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25700d2b80 0x7f257006bf70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 --2- 172.21.15.81:0/3951381059 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f25700d1e40 0x7f25701f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 >> 172.21.15.81:0/3951381059 conn(0x7f25700d4060 msgr2=0x7f25700ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 shutdown_connections 2024-03-18T00:25:47.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.233+0000 7f2576eea640 1 -- 172.21.15.81:0/3951381059 wait complete. 2024-03-18T00:25:47.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:47.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:47.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.347+0000 7fd376d29640 1 Processor -- start 2024-03-18T00:25:47.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.347+0000 7fd376d29640 1 -- start start 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd376d29640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd37015e260 0x7fd3700cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd376d29640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 0x7fd37006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd376d29640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd37006d1c0 con 0x7fd3700cdc90 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd376d29640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd37015e640 con 0x7fd37015e260 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd376d29640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd37006d4a0 con 0x7fd37006e4c0 2024-03-18T00:25:47.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd37015e260 0x7fd3700cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd37015e260 0x7fd3700cf740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60802/0 (socket says 172.21.15.81:60802) 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 -- 172.21.15.81:0/173763359 learned_addr learned my addr 172.21.15.81:0/173763359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd36ffff640 1 --2- 172.21.15.81:0/173763359 >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 0x7fd37006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 -- 172.21.15.81:0/173763359 >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 msgr2=0x7fd37006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 --2- 172.21.15.81:0/173763359 >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 0x7fd37006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 -- 172.21.15.81:0/173763359 >> v1:172.21.15.136:6789/0 conn(0x7fd3700cdc90 legacy=0x7fd3700ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd374ac5640 1 -- 172.21.15.81:0/173763359 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd37006d780 con 0x7fd37015e260 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.348+0000 7fd36ffff640 1 --2- 172.21.15.81:0/173763359 >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 0x7fd37006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:47.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.349+0000 7fd374ac5640 1 --2- 172.21.15.81:0/173763359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37015e260 0x7fd3700cf740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cd940 tx=0x7fd36002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e72a402f7135ff0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.349+0000 7fd36f7fe640 1 -- 172.21.15.81:0/173763359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360034070 con 0x7fd37015e260 2024-03-18T00:25:47.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.349+0000 7fd36f7fe640 1 -- 172.21.15.81:0/173763359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd360030860 con 0x7fd37015e260 2024-03-18T00:25:47.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.349+0000 7fd36f7fe640 1 -- 172.21.15.81:0/173763359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360030c30 con 0x7fd37015e260 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 -- 172.21.15.81:0/173763359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37015e260 msgr2=0x7fd3700cf740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 --2- 172.21.15.81:0/173763359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37015e260 0x7fd3700cf740 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd3700cd940 tx=0x7fd36002b9a0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 -- 172.21.15.81:0/173763359 shutdown_connections 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 --2- 172.21.15.81:0/173763359 >> v2:172.21.15.136:3300/0 conn(0x7fd37006e4c0 0x7fd37006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 --2- 172.21.15.81:0/173763359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37015e260 0x7fd3700cf740 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 -- 172.21.15.81:0/173763359 >> 172.21.15.81:0/173763359 conn(0x7fd3700b1bf0 msgr2=0x7fd3700b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 -- 172.21.15.81:0/173763359 shutdown_connections 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.350+0000 7fd376d29640 1 -- 172.21.15.81:0/173763359 wait complete. 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.351+0000 7fd376d29640 1 Processor -- start 2024-03-18T00:25:47.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.351+0000 7fd376d29640 1 -- start start 2024-03-18T00:25:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3700cdc90 0x7fd37009d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 0x7fd370155540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3700ca860 con 0x7fd37006e4c0 2024-03-18T00:25:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd37006dd40 con 0x7fd37015e260 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd376d29640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd3700ca9e0 con 0x7fd3700cdc90 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60806/0 (socket says 172.21.15.81:60806) 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 -- 172.21.15.81:0/2233419597 learned_addr learned my addr 172.21.15.81:0/2233419597 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd36ffff640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3700cdc90 0x7fd37009d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd3752c6640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 0x7fd370155540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 -- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3700cdc90 msgr2=0x7fd37009d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3700cdc90 0x7fd37009d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 -- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 msgr2=0x7fd370155540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 0x7fd370155540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 -- 172.21.15.81:0/2233419597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3700b46d0 con 0x7fd37006e4c0 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd3752c6640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 0x7fd370155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.352+0000 7fd374ac5640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd360000c00 tx=0x7fd3600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.353+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360034040 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.353+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3701f4a10 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.353+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd360039d90 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.353+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360043610 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.353+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3701f4fd0 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.354+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd37004f540 con 0x7fd37006e4c0 2024-03-18T00:25:47.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.354+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd360037070 con 0x7fd37006e4c0 2024-03-18T00:25:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.354+0000 7fd36d7fa640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 0x7fd35c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.355+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd3600acbc0 con 0x7fd37006e4c0 2024-03-18T00:25:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.355+0000 7fd36ffff640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 0x7fd35c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.355+0000 7fd36ffff640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 0x7fd35c06e090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd364009560 tx=0x7fd364008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.359+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd36003e070 con 0x7fd37006e4c0 2024-03-18T00:25:47.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.531+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd3700cb110 con 0x7fd37006e4c0 2024-03-18T00:25:47.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.531+0000 7fd36d7fa640 1 -- 172.21.15.81:0/2233419597 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fd36007b630 con 0x7fd37006e4c0 2024-03-18T00:25:47.532 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 msgr2=0x7fd35c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 0x7fd35c06e090 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd364009560 tx=0x7fd364008040 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 msgr2=0x7fd3700b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd360000c00 tx=0x7fd3600046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 shutdown_connections 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd37015e260 0x7fd370155540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd3700cdc90 0x7fd37009d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd35c06bbd0 0x7fd35c06e090 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 --2- 172.21.15.81:0/2233419597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd37006e4c0 0x7fd3700b4190 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 >> 172.21.15.81:0/2233419597 conn(0x7fd3700b1bf0 msgr2=0x7fd3700cfad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 shutdown_connections 2024-03-18T00:25:47.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.533+0000 7fd376d29640 1 -- 172.21.15.81:0/2233419597 wait complete. 2024-03-18T00:25:47.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:47.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.649+0000 7fa246e80640 1 Processor -- start 2024-03-18T00:25:47.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.649+0000 7fa246e80640 1 -- start start 2024-03-18T00:25:47.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa246e80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24006b1c0 0x7fa24006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa246e80640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa24015e3f0 0x7fa2400702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa246e80640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2400cd5f0 con 0x7fa240070820 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa246e80640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fa24006bae0 con 0x7fa24015e3f0 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa246e80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400cb740 con 0x7fa24006b1c0 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa23ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fa24015e3f0 0x7fa2400702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa24541d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa240070820 0x7fa24006e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34522/0 (socket says 172.21.15.81:34522) 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa24541d640 1 -- 172.21.15.81:0/3272705285 learned_addr learned my addr 172.21.15.81:0/3272705285 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.650+0000 7fa244c1c640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24006b1c0 0x7fa24006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23ffff640 1 -- 172.21.15.81:0/3272705285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24006b1c0 msgr2=0x7fa24006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23ffff640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24006b1c0 0x7fa24006b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23ffff640 1 -- 172.21.15.81:0/3272705285 >> v1:172.21.15.81:6789/0 conn(0x7fa240070820 legacy=0x7fa24006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23ffff640 1 -- 172.21.15.81:0/3272705285 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2400cba20 con 0x7fa24015e3f0 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23f7fe640 1 -- 172.21.15.81:0/3272705285 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212891140 0 0) 0x7fa2400cd5f0 con 0x7fa240070820 2024-03-18T00:25:47.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23ffff640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24015e3f0 0x7fa2400702e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa23402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2529d37326a44a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23f7fe640 1 -- 172.21.15.81:0/3272705285 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234034070 con 0x7fa24015e3f0 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23f7fe640 1 -- 172.21.15.81:0/3272705285 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234030610 con 0x7fa24015e3f0 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.651+0000 7fa23f7fe640 1 -- 172.21.15.81:0/3272705285 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2340309e0 con 0x7fa24015e3f0 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 -- 172.21.15.81:0/3272705285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24015e3f0 msgr2=0x7fa2400702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24015e3f0 0x7fa2400702e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa23402b960 comp rx=0 tx=0).stop 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 -- 172.21.15.81:0/3272705285 shutdown_connections 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa24015e3f0 0x7fa2400702e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 --2- 172.21.15.81:0/3272705285 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24006b1c0 0x7fa24006b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 -- 172.21.15.81:0/3272705285 >> 172.21.15.81:0/3272705285 conn(0x7fa2400b2b20 msgr2=0x7fa2400b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 -- 172.21.15.81:0/3272705285 shutdown_connections 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.652+0000 7fa246e80640 1 -- 172.21.15.81:0/3272705285 wait complete. 2024-03-18T00:25:47.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.653+0000 7fa246e80640 1 Processor -- start 2024-03-18T00:25:47.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.653+0000 7fa246e80640 1 -- start start 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24006b1c0 0x7fa24014f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24015e3f0 0x7fa2400b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa24006e790 con 0x7fa240070820 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa2400cf8b0 con 0x7fa24006b1c0 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa246e80640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa2400cbd00 con 0x7fa24015e3f0 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 -- 172.21.15.81:0/2217439622 learned_addr learned my addr 172.21.15.81:0/2217439622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa24541d640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24015e3f0 0x7fa2400b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa244c1c640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24006b1c0 0x7fa24014f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 -- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24015e3f0 msgr2=0x7fa2400b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24015e3f0 0x7fa2400b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 -- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24006b1c0 msgr2=0x7fa24014f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24006b1c0 0x7fa24014f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.654+0000 7fa23ffff640 1 -- 172.21.15.81:0/2217439622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2400b3e30 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa23ffff640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa23402bf70 tx=0x7fa2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234034040 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23403aaa0 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2400b4110 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2340443f0 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.655+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2400b46d0 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.656+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa24004f540 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.656+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa23404b060 con 0x7fa240070820 2024-03-18T00:25:47.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.657+0000 7fa23d7fa640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 0x7fa22c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.657+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa2340ac650 con 0x7fa240070820 2024-03-18T00:25:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.657+0000 7fa244c1c640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 0x7fa22c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.657+0000 7fa244c1c640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 0x7fa22c06e0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa230009b40 tx=0x7fa230009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.661+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa23403f070 con 0x7fa240070820 2024-03-18T00:25:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.834+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa2400b3b60 con 0x7fa240070820 2024-03-18T00:25:47.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.834+0000 7fa23d7fa640 1 -- 172.21.15.81:0/2217439622 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7fa23407aaf0 con 0x7fa240070820 2024-03-18T00:25:47.835 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 msgr2=0x7fa22c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 0x7fa22c06e0c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa230009b40 tx=0x7fa230009190 comp rx=0 tx=0).stop 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 msgr2=0x7fa2400b0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa23402bf70 tx=0x7fa2340046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 shutdown_connections 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa24015e3f0 0x7fa2400b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa22c06bc00 0x7fa22c06e0c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa240070820 0x7fa2400b0a90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 --2- 172.21.15.81:0/2217439622 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa24006b1c0 0x7fa24014f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 >> 172.21.15.81:0/2217439622 conn(0x7fa2400b2b20 msgr2=0x7fa2400ade00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 shutdown_connections 2024-03-18T00:25:47.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.836+0000 7fa246e80640 1 -- 172.21.15.81:0/2217439622 wait complete. 2024-03-18T00:25:47.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:47.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.950+0000 7f3b92c7e640 1 Processor -- start 2024-03-18T00:25:47.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.950+0000 7f3b92c7e640 1 -- start start 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b92c7e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3b8c06d1d0 0x7f3b8c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b92c7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b92c7e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8c0cf2c0 con 0x7f3b8c0ceee0 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b92c7e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c161c70 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b92c7e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8c0d1590 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b9121b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b9121b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60842/0 (socket says 172.21.15.81:60842) 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.951+0000 7f3b9121b640 1 -- 172.21.15.81:0/2612609010 learned_addr learned my addr 172.21.15.81:0/2612609010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b8bfff640 1 --2- 172.21.15.81:0/2612609010 >> v2:172.21.15.136:3300/0 conn(0x7f3b8c06d1d0 0x7f3b8c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b9121b640 1 -- 172.21.15.81:0/2612609010 >> v2:172.21.15.136:3300/0 conn(0x7f3b8c06d1d0 msgr2=0x7f3b8c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b9121b640 1 --2- 172.21.15.81:0/2612609010 >> v2:172.21.15.136:3300/0 conn(0x7f3b8c06d1d0 0x7f3b8c0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b9121b640 1 -- 172.21.15.81:0/2612609010 >> v1:172.21.15.136:6789/0 conn(0x7f3b8c0ceee0 legacy=0x7f3b8c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b9121b640 1 -- 172.21.15.81:0/2612609010 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c0d12b0 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.952+0000 7f3b9121b640 1 --2- 172.21.15.81:0/2612609010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c071820 tx=0x7f3b8402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c224c07b6d21ec2f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b8b7fe640 1 -- 172.21.15.81:0/2612609010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8402ca80 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b8b7fe640 1 -- 172.21.15.81:0/2612609010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b8402cc20 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b8b7fe640 1 -- 172.21.15.81:0/2612609010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b840343f0 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 -- 172.21.15.81:0/2612609010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c0d0a80 msgr2=0x7f3b8c0cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/2612609010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c071820 tx=0x7f3b8402bee0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 -- 172.21.15.81:0/2612609010 shutdown_connections 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/2612609010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0cd090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/2612609010 >> v2:172.21.15.136:3300/0 conn(0x7f3b8c06d1d0 0x7f3b8c0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 -- 172.21.15.81:0/2612609010 >> 172.21.15.81:0/2612609010 conn(0x7f3b8c09b160 msgr2=0x7f3b8c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 -- 172.21.15.81:0/2612609010 shutdown_connections 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.953+0000 7f3b92c7e640 1 -- 172.21.15.81:0/2612609010 wait complete. 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.954+0000 7f3b92c7e640 1 Processor -- start 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.954+0000 7f3b92c7e640 1 -- start start 2024-03-18T00:25:47.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b8c0ceee0 0x7f3b8c0c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0cc890 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8c0ccc00 con 0x7f3b8c0d0a80 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b92c7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8c0d0eb0 con 0x7f3b8c0ceee0 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b90a1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b90a1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60846/0 (socket says 172.21.15.81:60846) 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b90a1a640 1 -- 172.21.15.81:0/509092906 learned_addr learned my addr 172.21.15.81:0/509092906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b8bfff640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b8c0ceee0 0x7f3b8c0c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.955+0000 7f3b9121b640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 -- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b8c0ceee0 msgr2=0x7f3b8c0c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b8c0ceee0 0x7f3b8c0c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 -- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c0d0a80 msgr2=0x7f3b8c0c5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0c5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 -- 172.21.15.81:0/509092906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8c15db50 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b90a1a640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c400 tx=0x7f3b7c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0052d0 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c005490 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b8c0cb5a0 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c007260 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.956+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b8c15e0f0 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.957+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8c04f540 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.957+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3b7c007400 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.958+0000 7f3b897fa640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 0x7f3b7806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.958+0000 7f3b8bfff640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 0x7f3b7806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.958+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f3b7c089fe0 con 0x7f3b8c06d1d0 2024-03-18T00:25:47.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.958+0000 7f3b8bfff640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 0x7f3b7806e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0686e0 tx=0x7f3b80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:47.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:47.962+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3b7c058ad0 con 0x7f3b8c06d1d0 2024-03-18T00:25:48.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.135+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f3b8c0bc3d0 con 0x7f3b8c06d1d0 2024-03-18T00:25:48.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.135+0000 7f3b897fa640 1 -- 172.21.15.81:0/509092906 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f3b7c0583d0 con 0x7f3b8c06d1d0 2024-03-18T00:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 msgr2=0x7f3b7806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 0x7f3b7806e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c0686e0 tx=0x7f3b80008040 comp rx=0 tx=0).stop 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 msgr2=0x7f3b8c157480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c00c400 tx=0x7f3b7c00c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 shutdown_connections 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b8c0d0a80 0x7f3b8c0c5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b8c0ceee0 0x7f3b8c0c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b7806bbd0 0x7f3b7806e090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 --2- 172.21.15.81:0/509092906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b8c06d1d0 0x7f3b8c157480 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 >> 172.21.15.81:0/509092906 conn(0x7f3b8c09b160 msgr2=0x7f3b8c0ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 shutdown_connections 2024-03-18T00:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.137+0000 7f3b92c7e640 1 -- 172.21.15.81:0/509092906 wait complete. 2024-03-18T00:25:48.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.248+0000 7ff0126c6640 1 Processor -- start 2024-03-18T00:25:48.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.248+0000 7ff0126c6640 1 -- start start 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff0126c6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c071720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff0126c6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00c06e6f0 con 0x7ff00c15e170 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff0126c6640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00c06d380 con 0x7ff00c154a90 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff0126c6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c06d650 con 0x7ff00c15e5d0 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff00b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff00c15e170 0x7ff00c071010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34530/0 (socket says 172.21.15.81:34530) 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff00b7fe640 1 -- 172.21.15.81:0/936868282 learned_addr learned my addr 172.21.15.81:0/936868282 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff010c63640 1 --2- 172.21.15.81:0/936868282 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c071720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425156671 0 0) 0x7ff00c06e6f0 con 0x7ff00c15e170 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.249+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feff4003520 con 0x7ff00c15e170 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780125707 0 0) 0x7ff00c06d380 con 0x7ff00c154a90 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff00c06e6f0 con 0x7ff00c154a90 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff010c63640 1 -- 172.21.15.81:0/936868282 >> v1:172.21.15.136:6789/0 conn(0x7ff00c154a90 legacy=0x7ff00c06cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff010c63640 1 -- 172.21.15.81:0/936868282 >> v1:172.21.15.81:6789/0 conn(0x7ff00c15e170 legacy=0x7ff00c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff010c63640 1 -- 172.21.15.81:0/936868282 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c06d930 con 0x7ff00c15e5d0 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.250+0000 7ff010c63640 1 --2- 172.21.15.81:0/936868282 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c071720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff004009dc0 tx=0x7ff00402bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a9c1d495452238 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004039070 con 0x7ff00c15e5d0 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00402ccd0 con 0x7ff00c15e5d0 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff00affd640 1 -- 172.21.15.81:0/936868282 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff004034660 con 0x7ff00c15e5d0 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 -- 172.21.15.81:0/936868282 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 msgr2=0x7ff00c071720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 --2- 172.21.15.81:0/936868282 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c071720 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff004009dc0 tx=0x7ff00402bf20 comp rx=0 tx=0).stop 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 -- 172.21.15.81:0/936868282 shutdown_connections 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 --2- 172.21.15.81:0/936868282 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c071720 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 -- 172.21.15.81:0/936868282 >> 172.21.15.81:0/936868282 conn(0x7ff00c06b5e0 msgr2=0x7ff00c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 -- 172.21.15.81:0/936868282 shutdown_connections 2024-03-18T00:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.251+0000 7ff0126c6640 1 -- 172.21.15.81:0/936868282 wait complete. 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.252+0000 7ff0126c6640 1 Processor -- start 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.252+0000 7ff0126c6640 1 -- start start 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c15e170 0x7ff00c15c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c158d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c06e1d0 con 0x7ff00c154a90 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff00c06def0 con 0x7ff00c15e170 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff0126c6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff00c15ea60 con 0x7ff00c15e5d0 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60856/0 (socket says 172.21.15.81:60856) 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 -- 172.21.15.81:0/3834718599 learned_addr learned my addr 172.21.15.81:0/3834718599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00b7fe640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c15e170 0x7ff00c15c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff010c63640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c158d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 -- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 msgr2=0x7ff00c158d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c158d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 -- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c15e170 msgr2=0x7ff00c15c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c15e170 0x7ff00c15c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.253+0000 7ff00bfff640 1 -- 172.21.15.81:0/3834718599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff00c15ce30 con 0x7ff00c154a90 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff00bfff640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c500 tx=0x7feffc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc0052d0 con 0x7ff00c154a90 2024-03-18T00:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc005490 con 0x7ff00c154a90 2024-03-18T00:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feffc012870 con 0x7ff00c154a90 2024-03-18T00:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff00c15d110 con 0x7ff00c154a90 2024-03-18T00:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.254+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff00c15d6d0 con 0x7ff00c154a90 2024-03-18T00:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.255+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00c04f5b0 con 0x7ff00c154a90 2024-03-18T00:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.255+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feffc012a10 con 0x7ff00c154a90 2024-03-18T00:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.255+0000 7ff008ff9640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 0x7feff806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.256+0000 7ff00b7fe640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 0x7feff806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.256+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feffc08a750 con 0x7ff00c154a90 2024-03-18T00:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.256+0000 7ff00b7fe640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 0x7feff806e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff00c09e0d0 tx=0x7ff000009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.260+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7feffc059250 con 0x7ff00c154a90 2024-03-18T00:25:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.432+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff00c158840 con 0x7ff00c154a90 2024-03-18T00:25:48.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.434+0000 7ff008ff9640 1 -- 172.21.15.81:0/3834718599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7feffc058b50 con 0x7ff00c154a90 2024-03-18T00:25:48.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:48.435 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:48.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 msgr2=0x7feff806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 0x7feff806e090 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff00c09e0d0 tx=0x7ff000009040 comp rx=0 tx=0).stop 2024-03-18T00:25:48.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 msgr2=0x7ff00c147750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feffc00c500 tx=0x7feffc00c9c0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 shutdown_connections 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff00c15e5d0 0x7ff00c158d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff00c15e170 0x7ff00c15c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feff806bbd0 0x7feff806e090 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 --2- 172.21.15.81:0/3834718599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff00c154a90 0x7ff00c147750 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 >> 172.21.15.81:0/3834718599 conn(0x7ff00c06b5e0 msgr2=0x7ff00c15aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 shutdown_connections 2024-03-18T00:25:48.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.436+0000 7ff0126c6640 1 -- 172.21.15.81:0/3834718599 wait complete. 2024-03-18T00:25:48.447 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:48.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.550+0000 7f9097a3f640 1 Processor -- start 2024-03-18T00:25:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.550+0000 7f9097a3f640 1 -- start start 2024-03-18T00:25:48.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9097a3f640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9090072d40 0x7f909006cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9097a3f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90900cda10 con 0x7f9090145700 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9097a3f640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90900cdcf0 con 0x7f9090160170 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9097a3f640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f90900cd7c0 con 0x7f9090072d40 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f90957db640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f9090145700 0x7f909015fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34542/0 (socket says 172.21.15.81:34542) 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f90957db640 1 -- 172.21.15.81:0/3495121376 learned_addr learned my addr 172.21.15.81:0/3495121376 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9095fdc640 1 --2- 172.21.15.81:0/3495121376 >> v2:172.21.15.136:3300/0 conn(0x7f9090072d40 0x7f909006cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162806989 0 0) 0x7f90900cda10 con 0x7f9090145700 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f907c003520 con 0x7f9090145700 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348130091 0 0) 0x7f90900cdcf0 con 0x7f9090160170 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90900cda10 con 0x7f9090160170 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9095fdc640 1 -- 172.21.15.81:0/3495121376 >> v1:172.21.15.136:6789/0 conn(0x7f9090160170 legacy=0x7f90900cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9095fdc640 1 -- 172.21.15.81:0/3495121376 >> v1:172.21.15.81:6789/0 conn(0x7f9090145700 legacy=0x7f909015fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.551+0000 7f9095fdc640 1 -- 172.21.15.81:0/3495121376 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90900cdfd0 con 0x7f9090072d40 2024-03-18T00:25:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.552+0000 7f9095fdc640 1 --2- 172.21.15.81:0/3495121376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090072d40 0x7f909006cdc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90900cd940 tx=0x7f908802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff365a6a95fe7a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.552+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088039070 con 0x7f9090072d40 2024-03-18T00:25:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.552+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f908802cbc0 con 0x7f9090072d40 2024-03-18T00:25:48.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.552+0000 7f9087fff640 1 -- 172.21.15.81:0/3495121376 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9088034440 con 0x7f9090072d40 2024-03-18T00:25:48.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 -- 172.21.15.81:0/3495121376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090072d40 msgr2=0x7f909006cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 --2- 172.21.15.81:0/3495121376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090072d40 0x7f909006cdc0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f90900cd940 tx=0x7f908802be10 comp rx=0 tx=0).stop 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 -- 172.21.15.81:0/3495121376 shutdown_connections 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 --2- 172.21.15.81:0/3495121376 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090072d40 0x7f909006cdc0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 -- 172.21.15.81:0/3495121376 >> 172.21.15.81:0/3495121376 conn(0x7f90900cfbf0 msgr2=0x7f90900cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 -- 172.21.15.81:0/3495121376 shutdown_connections 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.553+0000 7f9097a3f640 1 -- 172.21.15.81:0/3495121376 wait complete. 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.554+0000 7f9097a3f640 1 Processor -- start 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.554+0000 7f9097a3f640 1 -- start start 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9090072d40 0x7f909015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090160170 0x7f909006e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90900ce7d0 con 0x7f9090145700 2024-03-18T00:25:48.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f90900ce340 con 0x7f9090160170 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9097a3f640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f90900ce950 con 0x7f9090072d40 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60864/0 (socket says 172.21.15.81:60864) 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 -- 172.21.15.81:0/2960059884 learned_addr learned my addr 172.21.15.81:0/2960059884 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f90957db640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9090072d40 0x7f909015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9095fdc640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090160170 0x7f909006e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 -- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9090072d40 msgr2=0x7f909015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9090072d40 0x7f909015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 -- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090160170 msgr2=0x7f909006e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090160170 0x7f909006e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 -- 172.21.15.81:0/2960059884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90900ad9f0 con 0x7f9090145700 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9094fda640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f908000c3f0 tx=0x7f908000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.555+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080017070 con 0x7f9090145700 2024-03-18T00:25:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.556+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90800052f0 con 0x7f9090145700 2024-03-18T00:25:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.556+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9080003830 con 0x7f9090145700 2024-03-18T00:25:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.556+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90900adc90 con 0x7f9090145700 2024-03-18T00:25:48.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.556+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90900ae250 con 0x7f9090145700 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.557+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90900ced10 con 0x7f9090145700 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.557+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f908001a070 con 0x7f9090145700 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.557+0000 7f9085ffb640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 0x7f907406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.558+0000 7f90957db640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 0x7f907406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.558+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9080089cc0 con 0x7f9090145700 2024-03-18T00:25:48.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.558+0000 7f90957db640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 0x7f907406e0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f908c0011e0 tx=0x7f908c007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.562+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f90900ced10 con 0x7f9090145700 2024-03-18T00:25:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.736+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f909004f540 con 0x7f9090145700 2024-03-18T00:25:48.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.737+0000 7f9085ffb640 1 -- 172.21.15.81:0/2960059884 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f908005e020 con 0x7f9090145700 2024-03-18T00:25:48.737 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 msgr2=0x7f907406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 0x7f907406e0c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f908c0011e0 tx=0x7f908c007d30 comp rx=0 tx=0).stop 2024-03-18T00:25:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 msgr2=0x7f909006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f908000c3f0 tx=0x7f908000c8b0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 shutdown_connections 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9090160170 0x7f909006e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f907406bc00 0x7f907406e0c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9090145700 0x7f909006db70 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 --2- 172.21.15.81:0/2960059884 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9090072d40 0x7f909015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 >> 172.21.15.81:0/2960059884 conn(0x7f90900cfbf0 msgr2=0x7f90901445e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 shutdown_connections 2024-03-18T00:25:48.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.739+0000 7f9097a3f640 1 -- 172.21.15.81:0/2960059884 wait complete. 2024-03-18T00:25:48.750 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.852+0000 7f8d61027640 1 Processor -- start 2024-03-18T00:25:48.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.852+0000 7f8d61027640 1 -- start start 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d61027640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 0x7f8d5c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d61027640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 0x7f8d5c0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d61027640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0cf2c0 con 0x7f8d5c06d000 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d61027640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5c161c70 con 0x7f8d5c0d0c50 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d61027640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c0d1590 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d5a59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8d5c06d000 0x7f8d5c0d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34556/0 (socket says 172.21.15.81:34556) 2024-03-18T00:25:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d5a59c640 1 -- 172.21.15.81:0/4099306445 learned_addr learned my addr 172.21.15.81:0/4099306445 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/4099306445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 0x7f8d5c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.853+0000 7f8d5b59e640 1 --2- 172.21.15.81:0/4099306445 >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 0x7f8d5c0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d59d9b640 1 -- 172.21.15.81:0/4099306445 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179693176 0 0) 0x7f8d5c0cf2c0 con 0x7f8d5c06d000 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d59d9b640 1 -- 172.21.15.81:0/4099306445 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d44003520 con 0x7f8d5c06d000 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/4099306445 >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 msgr2=0x7f8d5c0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/4099306445 >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 0x7f8d5c0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/4099306445 >> v1:172.21.15.81:6789/0 conn(0x7f8d5c06d000 legacy=0x7f8d5c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/4099306445 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c06d440 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.854+0000 7f8d5b59e640 1 --2- 172.21.15.81:0/4099306445 >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 0x7f8d5c0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:48.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/4099306445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 0x7f8d5c06cac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009d90 tx=0x7f8d4c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb306df58447ca60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d59d9b640 1 -- 172.21.15.81:0/4099306445 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c039070 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d59d9b640 1 -- 172.21.15.81:0/4099306445 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c02cbc0 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d59d9b640 1 -- 172.21.15.81:0/4099306445 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c034440 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 -- 172.21.15.81:0/4099306445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 msgr2=0x7f8d5c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 --2- 172.21.15.81:0/4099306445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 0x7f8d5c06cac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c009d90 tx=0x7f8d4c02be10 comp rx=0 tx=0).stop 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 -- 172.21.15.81:0/4099306445 shutdown_connections 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 --2- 172.21.15.81:0/4099306445 >> v2:172.21.15.136:3300/0 conn(0x7f8d5c0d0c50 0x7f8d5c0cd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 --2- 172.21.15.81:0/4099306445 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0ceee0 0x7f8d5c06cac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 -- 172.21.15.81:0/4099306445 >> 172.21.15.81:0/4099306445 conn(0x7f8d5c09b160 msgr2=0x7f8d5c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 -- 172.21.15.81:0/4099306445 shutdown_connections 2024-03-18T00:25:48.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.855+0000 7f8d61027640 1 -- 172.21.15.81:0/4099306445 wait complete. 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 Processor -- start 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 -- start start 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d5c0ceee0 0x7f8d5c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0d0c50 0x7f8d5c14ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c0cc5b0 con 0x7f8d5c06d000 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c0ccc00 con 0x7f8d5c0ceee0 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.857+0000 7f8d61027640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c0cc890 con 0x7f8d5c0d0c50 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60876/0 (socket says 172.21.15.81:60876) 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/1753036919 learned_addr learned my addr 172.21.15.81:0/1753036919 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d5c0ceee0 0x7f8d5c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5b59e640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0d0c50 0x7f8d5c14ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0d0c50 msgr2=0x7f8d5c14ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0d0c50 0x7f8d5c14ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d5c0ceee0 msgr2=0x7f8d5c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d5c0ceee0 0x7f8d5c0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:48.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 -- 172.21.15.81:0/1753036919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c15c830 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d5ad9d640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c037040 tx=0x7f8d4c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c039050 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c045070 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c15f0b0 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c009450 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.858+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c15cdb0 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.859+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c04f540 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.860+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8d4c03e850 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.860+0000 7f8d437fe640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 0x7f8d4806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.860+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8d4c0ad800 con 0x7f8d5c06d000 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.860+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 0x7f8d4806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.860+0000 7f8d5a59c640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 0x7f8d4806e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0700d0 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:48.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:48.864+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8d4c07c410 con 0x7f8d5c06d000 2024-03-18T00:25:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.036+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8d5c0cf4b0 con 0x7f8d5c06d000 2024-03-18T00:25:49.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.037+0000 7f8d437fe640 1 -- 172.21.15.81:0/1753036919 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f8d4c07bd10 con 0x7f8d5c06d000 2024-03-18T00:25:49.037 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 msgr2=0x7f8d4806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 0x7f8d4806e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c0700d0 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 msgr2=0x7f8d5c1f8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c037040 tx=0x7f8d4c004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 shutdown_connections 2024-03-18T00:25:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8d5c0d0c50 0x7f8d5c14ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8d5c0ceee0 0x7f8d5c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8d4806bbd0 0x7f8d4806e090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 --2- 172.21.15.81:0/1753036919 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d5c06d000 0x7f8d5c1f8190 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 >> 172.21.15.81:0/1753036919 conn(0x7f8d5c09b160 msgr2=0x7f8d5c0cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.038+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 shutdown_connections 2024-03-18T00:25:49.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.039+0000 7f8d61027640 1 -- 172.21.15.81:0/1753036919 wait complete. 2024-03-18T00:25:49.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:49.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.153+0000 7fd2ece36640 1 Processor -- start 2024-03-18T00:25:49.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.153+0000 7fd2ece36640 1 -- start start 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2ece36640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2e80ca940 0x7fd2e806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2ece36640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fd2e80ce100 0x7fd2e80c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2ece36640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e815aa30 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2ece36640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e806e7a0 con 0x7fd2e80ca940 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2ece36640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e806e190 con 0x7fd2e80ce100 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd2e80ca940 0x7fd2e806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e5d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd2e80cd7c0 0x7fd2e80cad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34570/0 (socket says 172.21.15.81:34570) 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e5d9b640 1 -- 172.21.15.81:0/343547224 learned_addr learned my addr 172.21.15.81:0/343547224 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e6d9d640 1 --2- 172.21.15.81:0/343547224 >> v2:172.21.15.136:3300/0 conn(0x7fd2e80ce100 0x7fd2e80c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e659c640 1 -- 172.21.15.81:0/343547224 >> v2:172.21.15.136:3300/0 conn(0x7fd2e80ce100 msgr2=0x7fd2e80c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e659c640 1 --2- 172.21.15.81:0/343547224 >> v2:172.21.15.136:3300/0 conn(0x7fd2e80ce100 0x7fd2e80c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e659c640 1 -- 172.21.15.81:0/343547224 >> v1:172.21.15.81:6789/0 conn(0x7fd2e80cd7c0 legacy=0x7fd2e80cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e659c640 1 -- 172.21.15.81:0/343547224 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80ce6c0 con 0x7fd2e80ca940 2024-03-18T00:25:49.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.154+0000 7fd2e559a640 1 -- 172.21.15.81:0/343547224 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31382470 0 0) 0x7fd2dc001110 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.155+0000 7fd2e659c640 1 --2- 172.21.15.81:0/343547224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80ca940 0x7fd2e806ec30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8070d10 tx=0x7fd2d802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad9980f5bb5fa6b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.155+0000 7fd2e559a640 1 -- 172.21.15.81:0/343547224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8039070 con 0x7fd2e80ca940 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.155+0000 7fd2e559a640 1 -- 172.21.15.81:0/343547224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d802cbf0 con 0x7fd2e80ca940 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.155+0000 7fd2e559a640 1 -- 172.21.15.81:0/343547224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8034440 con 0x7fd2e80ca940 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 -- 172.21.15.81:0/343547224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80ca940 msgr2=0x7fd2e806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 --2- 172.21.15.81:0/343547224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80ca940 0x7fd2e806ec30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8070d10 tx=0x7fd2d802be40 comp rx=0 tx=0).stop 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 -- 172.21.15.81:0/343547224 shutdown_connections 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 --2- 172.21.15.81:0/343547224 >> v2:172.21.15.136:3300/0 conn(0x7fd2e80ce100 0x7fd2e80c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 --2- 172.21.15.81:0/343547224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80ca940 0x7fd2e806ec30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 -- 172.21.15.81:0/343547224 >> 172.21.15.81:0/343547224 conn(0x7fd2e80cfbf0 msgr2=0x7fd2e80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 -- 172.21.15.81:0/343547224 shutdown_connections 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.156+0000 7fd2ece36640 1 -- 172.21.15.81:0/343547224 wait complete. 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.157+0000 7fd2ece36640 1 Processor -- start 2024-03-18T00:25:49.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.157+0000 7fd2ece36640 1 -- start start 2024-03-18T00:25:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2e80ca940 0x7fd2e80b4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2e80ce100 0x7fd2e815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80cb430 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e80ce9a0 con 0x7fd2e80ce100 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2ece36640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e80cc260 con 0x7fd2e80ca940 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60898/0 (socket says 172.21.15.81:60898) 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 -- 172.21.15.81:0/122106057 learned_addr learned my addr 172.21.15.81:0/122106057 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e659c640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2e80ca940 0x7fd2e80b4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e6d9d640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2e80ce100 0x7fd2e815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 -- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2e80ca940 msgr2=0x7fd2e80b4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2e80ca940 0x7fd2e80b4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 -- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2e80ce100 msgr2=0x7fd2e815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2e80ce100 0x7fd2e815ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.158+0000 7fd2e5d9b640 1 -- 172.21.15.81:0/122106057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e81f23e0 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2e5d9b640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c780 tx=0x7fd2dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc018070 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2dc0070d0 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e81f26c0 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2dc0074c0 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.159+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e81f2c80 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.160+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e804f540 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.160+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd2dc01b070 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.161+0000 7fd2d6ffd640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 0x7fd2c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.161+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fd2dc089c90 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.161+0000 7fd2e659c640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 0x7fd2c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.161+0000 7fd2e659c640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 0x7fd2c806e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8036000 tx=0x7fd2d8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.165+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd2e815aa30 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.338+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd2e80cf760 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.339+0000 7fd2d6ffd640 1 -- 172.21.15.81:0/122106057 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fd2dc058130 con 0x7fd2e80cd7c0 2024-03-18T00:25:49.339 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 msgr2=0x7fd2c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 0x7fd2c806e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8036000 tx=0x7fd2d8030000 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 msgr2=0x7fd2e814ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc00c780 tx=0x7fd2dc00cc40 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 shutdown_connections 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd2e80ce100 0x7fd2e815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd2c806bbd0 0x7fd2c806e090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2e80cd7c0 0x7fd2e814ec10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 --2- 172.21.15.81:0/122106057 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd2e80ca940 0x7fd2e80b4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 >> 172.21.15.81:0/122106057 conn(0x7fd2e80cfbf0 msgr2=0x7fd2e8150b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 shutdown_connections 2024-03-18T00:25:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.341+0000 7fd2ece36640 1 -- 172.21.15.81:0/122106057 wait complete. 2024-03-18T00:25:49.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.452+0000 7fb6978dc640 1 Processor -- start 2024-03-18T00:25:49.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.452+0000 7fb6978dc640 1 -- start start 2024-03-18T00:25:49.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb6978dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb69006fab0 0x7fb69006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb6978dc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb69006f2b0 0x7fb6900d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb6978dc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6900b1750 con 0x7fb6900d1300 2024-03-18T00:25:49.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb6978dc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb6901629b0 con 0x7fb69006f2b0 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb6978dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb690162ee0 con 0x7fb69006fab0 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb695e79640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6900d1300 0x7fb6900cc530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34572/0 (socket says 172.21.15.81:34572) 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb695e79640 1 -- 172.21.15.81:0/3305236064 learned_addr learned my addr 172.21.15.81:0/3305236064 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb695678640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb69006fab0 0x7fb69006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.453+0000 7fb694e77640 1 --2- 172.21.15.81:0/3305236064 >> v2:172.21.15.136:3300/0 conn(0x7fb69006f2b0 0x7fb6900d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb687fff640 1 -- 172.21.15.81:0/3305236064 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 783386754 0 0) 0x7fb6900b1750 con 0x7fb6900d1300 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb687fff640 1 -- 172.21.15.81:0/3305236064 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb67c003520 con 0x7fb6900d1300 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb694e77640 1 -- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb69006fab0 msgr2=0x7fb69006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb694e77640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb69006fab0 0x7fb69006fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb694e77640 1 -- 172.21.15.81:0/3305236064 >> v1:172.21.15.81:6789/0 conn(0x7fb6900d1300 legacy=0x7fb6900cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb694e77640 1 -- 172.21.15.81:0/3305236064 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6900703d0 con 0x7fb69006f2b0 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.454+0000 7fb694e77640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006f2b0 0x7fb6900d0dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91056cd5b2451683 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb687fff640 1 -- 172.21.15.81:0/3305236064 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680035020 con 0x7fb69006f2b0 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb687fff640 1 -- 172.21.15.81:0/3305236064 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb680031830 con 0x7fb69006f2b0 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb687fff640 1 -- 172.21.15.81:0/3305236064 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb680031c00 con 0x7fb69006f2b0 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 -- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006f2b0 msgr2=0x7fb6900d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006f2b0 0x7fb6900d0dc0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb6800097a0 tx=0x7fb68002b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 -- 172.21.15.81:0/3305236064 shutdown_connections 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006f2b0 0x7fb6900d0dc0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3305236064 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb69006fab0 0x7fb69006fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 -- 172.21.15.81:0/3305236064 >> 172.21.15.81:0/3305236064 conn(0x7fb6900d1ee0 msgr2=0x7fb6900d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 -- 172.21.15.81:0/3305236064 shutdown_connections 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.455+0000 7fb6978dc640 1 -- 172.21.15.81:0/3305236064 wait complete. 2024-03-18T00:25:49.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.456+0000 7fb6978dc640 1 Processor -- start 2024-03-18T00:25:49.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 -- start start 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006fab0 0x7fb690156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb690156660 0x7fb690157fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6900d02e0 con 0x7fb69006f2b0 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb690161d70 con 0x7fb69006fab0 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb6978dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb6900d05c0 con 0x7fb690156660 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb695678640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb695678640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60900/0 (socket says 172.21.15.81:60900) 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb695678640 1 -- 172.21.15.81:0/3297958360 learned_addr learned my addr 172.21.15.81:0/3297958360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb695e79640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb690156660 0x7fb690157fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.457+0000 7fb694e77640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006fab0 0x7fb690156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 -- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb690156660 msgr2=0x7fb690157fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb690156660 0x7fb690157fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 -- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006fab0 msgr2=0x7fb690156120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006fab0 0x7fb690156120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 -- 172.21.15.81:0/3297958360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb690156b10 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb695678640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009db0 tx=0x7fb68c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c018020 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb68c014480 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb690156df0 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c014850 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.458+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6901573b0 con 0x7fb69006f2b0 2024-03-18T00:25:49.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.459+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69004f5b0 con 0x7fb69006f2b0 2024-03-18T00:25:49.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.460+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb68c005d10 con 0x7fb69006f2b0 2024-03-18T00:25:49.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.460+0000 7fb685ffb640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 0x7fb67406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.460+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb68c08b560 con 0x7fb69006f2b0 2024-03-18T00:25:49.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.460+0000 7fb694e77640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 0x7fb67406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.461+0000 7fb694e77640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 0x7fb67406e090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb680036000 tx=0x7fb68003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.465+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb68c022070 con 0x7fb69006f2b0 2024-03-18T00:25:49.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.641+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb690152190 con 0x7fb69006f2b0 2024-03-18T00:25:49.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.642+0000 7fb685ffb640 1 -- 172.21.15.81:0/3297958360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fb68c010040 con 0x7fb69006f2b0 2024-03-18T00:25:49.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:49.642 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 msgr2=0x7fb67406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 0x7fb67406e090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb680036000 tx=0x7fb68003c040 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 msgr2=0x7fb69006d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009db0 tx=0x7fb68c00c490 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 shutdown_connections 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb690156660 0x7fb690157fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb69006fab0 0x7fb690156120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb67406bbd0 0x7fb67406e090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 --2- 172.21.15.81:0/3297958360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb69006f2b0 0x7fb69006d550 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 >> 172.21.15.81:0/3297958360 conn(0x7fb6900d1ee0 msgr2=0x7fb6900b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 shutdown_connections 2024-03-18T00:25:49.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.644+0000 7fb6978dc640 1 -- 172.21.15.81:0/3297958360 wait complete. 2024-03-18T00:25:49.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:49.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:49.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.758+0000 7fb2ad4e8640 1 Processor -- start 2024-03-18T00:25:49.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.758+0000 7fb2ad4e8640 1 -- start start 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2ad4e8640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb2a80cc5b0 0x7fb2a806b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2ad4e8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a8071ee0 con 0x7fb2a80b0150 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2ad4e8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a80721c0 con 0x7fb2a806b1c0 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2ad4e8640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a8072af0 con 0x7fb2a80cc5b0 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2a6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2a80b0150 0x7fb2a80ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34582/0 (socket says 172.21.15.81:34582) 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.759+0000 7fb2a6ffd640 1 -- 172.21.15.81:0/3012240263 learned_addr learned my addr 172.21.15.81:0/3012240263 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a77fe640 1 --2- 172.21.15.81:0/3012240263 >> v2:172.21.15.136:3300/0 conn(0x7fb2a80cc5b0 0x7fb2a806b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1015439739 0 0) 0x7fb2a8071ee0 con 0x7fb2a80b0150 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb290003520 con 0x7fb2a80b0150 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2404908160 0 0) 0x7fb2a80721c0 con 0x7fb2a806b1c0 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8071ee0 con 0x7fb2a806b1c0 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 581020883 0 0) 0x7fb290003520 con 0x7fb2a80b0150 2024-03-18T00:25:49.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 >> v2:172.21.15.136:3300/0 conn(0x7fb2a80cc5b0 msgr2=0x7fb2a806b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 --2- 172.21.15.81:0/3012240263 >> v2:172.21.15.136:3300/0 conn(0x7fb2a80cc5b0 0x7fb2a806b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 >> v1:172.21.15.136:6789/0 conn(0x7fb2a806b1c0 legacy=0x7fb2a815da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a80724a0 con 0x7fb2a80b0150 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7fb2980019f0 con 0x7fb2a80b0150 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 >> v1:172.21.15.81:6789/0 conn(0x7fb2a80b0150 legacy=0x7fb2a80ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb290003b90 0x7fb290003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb290004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb290005210 0x7fb29000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb29000c110 con 0x7fb290004800 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb29000c2c0 con 0x7fb290005210 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb29000c4c0 con 0x7fb290003b90 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb290004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a77fe640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb290005210 0x7fb29000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a6ffd640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb290003b90 0x7fb290003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 -- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb290003b90 msgr2=0x7fb290003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb290003b90 0x7fb290003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 -- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb290005210 msgr2=0x7fb29000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb290005210 0x7fb29000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a77fe640 1 -- 172.21.15.81:0/3012240263 reap_dead start 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.760+0000 7fb2a67fc640 1 -- 172.21.15.81:0/3012240263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290003520 con 0x7fb290004800 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.761+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb290004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0018d0 tx=0x7fb290005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1619bb1990282d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.761+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c037070 con 0x7fb290004800 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.761+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c0052d0 con 0x7fb290004800 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.761+0000 7fb2a5ffb640 1 -- 172.21.15.81:0/3012240263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0014f0 con 0x7fb290004800 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 msgr2=0x7fb290004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb290004c80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb29c0018d0 tx=0x7fb290005830 comp rx=0 tx=0).stop 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/3012240263 shutdown_connections 2024-03-18T00:25:49.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/3012240263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb290004c80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/3012240263 >> 172.21.15.81:0/3012240263 conn(0x7fb2a80d0da0 msgr2=0x7fb2a80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/3012240263 shutdown_connections 2024-03-18T00:25:49.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.762+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/3012240263 wait complete. 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.763+0000 7fb2ad4e8640 1 Processor -- start 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.763+0000 7fb2ad4e8640 1 -- start start 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 0x7fb2a8156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2a8157080 0x7fb2a80b0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a80b0530 con 0x7fb290004800 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a80d0900 con 0x7fb2a8159340 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2ad4e8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a80b06b0 con 0x7fb2a8157080 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60922/0 (socket says 172.21.15.81:60922) 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 -- 172.21.15.81:0/167671562 learned_addr learned my addr 172.21.15.81:0/167671562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a77fe640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2a8157080 0x7fb2a80b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 0x7fb2a8156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 -- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2a8157080 msgr2=0x7fb2a80b0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2a8157080 0x7fb2a80b0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 -- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 msgr2=0x7fb2a8156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 0x7fb2a8156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 -- 172.21.15.81:0/167671562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a80c7670 con 0x7fb290004800 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 0x7fb2a8156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:49.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb2a6ffd640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb298000f80 tx=0x7fb298007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.764+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29800ab00 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.765+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb298018070 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.765+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2980133f0 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.765+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a8158580 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.765+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a8158b40 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.766+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a806b620 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.766+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb298013590 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.766+0000 7fb28f7fe640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 0x7fb29406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.767+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb29808b110 con 0x7fb290004800 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.767+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 0x7fb29406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:49.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.767+0000 7fb2a67fc640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 0x7fb29406e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb29c034000 tx=0x7fb29c031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:49.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.771+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb2a806b620 con 0x7fb290004800 2024-03-18T00:25:49.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.942+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2a804f540 con 0x7fb290004800 2024-03-18T00:25:49.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.942+0000 7fb28f7fe640 1 -- 172.21.15.81:0/167671562 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7fb298059c00 con 0x7fb290004800 2024-03-18T00:25:49.943 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 msgr2=0x7fb29406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 0x7fb29406e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb29c034000 tx=0x7fb29c031000 comp rx=0 tx=0).stop 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 msgr2=0x7fb2a80c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb298000f80 tx=0x7fb298007b90 comp rx=0 tx=0).stop 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 shutdown_connections 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2a8157080 0x7fb2a80b0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2a8159340 0x7fb2a8156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb29406bbd0 0x7fb29406e090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 --2- 172.21.15.81:0/167671562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb290004800 0x7fb2a80c6f70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:49.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 >> 172.21.15.81:0/167671562 conn(0x7fb2a80d0da0 msgr2=0x7fb2a80ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:49.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 shutdown_connections 2024-03-18T00:25:49.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:49.944+0000 7fb2ad4e8640 1 -- 172.21.15.81:0/167671562 wait complete. 2024-03-18T00:25:49.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.059+0000 7f0b0a0e8640 1 Processor -- start 2024-03-18T00:25:50.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b0a0e8640 1 -- start start 2024-03-18T00:25:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b0a0e8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 0x7f0b0406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b0a0e8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b04071ee0 con 0x7f0b040b0150 2024-03-18T00:25:50.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b0a0e8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b040721c0 con 0x7f0b0415da20 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b0a0e8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0b04072af0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b037fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b040b0150 0x7f0b040ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34596/0 (socket says 172.21.15.81:34596) 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.060+0000 7f0b037fe640 1 -- 172.21.15.81:0/3956330820 learned_addr learned my addr 172.21.15.81:0/3956330820 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0afaffd640 1 --2- 172.21.15.81:0/3956330820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 0x7f0b0406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450467817 0 0) 0x7f0b04071ee0 con 0x7f0b040b0150 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af0003520 con 0x7f0b040b0150 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077689252 0 0) 0x7f0b040721c0 con 0x7f0b0415da20 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0afaffd640 1 -- 172.21.15.81:0/3956330820 >> v1:172.21.15.136:6789/0 conn(0x7f0b0415da20 legacy=0x7f0b0415de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0afaffd640 1 -- 172.21.15.81:0/3956330820 >> v1:172.21.15.81:6789/0 conn(0x7f0b040b0150 legacy=0x7f0b040ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.061+0000 7f0afaffd640 1 -- 172.21.15.81:0/3956330820 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b040724a0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0afaffd640 1 --2- 172.21.15.81:0/3956330820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 0x7f0b0406b620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097d0 tx=0x7f0aec02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8777447b3087130d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec035020 con 0x7f0b0406b1c0 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aec031800 con 0x7f0b0406b1c0 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b02ffd640 1 -- 172.21.15.81:0/3956330820 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aec031bb0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3956330820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 msgr2=0x7f0b0406b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3956330820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 0x7f0b0406b620 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0aec0097d0 tx=0x7f0aec02b8a0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3956330820 shutdown_connections 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3956330820 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b0406b1c0 0x7f0b0406b620 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3956330820 >> 172.21.15.81:0/3956330820 conn(0x7f0b040d0da0 msgr2=0x7f0b040d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3956330820 shutdown_connections 2024-03-18T00:25:50.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.062+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3956330820 wait complete. 2024-03-18T00:25:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.063+0000 7f0b0a0e8640 1 Processor -- start 2024-03-18T00:25:50.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 -- start start 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b040b0150 0x7f0b040c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0415da20 0x7f0b040c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040cf080 con 0x7f0b0406b1c0 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040d0900 con 0x7f0b0415da20 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b0a0e8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040b0530 con 0x7f0b040b0150 2024-03-18T00:25:50.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60930/0 (socket says 172.21.15.81:60930) 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.064+0000 7f0b037fe640 1 -- 172.21.15.81:0/3531711806 learned_addr learned my addr 172.21.15.81:0/3531711806 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0afaffd640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b040b0150 0x7f0b040c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b03fff640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0415da20 0x7f0b040c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 -- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b040b0150 msgr2=0x7f0b040c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b040b0150 0x7f0b040c9400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 -- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0415da20 msgr2=0x7f0b040c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0415da20 0x7f0b040c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 -- 172.21.15.81:0/3531711806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b04156220 con 0x7f0b0406b1c0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b037fe640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c460 tx=0x7f0af400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4017070 con 0x7f0b0406b1c0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0af4005ce0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b04156500 con 0x7f0b0406b1c0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af4007290 con 0x7f0b0406b1c0 2024-03-18T00:25:50.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.065+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b04152bf0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.066+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b0406dae0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.066+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0af401a070 con 0x7f0b0406b1c0 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.067+0000 7f0b00ff9640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 0x7f0ae406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.067+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0af4089e20 con 0x7f0b0406b1c0 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.067+0000 7f0afaffd640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 0x7f0ae406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.067+0000 7f0afaffd640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 0x7f0ae406e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0aec036000 tx=0x7f0aec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.071+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0b0406dae0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.243+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0b0404f540 con 0x7f0b0406b1c0 2024-03-18T00:25:50.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.244+0000 7f0b00ff9640 1 -- 172.21.15.81:0/3531711806 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f0af40581b0 con 0x7f0b0406b1c0 2024-03-18T00:25:50.244 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:50.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 msgr2=0x7f0ae406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 0x7f0ae406e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0aec036000 tx=0x7f0aec008030 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 msgr2=0x7f0b040c8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f0af400c460 tx=0x7f0af400c920 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 shutdown_connections 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b0415da20 0x7f0b040c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b040b0150 0x7f0b040c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ae406bbd0 0x7f0ae406e090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 --2- 172.21.15.81:0/3531711806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b0406b1c0 0x7f0b040c8ec0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 >> 172.21.15.81:0/3531711806 conn(0x7f0b040d0da0 msgr2=0x7f0b040b10c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 shutdown_connections 2024-03-18T00:25:50.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.246+0000 7f0b0a0e8640 1 -- 172.21.15.81:0/3531711806 wait complete. 2024-03-18T00:25:50.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:50.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.361+0000 7f72661ba640 1 Processor -- start 2024-03-18T00:25:50.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.361+0000 7f72661ba640 1 -- start start 2024-03-18T00:25:50.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f72661ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726006b1c0 0x7f726006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f72661ba640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726015e3f0 0x7f72600702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f72661ba640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72600cd5f0 con 0x7f7260070820 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f72661ba640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f726006bae0 con 0x7f726015e3f0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f72661ba640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f72600cb740 con 0x7f726006b1c0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726015e3f0 0x7f72600702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f726015e3f0 0x7f72600702e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60946/0 (socket says 172.21.15.81:60946) 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 -- 172.21.15.81:0/3063582638 learned_addr learned my addr 172.21.15.81:0/3063582638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725f7fe640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726006b1c0 0x7f726006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 -- 172.21.15.81:0/3063582638 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726006b1c0 msgr2=0x7f726006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726006b1c0 0x7f726006b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 -- 172.21.15.81:0/3063582638 >> v1:172.21.15.136:6789/0 conn(0x7f7260070820 legacy=0x7f726006e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.362+0000 7f725effd640 1 -- 172.21.15.81:0/3063582638 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72600cba20 con 0x7f726015e3f0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.363+0000 7f725effd640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726015e3f0 0x7f72600702e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f725402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16de7b9675b5940 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.363+0000 7f725e7fc640 1 -- 172.21.15.81:0/3063582638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725402f840 con 0x7f726015e3f0 2024-03-18T00:25:50.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.363+0000 7f725e7fc640 1 -- 172.21.15.81:0/3063582638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f725402f9e0 con 0x7f726015e3f0 2024-03-18T00:25:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.363+0000 7f725e7fc640 1 -- 172.21.15.81:0/3063582638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f725402fdb0 con 0x7f726015e3f0 2024-03-18T00:25:50.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 -- 172.21.15.81:0/3063582638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726015e3f0 msgr2=0x7f72600702e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726015e3f0 0x7f72600702e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7254009870 tx=0x7f725402ba20 comp rx=0 tx=0).stop 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 -- 172.21.15.81:0/3063582638 shutdown_connections 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f726015e3f0 0x7f72600702e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 --2- 172.21.15.81:0/3063582638 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726006b1c0 0x7f726006b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 -- 172.21.15.81:0/3063582638 >> 172.21.15.81:0/3063582638 conn(0x7f72600b2b20 msgr2=0x7f72600b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 -- 172.21.15.81:0/3063582638 shutdown_connections 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.364+0000 7f72661ba640 1 -- 172.21.15.81:0/3063582638 wait complete. 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.365+0000 7f72661ba640 1 Processor -- start 2024-03-18T00:25:50.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.365+0000 7f72661ba640 1 -- start start 2024-03-18T00:25:50.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 0x7f72600b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 0x7f72601526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f726006e790 con 0x7f7260070820 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f72600cf8b0 con 0x7f726006b1c0 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f72661ba640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f72600cbd00 con 0x7f726015e3f0 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60956/0 (socket says 172.21.15.81:60956) 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 -- 172.21.15.81:0/2078469085 learned_addr learned my addr 172.21.15.81:0/2078469085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725ffff640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 0x7f72601526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 -- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 msgr2=0x7f72601526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725f7fe640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 0x7f72600b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 0x7f72601526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 -- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 msgr2=0x7f72600b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 0x7f72600b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 -- 172.21.15.81:0/2078469085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7260160d10 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725ffff640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 0x7f72601526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725f7fe640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 0x7f72600b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f725effd640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f725402ba60 tx=0x7f7254004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254047070 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7254037bc0 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.366+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7254042480 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.367+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72600c80c0 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.367+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72600c8680 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.368+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f726004f540 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.368+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f725404a070 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.368+0000 7f7247fff640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 0x7f724c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.368+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f72540acc80 con 0x7f7260070820 2024-03-18T00:25:50.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.368+0000 7f725f7fe640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 0x7f724c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.369+0000 7f725f7fe640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 0x7f724c06e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7250009ac0 tx=0x7f7250008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.373+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7254033030 con 0x7f7260070820 2024-03-18T00:25:50.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.544+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f72600c8850 con 0x7f7260070820 2024-03-18T00:25:50.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.544+0000 7f7247fff640 1 -- 172.21.15.81:0/2078469085 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f725407b770 con 0x7f7260070820 2024-03-18T00:25:50.545 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 msgr2=0x7f724c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 0x7f724c06e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7250009ac0 tx=0x7f7250008040 comp rx=0 tx=0).stop 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 msgr2=0x7f7260152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f725402ba60 tx=0x7f7254004730 comp rx=0 tx=0).stop 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 shutdown_connections 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f726015e3f0 0x7f72601526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f724c06bbd0 0x7f724c06e090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7260070820 0x7f7260152170 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 --2- 172.21.15.81:0/2078469085 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f726006b1c0 0x7f72600b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 >> 172.21.15.81:0/2078469085 conn(0x7f72600b2b20 msgr2=0x7f726006e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 shutdown_connections 2024-03-18T00:25:50.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.546+0000 7f72661ba640 1 -- 172.21.15.81:0/2078469085 wait complete. 2024-03-18T00:25:50.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:50.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.657+0000 7f04d9c27640 1 Processor -- start 2024-03-18T00:25:50.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.657+0000 7f04d9c27640 1 -- start start 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d9c27640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 0x7f04d40b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d9c27640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d40ae770 con 0x7f04d4071ed0 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d9c27640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04d40aea10 con 0x7f04d4072e20 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d9c27640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f04d40afbc0 con 0x7f04d415b060 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d3fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f04d4071ed0 0x7f04d406dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34606/0 (socket says 172.21.15.81:34606) 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d3fff640 1 -- 172.21.15.81:0/3399656786 learned_addr learned my addr 172.21.15.81:0/3399656786 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:50.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.658+0000 7f04d37fe640 1 --2- 172.21.15.81:0/3399656786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 0x7f04d40b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3629326825 0 0) 0x7f04d40ae770 con 0x7f04d4071ed0 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04bc003520 con 0x7f04d4071ed0 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128637693 0 0) 0x7f04d40aea10 con 0x7f04d4072e20 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04d40ae770 con 0x7f04d4072e20 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d37fe640 1 -- 172.21.15.81:0/3399656786 >> v1:172.21.15.136:6789/0 conn(0x7f04d4072e20 legacy=0x7f04d40af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d37fe640 1 -- 172.21.15.81:0/3399656786 >> v1:172.21.15.81:6789/0 conn(0x7f04d4071ed0 legacy=0x7f04d406dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.659+0000 7f04d37fe640 1 -- 172.21.15.81:0/3399656786 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d40b3e70 con 0x7f04d415b060 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d37fe640 1 --2- 172.21.15.81:0/3399656786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 0x7f04d40b4150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009dc0 tx=0x7f04c402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d311bd7e971beb0f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4039070 con 0x7f04d415b060 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c402cc40 con 0x7f04d415b060 2024-03-18T00:25:50.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d27fc640 1 -- 172.21.15.81:0/3399656786 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c4034440 con 0x7f04d415b060 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 -- 172.21.15.81:0/3399656786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 msgr2=0x7f04d40b4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 --2- 172.21.15.81:0/3399656786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 0x7f04d40b4150 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f04c4009dc0 tx=0x7f04c402be90 comp rx=0 tx=0).stop 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 -- 172.21.15.81:0/3399656786 shutdown_connections 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 --2- 172.21.15.81:0/3399656786 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d415b060 0x7f04d40b4150 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 -- 172.21.15.81:0/3399656786 >> 172.21.15.81:0/3399656786 conn(0x7f04d40b2a40 msgr2=0x7f04d40b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 -- 172.21.15.81:0/3399656786 shutdown_connections 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.660+0000 7f04d9c27640 1 -- 172.21.15.81:0/3399656786 wait complete. 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.661+0000 7f04d9c27640 1 Processor -- start 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 -- start start 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 0x7f04d413c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d4072e20 0x7f04d40cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40b5590 con 0x7f04d415b060 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f04d40af020 con 0x7f04d4072e20 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.662+0000 7f04d9c27640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f04d40b5710 con 0x7f04d4071ed0 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d37fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 0x7f04d413c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60972/0 (socket says 172.21.15.81:60972) 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 -- 172.21.15.81:0/1346151172 learned_addr learned my addr 172.21.15.81:0/1346151172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d2ffd640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d4072e20 0x7f04d40cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 -- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 msgr2=0x7f04d413c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 0x7f04d413c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 -- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d4072e20 msgr2=0x7f04d40cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d4072e20 0x7f04d40cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 -- 172.21.15.81:0/1346151172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d414e970 con 0x7f04d415b060 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d37fe640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 0x7f04d413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d3fff640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00c430 tx=0x7f04cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc017070 con 0x7f04d415b060 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc005d00 con 0x7f04d415b060 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d414ec10 con 0x7f04d415b060 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04cc007310 con 0x7f04d415b060 2024-03-18T00:25:50.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.663+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d413cb90 con 0x7f04d415b060 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.664+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04d404f5b0 con 0x7f04d415b060 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.665+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f04cc01a070 con 0x7f04d415b060 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.665+0000 7f04bbfff640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 0x7f04c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.665+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f04cc089dd0 con 0x7f04d415b060 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.665+0000 7f04d37fe640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 0x7f04c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.665+0000 7f04d37fe640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 0x7f04c006e090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04c4036000 tx=0x7f04c4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.669+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f04cc058300 con 0x7f04d415b060 2024-03-18T00:25:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.845+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04d4072c00 con 0x7f04d415b060 2024-03-18T00:25:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.846+0000 7f04bbfff640 1 -- 172.21.15.81:0/1346151172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f04cc08b090 con 0x7f04d415b060 2024-03-18T00:25:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:50.846 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 msgr2=0x7f04c006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 0x7f04c006e090 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f04c4036000 tx=0x7f04c4030000 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 msgr2=0x7f04d406b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00c430 tx=0x7f04cc00c8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 shutdown_connections 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f04c006bbd0 0x7f04c006e090 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04d415b060 0x7f04d406b1c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f04d4072e20 0x7f04d40cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 --2- 172.21.15.81:0/1346151172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f04d4071ed0 0x7f04d413c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 >> 172.21.15.81:0/1346151172 conn(0x7f04d40b2a40 msgr2=0x7f04d40b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 shutdown_connections 2024-03-18T00:25:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.848+0000 7f04d9c27640 1 -- 172.21.15.81:0/1346151172 wait complete. 2024-03-18T00:25:50.859 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:50.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:50.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.961+0000 7f08b533b640 1 Processor -- start 2024-03-18T00:25:50.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.961+0000 7f08b533b640 1 -- start start 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08b533b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 0x7f08b00d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08b533b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08b00d0a80 0x7f08b00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08b533b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08b00cf2c0 con 0x7f08b00ceee0 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08b533b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f08b0161c70 con 0x7f08b00d0a80 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08b533b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00d1590 con 0x7f08b006d1d0 2024-03-18T00:25:50.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08af7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08b00d0a80 0x7f08b00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08af7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f08b00d0a80 0x7f08b00cd090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60984/0 (socket says 172.21.15.81:60984) 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08ae7fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 0x7f08b00d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.962+0000 7f08af7fe640 1 -- 172.21.15.81:0/3229132339 learned_addr learned my addr 172.21.15.81:0/3229132339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08af7fe640 1 -- 172.21.15.81:0/3229132339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 msgr2=0x7f08b00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08adffb640 1 -- 172.21.15.81:0/3229132339 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 870394825 0 0) 0x7f08b00cf2c0 con 0x7f08b00ceee0 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08af7fe640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 0x7f08b00d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08af7fe640 1 -- 172.21.15.81:0/3229132339 >> v1:172.21.15.136:6789/0 conn(0x7f08b00ceee0 legacy=0x7f08b006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08af7fe640 1 -- 172.21.15.81:0/3229132339 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00d12b0 con 0x7f08b00d0a80 2024-03-18T00:25:50.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08ae7fc640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 0x7f08b00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:50.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08af7fe640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b00d0a80 0x7f08b00cd090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009870 tx=0x7f08a002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67540d9ce144b6f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08adffb640 1 -- 172.21.15.81:0/3229132339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a0035020 con 0x7f08b00d0a80 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08adffb640 1 -- 172.21.15.81:0/3229132339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a0031640 con 0x7f08b00d0a80 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.963+0000 7f08adffb640 1 -- 172.21.15.81:0/3229132339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a002d040 con 0x7f08b00d0a80 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 -- 172.21.15.81:0/3229132339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b00d0a80 msgr2=0x7f08b00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b00d0a80 0x7f08b00cd090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f08a0009870 tx=0x7f08a002b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 -- 172.21.15.81:0/3229132339 shutdown_connections 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b00d0a80 0x7f08b00cd090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 --2- 172.21.15.81:0/3229132339 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b006d1d0 0x7f08b00d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 -- 172.21.15.81:0/3229132339 >> 172.21.15.81:0/3229132339 conn(0x7f08b009b160 msgr2=0x7f08b00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 -- 172.21.15.81:0/3229132339 shutdown_connections 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.964+0000 7f08b533b640 1 -- 172.21.15.81:0/3229132339 wait complete. 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.965+0000 7f08b533b640 1 Processor -- start 2024-03-18T00:25:50.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.965+0000 7f08b533b640 1 -- start start 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b00ceee0 0x7f08b00b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08b00d0a80 0x7f08b00b7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00cc890 con 0x7f08b006d1d0 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f08b00ccc00 con 0x7f08b00d0a80 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08b533b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f08b00d0f10 con 0x7f08b00ceee0 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08aeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60990/0 (socket says 172.21.15.81:60990) 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08aeffd640 1 -- 172.21.15.81:0/1904526643 learned_addr learned my addr 172.21.15.81:0/1904526643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08ae7fc640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b00ceee0 0x7f08b00b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.966+0000 7f08af7fe640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08b00d0a80 0x7f08b00b7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 -- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b00ceee0 msgr2=0x7f08b00b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b00ceee0 0x7f08b00b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 -- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08b00d0a80 msgr2=0x7f08b00b7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08b00d0a80 0x7f08b00b7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 -- 172.21.15.81:0/1904526643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b00b2370 con 0x7f08b006d1d0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08aeffd640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c4e0 tx=0x7f08a800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a8017070 con 0x7f08b006d1d0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a80035f0 con 0x7f08b006d1d0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b00b2650 con 0x7f08b006d1d0 2024-03-18T00:25:50.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a80039e0 con 0x7f08b006d1d0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.967+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b015df90 con 0x7f08b006d1d0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.968+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b004f540 con 0x7f08b006d1d0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.968+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f08a801a070 con 0x7f08b006d1d0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.969+0000 7f08a77fe640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 0x7f089006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.969+0000 7f08ae7fc640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 0x7f089006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.969+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f08a8089d90 con 0x7f08b006d1d0 2024-03-18T00:25:50.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.969+0000 7f08ae7fc640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 0x7f089006e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0898009bd0 tx=0x7f089800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:50.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:50.973+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f08a8058230 con 0x7f08b006d1d0 2024-03-18T00:25:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.144+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08b00cf4b0 con 0x7f08b006d1d0 2024-03-18T00:25:51.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.144+0000 7f08a77fe640 1 -- 172.21.15.81:0/1904526643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f08a805c2d0 con 0x7f08b006d1d0 2024-03-18T00:25:51.145 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 msgr2=0x7f089006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 0x7f089006e090 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0898009bd0 tx=0x7f089800b040 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 msgr2=0x7f08b0153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f08a800c4e0 tx=0x7f08a800c9a0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 shutdown_connections 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f08b00d0a80 0x7f08b00b7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f08b00ceee0 0x7f08b00b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f089006bbd0 0x7f089006e090 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 --2- 172.21.15.81:0/1904526643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08b006d1d0 0x7f08b0153670 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 >> 172.21.15.81:0/1904526643 conn(0x7f08b009b160 msgr2=0x7f08b00c91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 shutdown_connections 2024-03-18T00:25:51.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.146+0000 7f08b533b640 1 -- 172.21.15.81:0/1904526643 wait complete. 2024-03-18T00:25:51.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:51.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.260+0000 7ff7f6d87640 1 Processor -- start 2024-03-18T00:25:51.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.260+0000 7ff7f6d87640 1 -- start start 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f6d87640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f00ceae0 0x7ff7f00d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f6d87640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f015fa40 0x7ff7f00c5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f6d87640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7f00b31d0 con 0x7ff7f00cf480 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f6d87640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff7f00cd560 con 0x7ff7f00ceae0 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f6d87640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00cd840 con 0x7ff7f015fa40 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f00ceae0 0x7ff7f00d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff7f00ceae0 0x7ff7f00d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32772/0 (socket says 172.21.15.81:32772) 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 -- 172.21.15.81:0/2816332632 learned_addr learned my addr 172.21.15.81:0/2816332632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:51.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f5324640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f015fa40 0x7ff7f00c5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 -- 172.21.15.81:0/2816332632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f015fa40 msgr2=0x7ff7f00c5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f015fa40 0x7ff7f00c5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 -- 172.21.15.81:0/2816332632 >> v1:172.21.15.136:6789/0 conn(0x7ff7f00cf480 legacy=0x7ff7f015f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.261+0000 7ff7f4b23640 1 -- 172.21.15.81:0/2816332632 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00b2e60 con 0x7ff7f00ceae0 2024-03-18T00:25:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.262+0000 7ff7f4b23640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f00ceae0 0x7ff7f00d29c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009870 tx=0x7ff7e002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af57ec54ad5c4ef9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.262+0000 7ff7ef7fe640 1 -- 172.21.15.81:0/2816332632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e0035020 con 0x7ff7f00ceae0 2024-03-18T00:25:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.262+0000 7ff7ef7fe640 1 -- 172.21.15.81:0/2816332632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e0031640 con 0x7ff7f00ceae0 2024-03-18T00:25:51.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.262+0000 7ff7ef7fe640 1 -- 172.21.15.81:0/2816332632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e002d040 con 0x7ff7f00ceae0 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2816332632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f00ceae0 msgr2=0x7ff7f00d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f00ceae0 0x7ff7f00d29c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0009870 tx=0x7ff7e002b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2816332632 shutdown_connections 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f015fa40 0x7ff7f00c5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2816332632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f00ceae0 0x7ff7f00d29c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2816332632 >> 172.21.15.81:0/2816332632 conn(0x7ff7f00d1ea0 msgr2=0x7ff7f00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2816332632 shutdown_connections 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.263+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2816332632 wait complete. 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.264+0000 7ff7f6d87640 1 Processor -- start 2024-03-18T00:25:51.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.264+0000 7ff7f6d87640 1 -- start start 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f00ceae0 0x7ff7f00c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 0x7ff7f0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00cf040 con 0x7ff7f015fa40 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff7f00ceec0 con 0x7ff7f00cf480 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff7f00cf1c0 con 0x7ff7f00ceae0 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32780/0 (socket says 172.21.15.81:32780) 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 -- 172.21.15.81:0/2790730823 learned_addr learned my addr 172.21.15.81:0/2790730823 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f4b23640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f00ceae0 0x7ff7f00c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7effff640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 0x7ff7f0153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 -- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f00ceae0 msgr2=0x7ff7f00c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f00ceae0 0x7ff7f00c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 -- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 msgr2=0x7ff7f0153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 0x7ff7f0153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 -- 172.21.15.81:0/2790730823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7f00b7230 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7effff640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 0x7ff7f0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f5324640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800efc0 tx=0x7ff7e800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8018020 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7e8014480 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8009e60 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7f006c830 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.265+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7f006cdf0 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.266+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f006cff0 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.267+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff7e8005d10 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.267+0000 7ff7ed7fa640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 0x7ff7dc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.267+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff7e808b750 con 0x7ff7f015fa40 2024-03-18T00:25:51.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.267+0000 7ff7f4b23640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 0x7ff7dc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.268+0000 7ff7f4b23640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 0x7ff7dc06e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0036000 tx=0x7ff7e003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.271+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff7f006cff0 con 0x7ff7f015fa40 2024-03-18T00:25:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.462+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff7f006c640 con 0x7ff7f015fa40 2024-03-18T00:25:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.462+0000 7ff7ed7fa640 1 -- 172.21.15.81:0/2790730823 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7ff7e8022030 con 0x7ff7f015fa40 2024-03-18T00:25:51.463 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 msgr2=0x7ff7dc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 0x7ff7dc06e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff7e0036000 tx=0x7ff7e003c040 comp rx=0 tx=0).stop 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 msgr2=0x7ff7f0154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7e800efc0 tx=0x7ff7e800c490 comp rx=0 tx=0).stop 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 shutdown_connections 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff7dc06bbd0 0x7ff7dc06e090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7f015fa40 0x7ff7f0154500 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff7f00cf480 0x7ff7f0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 --2- 172.21.15.81:0/2790730823 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff7f00ceae0 0x7ff7f00c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 >> 172.21.15.81:0/2790730823 conn(0x7ff7f00d1ea0 msgr2=0x7ff7f00d2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 shutdown_connections 2024-03-18T00:25:51.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.464+0000 7ff7f6d87640 1 -- 172.21.15.81:0/2790730823 wait complete. 2024-03-18T00:25:51.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.579+0000 7f55a7436640 1 Processor -- start 2024-03-18T00:25:51.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.579+0000 7f55a7436640 1 -- start start 2024-03-18T00:25:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a7436640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f55a006c490 0x7f55a00d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a7436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 0x7f55a00d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a7436640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a00ce2d0 con 0x7f55a00cdef0 2024-03-18T00:25:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a7436640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f55a006c970 con 0x7f55a006c490 2024-03-18T00:25:51.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a7436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f55a006cc50 con 0x7f55a00b1ea0 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a51d2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f55a00cdef0 0x7f55a00b1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34608/0 (socket says 172.21.15.81:34608) 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a51d2640 1 -- 172.21.15.81:0/1647468718 learned_addr learned my addr 172.21.15.81:0/1647468718 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a59d3640 1 --2- 172.21.15.81:0/1647468718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 0x7f55a00d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.580+0000 7f55a49d1640 1 --2- 172.21.15.81:0/1647468718 >> v2:172.21.15.136:3300/0 conn(0x7f55a006c490 0x7f55a00d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f5597fff640 1 -- 172.21.15.81:0/1647468718 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632827332 0 0) 0x7f55a00ce2d0 con 0x7f55a00cdef0 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f5597fff640 1 -- 172.21.15.81:0/1647468718 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f558c003520 con 0x7f55a00cdef0 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f55a59d3640 1 -- 172.21.15.81:0/1647468718 >> v2:172.21.15.136:3300/0 conn(0x7f55a006c490 msgr2=0x7f55a00d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f55a59d3640 1 --2- 172.21.15.81:0/1647468718 >> v2:172.21.15.136:3300/0 conn(0x7f55a006c490 0x7f55a00d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f55a59d3640 1 -- 172.21.15.81:0/1647468718 >> v1:172.21.15.81:6789/0 conn(0x7f55a00cdef0 legacy=0x7f55a00b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f55a59d3640 1 -- 172.21.15.81:0/1647468718 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a006cf30 con 0x7f55a00b1ea0 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.581+0000 7f55a59d3640 1 --2- 172.21.15.81:0/1647468718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 0x7f55a00d0380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=450a2afea8f1f67b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f5597fff640 1 -- 172.21.15.81:0/1647468718 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598035020 con 0x7f55a00b1ea0 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f5597fff640 1 -- 172.21.15.81:0/1647468718 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5598031830 con 0x7f55a00b1ea0 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f5597fff640 1 -- 172.21.15.81:0/1647468718 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5598031c00 con 0x7f55a00b1ea0 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 -- 172.21.15.81:0/1647468718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 msgr2=0x7f55a00d0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 --2- 172.21.15.81:0/1647468718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 0x7f55a00d0380 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f55980097a0 tx=0x7f559802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 -- 172.21.15.81:0/1647468718 shutdown_connections 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 --2- 172.21.15.81:0/1647468718 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00b1ea0 0x7f55a00d0380 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 --2- 172.21.15.81:0/1647468718 >> v2:172.21.15.136:3300/0 conn(0x7f55a006c490 0x7f55a00d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 -- 172.21.15.81:0/1647468718 >> 172.21.15.81:0/1647468718 conn(0x7f55a00d1ea0 msgr2=0x7f55a00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 -- 172.21.15.81:0/1647468718 shutdown_connections 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.582+0000 7f55a7436640 1 -- 172.21.15.81:0/1647468718 wait complete. 2024-03-18T00:25:51.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.583+0000 7f55a7436640 1 Processor -- start 2024-03-18T00:25:51.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.583+0000 7f55a7436640 1 -- start start 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55a00b1ea0 0x7f55a00aff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00cdef0 0x7f55a01f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f55a00b31f0 con 0x7f55a006c490 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f55a006d4f0 con 0x7f55a00b1ea0 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a7436640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f55a00cc4f0 con 0x7f55a00cdef0 2024-03-18T00:25:51.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a51d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a51d2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32786/0 (socket says 172.21.15.81:32786) 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a51d2640 1 -- 172.21.15.81:0/2488868688 learned_addr learned my addr 172.21.15.81:0/2488868688 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a59d3640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00cdef0 0x7f55a01f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.584+0000 7f55a49d1640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55a00b1ea0 0x7f55a00aff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 -- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00cdef0 msgr2=0x7f55a01f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00cdef0 0x7f55a01f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 -- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55a00b1ea0 msgr2=0x7f55a00aff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55a00b1ea0 0x7f55a00aff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 -- 172.21.15.81:0/2488868688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a01f48b0 con 0x7f55a006c490 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a51d2640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cb40 tx=0x7f559c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c017070 con 0x7f55a006c490 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c00aca0 con 0x7f55a006c490 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c012620 con 0x7f55a006c490 2024-03-18T00:25:51.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a01f4b90 con 0x7f55a006c490 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.585+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a01f7910 con 0x7f55a006c490 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.586+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55a01f7440 con 0x7f55a006c490 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.586+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f559c01a070 con 0x7f55a006c490 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.587+0000 7f5595ffb640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 0x7f558406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.587+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f559c08a870 con 0x7f55a006c490 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.587+0000 7f55a49d1640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 0x7f558406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.587+0000 7f55a49d1640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 0x7f558406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55a006b6d0 tx=0x7f5590009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.591+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f559c058d10 con 0x7f55a006c490 2024-03-18T00:25:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.766+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f55a004f540 con 0x7f55a006c490 2024-03-18T00:25:51.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.766+0000 7f5595ffb640 1 -- 172.21.15.81:0/2488868688 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f559c05cdb0 con 0x7f55a006c490 2024-03-18T00:25:51.767 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 msgr2=0x7f558406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 0x7f558406e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f55a006b6d0 tx=0x7f5590009190 comp rx=0 tx=0).stop 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 msgr2=0x7f55a01f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f559c00cb40 tx=0x7f559c00a060 comp rx=0 tx=0).stop 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 shutdown_connections 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f55a00cdef0 0x7f55a01f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f55a00b1ea0 0x7f55a00aff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f558406bbd0 0x7f558406e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 --2- 172.21.15.81:0/2488868688 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55a006c490 0x7f55a01f7e30 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 >> 172.21.15.81:0/2488868688 conn(0x7f55a00d1ea0 msgr2=0x7f55a006f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 shutdown_connections 2024-03-18T00:25:51.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.768+0000 7f55a7436640 1 -- 172.21.15.81:0/2488868688 wait complete. 2024-03-18T00:25:51.810 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T00:25:51.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.910+0000 7f48d6edc640 1 Processor -- start 2024-03-18T00:25:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.910+0000 7f48d6edc640 1 -- start start 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d6edc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 0x7f48d00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d6edc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 0x7f48d015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d6edc640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48d00b3440 con 0x7f48d0162690 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d6edc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f48d00d16c0 con 0x7f48d01622b0 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d6edc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00d2660 con 0x7f48d015ea90 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48cffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f48d0162690 0x7f48d0162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34622/0 (socket says 172.21.15.81:34622) 2024-03-18T00:25:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48cffff640 1 -- 172.21.15.81:0/706977801 learned_addr learned my addr 172.21.15.81:0/706977801 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d5479640 1 --2- 172.21.15.81:0/706977801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 0x7f48d015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.911+0000 7f48d4c78640 1 --2- 172.21.15.81:0/706977801 >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 0x7f48d00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645227984 0 0) 0x7f48d00b3440 con 0x7f48d0162690 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48bc003520 con 0x7f48d0162690 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48d5479640 1 -- 172.21.15.81:0/706977801 >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 msgr2=0x7f48d00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48d5479640 1 --2- 172.21.15.81:0/706977801 >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 0x7f48d00d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 242409499 0 0) 0x7f48bc003520 con 0x7f48d0162690 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48d5479640 1 -- 172.21.15.81:0/706977801 >> v1:172.21.15.81:6789/0 conn(0x7f48d0162690 legacy=0x7f48d0162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48d5479640 1 -- 172.21.15.81:0/706977801 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00d20a0 con 0x7f48d015ea90 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.912+0000 7f48d4c78640 1 --2- 172.21.15.81:0/706977801 >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 0x7f48d00d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d5479640 1 --2- 172.21.15.81:0/706977801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 0x7f48d015ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48c00097d0 tx=0x7f48c002b650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=183a3d14ce1909e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c0037070 con 0x7f48d015ea90 2024-03-18T00:25:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48c002be50 con 0x7f48d015ea90 2024-03-18T00:25:51.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48cf7fe640 1 -- 172.21.15.81:0/706977801 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8001670 con 0x7f48d015ea90 2024-03-18T00:25:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 -- 172.21.15.81:0/706977801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 msgr2=0x7f48d015ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 --2- 172.21.15.81:0/706977801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 0x7f48d015ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f48c00097d0 tx=0x7f48c002b650 comp rx=0 tx=0).stop 2024-03-18T00:25:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 -- 172.21.15.81:0/706977801 shutdown_connections 2024-03-18T00:25:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 --2- 172.21.15.81:0/706977801 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d015ea90 0x7f48d015ef20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 --2- 172.21.15.81:0/706977801 >> v2:172.21.15.136:3300/0 conn(0x7f48d01622b0 0x7f48d00d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 -- 172.21.15.81:0/706977801 >> 172.21.15.81:0/706977801 conn(0x7f48d00d4070 msgr2=0x7f48d00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 -- 172.21.15.81:0/706977801 shutdown_connections 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.913+0000 7f48d6edc640 1 -- 172.21.15.81:0/706977801 wait complete. 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.914+0000 7f48d6edc640 1 Processor -- start 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 -- start start 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d015ea90 0x7f48d00cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d0162690 0x7f48d01f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00cfc90 con 0x7f48d01622b0 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f48d00d2ab0 con 0x7f48d015ea90 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48d6edc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f48d00cfe10 con 0x7f48d0162690 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.915+0000 7f48cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32800/0 (socket says 172.21.15.81:32800) 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 -- 172.21.15.81:0/1140027295 learned_addr learned my addr 172.21.15.81:0/1140027295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48d4c78640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d015ea90 0x7f48d00cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48d5479640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d0162690 0x7f48d01f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 -- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d0162690 msgr2=0x7f48d01f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d0162690 0x7f48d01f46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 -- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d015ea90 msgr2=0x7f48d00cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d015ea90 0x7f48d00cdcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 -- 172.21.15.81:0/1140027295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d00ccf40 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cffff640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c750 tx=0x7f48b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b8005ad0 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48b8005c90 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48b80072b0 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d01f8970 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.916+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d00cd4c0 con 0x7f48d01622b0 2024-03-18T00:25:51.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.917+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d004f5b0 con 0x7f48d01622b0 2024-03-18T00:25:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.918+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f48b8007450 con 0x7f48d01622b0 2024-03-18T00:25:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.918+0000 7f48cd7fa640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 0x7f48b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.918+0000 7f48d4c78640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 0x7f48b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:51.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.918+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f48b808a7f0 con 0x7f48d01622b0 2024-03-18T00:25:51.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.919+0000 7f48d4c78640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 0x7f48b006e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009bd0 tx=0x7f48c800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:51.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:51.923+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f48b8059370 con 0x7f48d01622b0 2024-03-18T00:25:52.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.097+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48d00d18d0 con 0x7f48d01622b0 2024-03-18T00:25:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.098+0000 7f48cd7fa640 1 -- 172.21.15.81:0/1140027295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f48b8058c70 con 0x7f48d01622b0 2024-03-18T00:25:52.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:52.099 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 msgr2=0x7f48b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 0x7f48b006e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009bd0 tx=0x7f48c800b040 comp rx=0 tx=0).stop 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 msgr2=0x7f48d00c9bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f48b800c750 tx=0x7f48b800cc10 comp rx=0 tx=0).stop 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 shutdown_connections 2024-03-18T00:25:52.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f48d0162690 0x7f48d01f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f48b006bbd0 0x7f48b006e090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48d01622b0 0x7f48d00c9bf0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 --2- 172.21.15.81:0/1140027295 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f48d015ea90 0x7f48d00cdcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 >> 172.21.15.81:0/1140027295 conn(0x7f48d00d4070 msgr2=0x7f48d015ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 shutdown_connections 2024-03-18T00:25:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.100+0000 7f48d6edc640 1 -- 172.21.15.81:0/1140027295 wait complete. 2024-03-18T00:25:52.112 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:52.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.216+0000 7feee6a97640 1 Processor -- start 2024-03-18T00:25:52.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.216+0000 7feee6a97640 1 -- start start 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee6a97640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feee00cdef0 0x7feee00d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee6a97640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee00ce2d0 con 0x7feee00b1ea0 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee6a97640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee006c970 con 0x7feee006c490 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee6a97640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7feee006cc50 con 0x7feee00cdef0 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee4833640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feee00cdef0 0x7feee00d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee5034640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feee00b1ea0 0x7feee00d0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34636/0 (socket says 172.21.15.81:34636) 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee5034640 1 -- 172.21.15.81:0/643920438 learned_addr learned my addr 172.21.15.81:0/643920438 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee4833640 1 -- 172.21.15.81:0/643920438 >> v1:172.21.15.136:6789/0 conn(0x7feee006c490 legacy=0x7feee00b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee4833640 1 -- 172.21.15.81:0/643920438 >> v1:172.21.15.81:6789/0 conn(0x7feee00b1ea0 legacy=0x7feee00d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feedf7fe640 1 -- 172.21.15.81:0/643920438 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076160099 0 0) 0x7feee00ce2d0 con 0x7feee00b1ea0 2024-03-18T00:25:52.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.217+0000 7feee4833640 1 -- 172.21.15.81:0/643920438 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee006cf30 con 0x7feee00cdef0 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee4833640 1 --2- 172.21.15.81:0/643920438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee00cdef0 0x7feee00d29c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed4009720 tx=0x7feed402b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d1eccf3adcfa84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feedf7fe640 1 -- 172.21.15.81:0/643920438 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4037070 con 0x7feee00cdef0 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feedf7fe640 1 -- 172.21.15.81:0/643920438 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4030710 con 0x7feee00cdef0 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feedf7fe640 1 -- 172.21.15.81:0/643920438 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4030ae0 con 0x7feee00cdef0 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 -- 172.21.15.81:0/643920438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee00cdef0 msgr2=0x7feee00d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 --2- 172.21.15.81:0/643920438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee00cdef0 0x7feee00d29c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7feed4009720 tx=0x7feed402b730 comp rx=0 tx=0).stop 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 -- 172.21.15.81:0/643920438 shutdown_connections 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 --2- 172.21.15.81:0/643920438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee00cdef0 0x7feee00d29c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 -- 172.21.15.81:0/643920438 >> 172.21.15.81:0/643920438 conn(0x7feee00d1ea0 msgr2=0x7feee00d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 -- 172.21.15.81:0/643920438 shutdown_connections 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.218+0000 7feee6a97640 1 -- 172.21.15.81:0/643920438 wait complete. 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 Processor -- start 2024-03-18T00:25:52.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 -- start start 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee00b1ea0 0x7feee01f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feee00cdef0 0x7feee00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feee00b31f0 con 0x7feee006c490 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feee006d4f0 con 0x7feee00b1ea0 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.220+0000 7feee6a97640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feee00cc4f0 con 0x7feee00cdef0 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32818/0 (socket says 172.21.15.81:32818) 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 -- 172.21.15.81:0/1575650990 learned_addr learned my addr 172.21.15.81:0/1575650990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:52.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feedffff640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee00b1ea0 0x7feee01f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee5034640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feee00cdef0 0x7feee00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 -- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feee00cdef0 msgr2=0x7feee00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feee00cdef0 0x7feee00b6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 -- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee00b1ea0 msgr2=0x7feee01f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee00b1ea0 0x7feee01f4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 -- 172.21.15.81:0/1575650990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee0070c50 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee4833640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feed4035040 tx=0x7feed40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4037040 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feed4004030 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee00c9e40 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feed4004420 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.221+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee00ca400 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.222+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee004f540 con 0x7feee006c490 2024-03-18T00:25:52.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.223+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feed4032940 con 0x7feee006c490 2024-03-18T00:25:52.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.223+0000 7feedd7fa640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 0x7feec406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.223+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7feed40ac760 con 0x7feee006c490 2024-03-18T00:25:52.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.223+0000 7feedffff640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 0x7feec406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.223+0000 7feedffff640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 0x7feec406e0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feecc000f60 tx=0x7feecc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.227+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7feed4042020 con 0x7feee006c490 2024-03-18T00:25:52.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.399+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7feee00b49f0 con 0x7feee006c490 2024-03-18T00:25:52.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.400+0000 7feedd7fa640 1 -- 172.21.15.81:0/1575650990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7feed407ac00 con 0x7feee006c490 2024-03-18T00:25:52.401 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 msgr2=0x7feec406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 0x7feec406e0c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7feecc000f60 tx=0x7feecc009040 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 msgr2=0x7feee015e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7feed4035040 tx=0x7feed40046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 shutdown_connections 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feee00cdef0 0x7feee00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feee00b1ea0 0x7feee01f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feec406bc00 0x7feec406e0c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 --2- 172.21.15.81:0/1575650990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feee006c490 0x7feee015e620 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 >> 172.21.15.81:0/1575650990 conn(0x7feee00d1ea0 msgr2=0x7feee00b0b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 shutdown_connections 2024-03-18T00:25:52.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.402+0000 7feee6a97640 1 -- 172.21.15.81:0/1575650990 wait complete. 2024-03-18T00:25:52.413 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.516+0000 7f2276285640 1 Processor -- start 2024-03-18T00:25:52.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.516+0000 7f2276285640 1 -- start start 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f22701589a0 0x7f227015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22700c4a90 0x7f227006e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f227006eca0 0x7f227015e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f22700c4ea0 con 0x7f22700c4a90 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2270158d80 con 0x7f22701589a0 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2276285640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f227006d3c0 con 0x7f227006eca0 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22700c4a90 0x7f227006e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f22700c4a90 0x7f227006e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32834/0 (socket says 172.21.15.81:32834) 2024-03-18T00:25:52.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 -- 172.21.15.81:0/3915521477 learned_addr learned my addr 172.21.15.81:0/3915521477 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226ffff640 1 --2- 172.21.15.81:0/3915521477 >> v2:172.21.15.136:3300/0 conn(0x7f22701589a0 0x7f227015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f2274822640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f227006eca0 0x7f227015e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 -- 172.21.15.81:0/3915521477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f227006eca0 msgr2=0x7f227015e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f227006eca0 0x7f227015e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 -- 172.21.15.81:0/3915521477 >> v2:172.21.15.136:3300/0 conn(0x7f22701589a0 msgr2=0x7f227015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 --2- 172.21.15.81:0/3915521477 >> v2:172.21.15.136:3300/0 conn(0x7f22701589a0 0x7f227015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.517+0000 7f226f7fe640 1 -- 172.21.15.81:0/3915521477 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22700c50c0 con 0x7f22700c4a90 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f226f7fe640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f227006e760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22700b5de0 tx=0x7f226402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb34e0020bf2eca server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f226effd640 1 -- 172.21.15.81:0/3915521477 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264035020 con 0x7f22700c4a90 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f226effd640 1 -- 172.21.15.81:0/3915521477 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2264031870 con 0x7f22700c4a90 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f226effd640 1 -- 172.21.15.81:0/3915521477 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264031c40 con 0x7f22700c4a90 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 -- 172.21.15.81:0/3915521477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 msgr2=0x7f227006e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f227006e760 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f22700b5de0 tx=0x7f226402b910 comp rx=0 tx=0).stop 2024-03-18T00:25:52.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 -- 172.21.15.81:0/3915521477 shutdown_connections 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f227006eca0 0x7f227015e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 --2- 172.21.15.81:0/3915521477 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f227006e760 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 --2- 172.21.15.81:0/3915521477 >> v2:172.21.15.136:3300/0 conn(0x7f22701589a0 0x7f227015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.518+0000 7f2276285640 1 -- 172.21.15.81:0/3915521477 >> 172.21.15.81:0/3915521477 conn(0x7f22700cfbf0 msgr2=0x7f22700cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.519+0000 7f2276285640 1 -- 172.21.15.81:0/3915521477 shutdown_connections 2024-03-18T00:25:52.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.519+0000 7f2276285640 1 -- 172.21.15.81:0/3915521477 wait complete. 2024-03-18T00:25:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.520+0000 7f2276285640 1 Processor -- start 2024-03-18T00:25:52.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.520+0000 7f2276285640 1 -- start start 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.520+0000 7f2276285640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 0x7f22700c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22701589a0 0x7f22700b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22700c5960 con 0x7f22700c4a90 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f22700c5680 con 0x7f227006eca0 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f22700c5c40 con 0x7f22701589a0 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226ffff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 0x7f22700c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32840/0 (socket says 172.21.15.81:32840) 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 -- 172.21.15.81:0/1288352382 learned_addr learned my addr 172.21.15.81:0/1288352382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2274822640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22701589a0 0x7f22700b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 -- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22701589a0 msgr2=0x7f22700b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22701589a0 0x7f22700b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 -- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 msgr2=0x7f22700c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 0x7f22700c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 -- 172.21.15.81:0/1288352382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22700c8fd0 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226ffff640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 0x7f22700c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226f7fe640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2264000c00 tx=0x7f22640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264035040 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2264030d00 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227015c710 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22640456a0 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.521+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227015ccd0 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.522+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227004f540 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.523+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2264038020 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.523+0000 7f226cff9640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 0x7f225c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.523+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f22640acc80 con 0x7f22700c4a90 2024-03-18T00:25:52.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.523+0000 7f226ffff640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 0x7f225c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.523+0000 7f226ffff640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 0x7f225c06e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2260009e10 tx=0x7f2260009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.527+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f226407b120 con 0x7f22700c4a90 2024-03-18T00:25:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.699+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f22700c67a0 con 0x7f22700c4a90 2024-03-18T00:25:52.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.700+0000 7f226cff9640 1 -- 172.21.15.81:0/1288352382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f226407f1c0 con 0x7f22700c4a90 2024-03-18T00:25:52.701 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 msgr2=0x7f225c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 0x7f225c06e090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2260009e10 tx=0x7f2260009190 comp rx=0 tx=0).stop 2024-03-18T00:25:52.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 msgr2=0x7f22701f6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2264000c00 tx=0x7f22640046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 shutdown_connections 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f22701589a0 0x7f22700b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f225c06bbd0 0x7f225c06e090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22700c4a90 0x7f22701f6330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 --2- 172.21.15.81:0/1288352382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f227006eca0 0x7f22700c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 >> 172.21.15.81:0/1288352382 conn(0x7f22700cfbf0 msgr2=0x7f22700af8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 shutdown_connections 2024-03-18T00:25:52.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.702+0000 7f2276285640 1 -- 172.21.15.81:0/1288352382 wait complete. 2024-03-18T00:25:52.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:52.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:25:52.782 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:25:52.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.821+0000 7f142c29a640 1 Processor -- start 2024-03-18T00:25:52.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.821+0000 7f142c29a640 1 -- start start 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142c29a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14240d4bb0 0x7f14240b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142c29a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240cffe0 con 0x7f1424161890 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142c29a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14240cfa20 con 0x7f14240d1070 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142c29a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f14240cfd00 con 0x7f14240d4bb0 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a837640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f14240d4bb0 0x7f14240b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a036640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1424161890 0x7f14240d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34650/0 (socket says 172.21.15.81:34650) 2024-03-18T00:25:52.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a036640 1 -- 172.21.15.81:0/4287643981 learned_addr learned my addr 172.21.15.81:0/4287643981 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a837640 1 -- 172.21.15.81:0/4287643981 >> v1:172.21.15.136:6789/0 conn(0x7f14240d1070 legacy=0x7f14240d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a837640 1 -- 172.21.15.81:0/4287643981 >> v1:172.21.15.81:6789/0 conn(0x7f1424161890 legacy=0x7f14240d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.822+0000 7f142a837640 1 -- 172.21.15.81:0/4287643981 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14240cf710 con 0x7f14240d4bb0 2024-03-18T00:25:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.823+0000 7f142a837640 1 --2- 172.21.15.81:0/4287643981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240b4ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f141c009d90 tx=0x7f141c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86305856072fe00c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.823+0000 7f1429034640 1 -- 172.21.15.81:0/4287643981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c039070 con 0x7f14240d4bb0 2024-03-18T00:25:52.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.823+0000 7f1429034640 1 -- 172.21.15.81:0/4287643981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f141c02cd00 con 0x7f14240d4bb0 2024-03-18T00:25:52.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.823+0000 7f1429034640 1 -- 172.21.15.81:0/4287643981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f141c034660 con 0x7f14240d4bb0 2024-03-18T00:25:52.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 -- 172.21.15.81:0/4287643981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 msgr2=0x7f14240b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 --2- 172.21.15.81:0/4287643981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240b4ec0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f141c009d90 tx=0x7f141c02bf50 comp rx=0 tx=0).stop 2024-03-18T00:25:52.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 -- 172.21.15.81:0/4287643981 shutdown_connections 2024-03-18T00:25:52.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 --2- 172.21.15.81:0/4287643981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240b4ec0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 -- 172.21.15.81:0/4287643981 >> 172.21.15.81:0/4287643981 conn(0x7f14240d4090 msgr2=0x7f14240d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 -- 172.21.15.81:0/4287643981 shutdown_connections 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.824+0000 7f142c29a640 1 -- 172.21.15.81:0/4287643981 wait complete. 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.825+0000 7f142c29a640 1 Processor -- start 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.825+0000 7f142c29a640 1 -- start start 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14240d1070 0x7f142415bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 0x7f14240d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14240b6ee0 con 0x7f14240d4bb0 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f14240b5580 con 0x7f14240d1070 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f14240b7060 con 0x7f1424161890 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32860/0 (socket says 172.21.15.81:32860) 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 -- 172.21.15.81:0/3507305577 learned_addr learned my addr 172.21.15.81:0/3507305577 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142a036640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14240d1070 0x7f142415bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142a837640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 0x7f14240d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 -- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 msgr2=0x7f14240d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 0x7f14240d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 -- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14240d1070 msgr2=0x7f142415bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14240d1070 0x7f142415bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:52.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 -- 172.21.15.81:0/3507305577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142415c4f0 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142a837640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 0x7f14240d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f1429835640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f142000c400 tx=0x7f142000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14200052d0 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1420005490 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14240cb290 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1420007260 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.826+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14240cb850 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.827+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142404f540 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.828+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1420007400 con 0x7f14240d4bb0 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.828+0000 7f141affd640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 0x7f140806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:52.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.828+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1420089ea0 con 0x7f14240d4bb0 2024-03-18T00:25:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.828+0000 7f142a036640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 0x7f140806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:52.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.829+0000 7f142a036640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 0x7f140806e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1414005880 tx=0x7f1414009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:52.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:52.833+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f142415c4f0 con 0x7f14240d4bb0 2024-03-18T00:25:53.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.007+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f142408d7e0 con 0x7f14240d4bb0 2024-03-18T00:25:53.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.007+0000 7f141affd640 1 -- 172.21.15.81:0/3507305577 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f14200583d0 con 0x7f14240d4bb0 2024-03-18T00:25:53.008 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 msgr2=0x7f140806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 0x7f140806e090 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1414005880 tx=0x7f1414009040 comp rx=0 tx=0).stop 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 msgr2=0x7f14240d2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f142000c400 tx=0x7f142000c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 shutdown_connections 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1424161890 0x7f14240d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f140806bbd0 0x7f140806e090 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14240d4bb0 0x7f14240d2220 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 --2- 172.21.15.81:0/3507305577 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f14240d1070 0x7f142415bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 >> 172.21.15.81:0/3507305577 conn(0x7f14240d4090 msgr2=0x7f142406d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 shutdown_connections 2024-03-18T00:25:53.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.009+0000 7f142c29a640 1 -- 172.21.15.81:0/3507305577 wait complete. 2024-03-18T00:25:53.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-18T00:25:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.123+0000 7f635e9bc640 1 Processor -- start 2024-03-18T00:25:53.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.123+0000 7f635e9bc640 1 -- start start 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.123+0000 7f635e9bc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63580d10d0 0x7f6358162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.123+0000 7f635e9bc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f635815ea90 0x7f635815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.123+0000 7f635e9bc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63580b3440 con 0x7f63581622b0 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f635e9bc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f63580d16c0 con 0x7f63580d10d0 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f635e9bc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63580d2660 con 0x7f635815ea90 2024-03-18T00:25:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63580d10d0 0x7f6358162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f63580d10d0 0x7f6358162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32868/0 (socket says 172.21.15.81:32868) 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 -- 172.21.15.81:0/3618473660 learned_addr learned my addr 172.21.15.81:0/3618473660 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f635cf59640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f635815ea90 0x7f635815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 -- 172.21.15.81:0/3618473660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f635815ea90 msgr2=0x7f635815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f635815ea90 0x7f635815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 -- 172.21.15.81:0/3618473660 >> v1:172.21.15.136:6789/0 conn(0x7f63581622b0 legacy=0x7f6358162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.124+0000 7f63577fe640 1 -- 172.21.15.81:0/3618473660 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63580d20a0 con 0x7f63580d10d0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f63577fe640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358162da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f634c0098a0 tx=0x7f634c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d088e2cb53a317b8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f6356ffd640 1 -- 172.21.15.81:0/3618473660 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c0317c0 con 0x7f63580d10d0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f6356ffd640 1 -- 172.21.15.81:0/3618473660 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634c037070 con 0x7f63580d10d0 2024-03-18T00:25:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f6356ffd640 1 -- 172.21.15.81:0/3618473660 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634c031b80 con 0x7f63580d10d0 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 -- 172.21.15.81:0/3618473660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 msgr2=0x7f6358162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358162da0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f634c0098a0 tx=0x7f634c02b860 comp rx=0 tx=0).stop 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 -- 172.21.15.81:0/3618473660 shutdown_connections 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f635815ea90 0x7f635815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3618473660 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358162da0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.125+0000 7f635e9bc640 1 -- 172.21.15.81:0/3618473660 >> 172.21.15.81:0/3618473660 conn(0x7f63580d4070 msgr2=0x7f63580d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.126+0000 7f635e9bc640 1 -- 172.21.15.81:0/3618473660 shutdown_connections 2024-03-18T00:25:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.126+0000 7f635e9bc640 1 -- 172.21.15.81:0/3618473660 wait complete. 2024-03-18T00:25:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.127+0000 7f635e9bc640 1 Processor -- start 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.127+0000 7f635e9bc640 1 -- start start 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.127+0000 7f635e9bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f635815ea90 0x7f6358158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63581622b0 0x7f635815d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63580cfc90 con 0x7f63580d10d0 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f63580d2ab0 con 0x7f635815ea90 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f63580cfe10 con 0x7f63581622b0 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32876/0 (socket says 172.21.15.81:32876) 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 -- 172.21.15.81:0/3211330572 learned_addr learned my addr 172.21.15.81:0/3211330572 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f63577fe640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f635815ea90 0x7f6358158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635cf59640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63581622b0 0x7f635815d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 -- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63581622b0 msgr2=0x7f635815d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63581622b0 0x7f635815d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 -- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f635815ea90 msgr2=0x7f6358158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f635815ea90 0x7f6358158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 -- 172.21.15.81:0/3211330572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63580b37d0 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6357fff640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f634800c400 tx=0x7f634800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63480052d0 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6348005490 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63580b3ab0 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348007260 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.128+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63580b4070 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.129+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635804f5b0 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.130+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6348007400 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.130+0000 7f6354ff9640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 0x7f634406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.130+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6348089f30 con 0x7f63580d10d0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.130+0000 7f63577fe640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 0x7f634406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.131+0000 7f63577fe640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 0x7f634406e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f634c036000 tx=0x7f634c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.135+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f63480583d0 con 0x7f63580d10d0 2024-03-18T00:25:53.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.385+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f63580d18d0 con 0x7f63580d10d0 2024-03-18T00:25:53.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.607+0000 7f6354ff9640 1 -- 172.21.15.81:0/3211330572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v51) ==== 147+0+0 (secure 0 0 0) 0x7f634805c470 con 0x7f63580d10d0 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 msgr2=0x7f634406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 0x7f634406e090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f634c036000 tx=0x7f634c03d040 comp rx=0 tx=0).stop 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 msgr2=0x7f6358156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f634800c400 tx=0x7f634800c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 shutdown_connections 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f63581622b0 0x7f635815d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f635815ea90 0x7f6358158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f634406bbd0 0x7f634406e090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 --2- 172.21.15.81:0/3211330572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63580d10d0 0x7f6358156150 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.609+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 >> 172.21.15.81:0/3211330572 conn(0x7f63580d4070 msgr2=0x7f635806bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.610+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 shutdown_connections 2024-03-18T00:25:53.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.610+0000 7f635e9bc640 1 -- 172.21.15.81:0/3211330572 wait complete. 2024-03-18T00:25:53.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-18T00:25:53.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 Processor -- start 2024-03-18T00:25:53.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 -- start start 2024-03-18T00:25:53.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdc5415e850 0x7fdc5406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540d1390 con 0x7fdc540d0e20 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc540d1670 con 0x7fdc5415e470 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc5b027640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdc540d1950 con 0x7fdc5415e850 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.727+0000 7fdc595c4640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fdc540d0e20 0x7fdc540ccc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34652/0 (socket says 172.21.15.81:34652) 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc595c4640 1 -- 172.21.15.81:0/2261968665 learned_addr learned my addr 172.21.15.81:0/2261968665 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc53fff640 1 --2- 172.21.15.81:0/2261968665 >> v2:172.21.15.136:3300/0 conn(0x7fdc5415e850 0x7fdc5406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189588092 0 0) 0x7fdc540d1390 con 0x7fdc540d0e20 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc44003520 con 0x7fdc540d0e20 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739340666 0 0) 0x7fdc540d1670 con 0x7fdc5415e470 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc540d1390 con 0x7fdc5415e470 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc53fff640 1 -- 172.21.15.81:0/2261968665 >> v1:172.21.15.136:6789/0 conn(0x7fdc5415e470 legacy=0x7fdc5406c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc53fff640 1 -- 172.21.15.81:0/2261968665 >> v1:172.21.15.81:6789/0 conn(0x7fdc540d0e20 legacy=0x7fdc540ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.728+0000 7fdc53fff640 1 -- 172.21.15.81:0/2261968665 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc540cc770 con 0x7fdc5415e850 2024-03-18T00:25:53.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc53fff640 1 --2- 172.21.15.81:0/2261968665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc5415e850 0x7fdc5406cc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc400097a0 tx=0x7fdc4002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4aa3e55571e8bb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40034070 con 0x7fdc5415e850 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc40030610 con 0x7fdc5415e850 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc537fe640 1 -- 172.21.15.81:0/2261968665 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc400309c0 con 0x7fdc5415e850 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc5b027640 1 -- 172.21.15.81:0/2261968665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc5415e850 msgr2=0x7fdc5406cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc5b027640 1 --2- 172.21.15.81:0/2261968665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc5415e850 0x7fdc5406cc80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdc400097a0 tx=0x7fdc4002b960 comp rx=0 tx=0).stop 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc5b027640 1 -- 172.21.15.81:0/2261968665 shutdown_connections 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.729+0000 7fdc5b027640 1 --2- 172.21.15.81:0/2261968665 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc5415e850 0x7fdc5406cc80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.730+0000 7fdc5b027640 1 -- 172.21.15.81:0/2261968665 >> 172.21.15.81:0/2261968665 conn(0x7fdc540d1f10 msgr2=0x7fdc540d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.730+0000 7fdc5b027640 1 -- 172.21.15.81:0/2261968665 shutdown_connections 2024-03-18T00:25:53.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.730+0000 7fdc5b027640 1 -- 172.21.15.81:0/2261968665 wait complete. 2024-03-18T00:25:53.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.731+0000 7fdc5b027640 1 Processor -- start 2024-03-18T00:25:53.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.731+0000 7fdc5b027640 1 -- start start 2024-03-18T00:25:53.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc540d0e20 0x7fdc54159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc5415e850 0x7fdc5414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5406d340 con 0x7fdc5415e470 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5406d1c0 con 0x7fdc540d0e20 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdc540cd3a0 con 0x7fdc5415e850 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32878/0 (socket says 172.21.15.81:32878) 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 -- 172.21.15.81:0/3485702961 learned_addr learned my addr 172.21.15.81:0/3485702961 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc595c4640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc5415e850 0x7fdc5414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc58dc3640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc540d0e20 0x7fdc54159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 -- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc5415e850 msgr2=0x7fdc5414e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc5415e850 0x7fdc5414e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 -- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc540d0e20 msgr2=0x7fdc54159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc540d0e20 0x7fdc54159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 -- 172.21.15.81:0/3485702961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54158d00 con 0x7fdc5415e470 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc53fff640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098c0 tx=0x7fdc400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40034040 con 0x7fdc5415e470 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4003aaa0 con 0x7fdc5415e470 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc40006e10 con 0x7fdc5415e470 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc54158fa0 con 0x7fdc5415e470 2024-03-18T00:25:53.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.732+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc54159560 con 0x7fdc5415e470 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.733+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc540b2cc0 con 0x7fdc5415e470 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.734+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdc40037070 con 0x7fdc5415e470 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.734+0000 7fdc517fa640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 0x7fdc3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.734+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fdc400ac6e0 con 0x7fdc5415e470 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.734+0000 7fdc58dc3640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 0x7fdc3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:53.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.735+0000 7fdc58dc3640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 0x7fdc3806e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc48007fd0 tx=0x7fdc48009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:53.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.738+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdc540b2cc0 con 0x7fdc5415e470 2024-03-18T00:25:53.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.915+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fdc5404f540 con 0x7fdc5415e470 2024-03-18T00:25:53.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.918+0000 7fdc517fa640 1 -- 172.21.15.81:0/3485702961 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fdc4003f070 con 0x7fdc5415e470 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 msgr2=0x7fdc3806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 0x7fdc3806e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc48007fd0 tx=0x7fdc48009040 comp rx=0 tx=0).stop 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 msgr2=0x7fdc5415a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdc400098c0 tx=0x7fdc400046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 shutdown_connections 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdc5415e850 0x7fdc5414e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdc3806bbd0 0x7fdc3806e090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc5415e470 0x7fdc5415a9a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 --2- 172.21.15.81:0/3485702961 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdc540d0e20 0x7fdc54159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 >> 172.21.15.81:0/3485702961 conn(0x7fdc540d1f10 msgr2=0x7fdc5406fc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 shutdown_connections 2024-03-18T00:25:53.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:53.920+0000 7fdc5b027640 1 -- 172.21.15.81:0/3485702961 wait complete. 2024-03-18T00:25:53.932 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-18T00:25:53.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T00:25:53.974 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T00:25:54.033 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-18T00:25:54.033 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:54.033 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:54.048 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:54.048 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:54.104 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:54.104 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:54.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 Processor -- start 2024-03-18T00:25:54.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 -- start start 2024-03-18T00:25:54.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 0x7f1fa815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fa80b3440 con 0x7f1fa81622b0 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1fa80d16c0 con 0x7f1fa815ea90 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.311+0000 7f1fadcdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa80d2660 con 0x7f1fa80d10d0 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa7fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 0x7f1fa815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa77fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f1fa81622b0 0x7f1fa8162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:53316/0 (socket says 172.21.15.81:53316) 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa77fe640 1 -- 172.21.15.81:0/2096744170 learned_addr learned my addr 172.21.15.81:0/2096744170 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/2096744170 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa67fc640 1 -- 172.21.15.81:0/2096744170 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1101229085 0 0) 0x7f1fa80b3440 con 0x7f1fa81622b0 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/2096744170 >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 msgr2=0x7f1fa815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/2096744170 >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 0x7f1fa815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/2096744170 >> v1:172.21.15.136:6789/0 conn(0x7f1fa81622b0 legacy=0x7f1fa8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/2096744170 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa80d20a0 con 0x7f1fa80d10d0 2024-03-18T00:25:54.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.312+0000 7f1fa7fff640 1 --2- 172.21.15.81:0/2096744170 >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 0x7f1fa815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/2096744170 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa8162da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097a0 tx=0x7f1f9c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38c3d4fd1e9a074e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fa67fc640 1 -- 172.21.15.81:0/2096744170 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c039070 con 0x7f1fa80d10d0 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fa67fc640 1 -- 172.21.15.81:0/2096744170 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c0316f0 con 0x7f1fa80d10d0 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fa67fc640 1 -- 172.21.15.81:0/2096744170 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c031ac0 con 0x7f1fa80d10d0 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 -- 172.21.15.81:0/2096744170 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 msgr2=0x7f1fa8162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/2096744170 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa8162da0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097a0 tx=0x7f1f9c02b790 comp rx=0 tx=0).stop 2024-03-18T00:25:54.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 -- 172.21.15.81:0/2096744170 shutdown_connections 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/2096744170 >> v2:172.21.15.136:3300/0 conn(0x7f1fa815ea90 0x7f1fa815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/2096744170 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa8162da0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 -- 172.21.15.81:0/2096744170 >> 172.21.15.81:0/2096744170 conn(0x7f1fa80d4070 msgr2=0x7f1fa80d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 -- 172.21.15.81:0/2096744170 shutdown_connections 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.313+0000 7f1fadcdc640 1 -- 172.21.15.81:0/2096744170 wait complete. 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.314+0000 7f1fadcdc640 1 Processor -- start 2024-03-18T00:25:54.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 -- start start 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa81585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fa81622b0 0x7f1fa80b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa80cfc90 con 0x7f1fa815ea90 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa80d2ab0 con 0x7f1fa81622b0 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fadcdc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa80cfe10 con 0x7f1fa80d10d0 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.315+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32886/0 (socket says 172.21.15.81:32886) 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/3912176151 learned_addr learned my addr 172.21.15.81:0/3912176151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa77fe640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa81585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa7fff640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fa81622b0 0x7f1fa80b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 msgr2=0x7f1fa81585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa81585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fa81622b0 msgr2=0x7f1fa80b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fa81622b0 0x7f1fa80b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 -- 172.21.15.81:0/3912176151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa80cbb10 con 0x7f1fa815ea90 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fa6ffd640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000c00 tx=0x7f1f9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c044070 con 0x7f1fa815ea90 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c034680 con 0x7f1fa815ea90 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fa80cbdf0 con 0x7f1fa815ea90 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c039040 con 0x7f1fa815ea90 2024-03-18T00:25:54.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.316+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fa80cc3b0 con 0x7f1fa815ea90 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.317+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa804f5b0 con 0x7f1fa815ea90 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.318+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1f9c047070 con 0x7f1fa815ea90 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.318+0000 7f1f8ffff640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 0x7f1f9406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.318+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1f9c0ac530 con 0x7f1fa815ea90 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.318+0000 7f1fa77fe640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 0x7f1f9406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.318+0000 7f1fa77fe640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 0x7f1f9406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f980012e0 tx=0x7f1f98001630 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.322+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1f9c07a9d0 con 0x7f1fa815ea90 2024-03-18T00:25:54.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.496+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1fa80d18d0 con 0x7f1fa815ea90 2024-03-18T00:25:54.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.497+0000 7f1f8ffff640 1 -- 172.21.15.81:0/3912176151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f1f9c07ea70 con 0x7f1fa815ea90 2024-03-18T00:25:54.497 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:54.498 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 msgr2=0x7f1f9406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 0x7f1f9406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1f980012e0 tx=0x7f1f98001630 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 msgr2=0x7f1fa80b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c000c00 tx=0x7f1f9c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 shutdown_connections 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1fa81622b0 0x7f1fa80b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f9406bbd0 0x7f1f9406e090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa815ea90 0x7f1fa80b9280 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 --2- 172.21.15.81:0/3912176151 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1fa80d10d0 0x7f1fa81585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 >> 172.21.15.81:0/3912176151 conn(0x7f1fa80d4070 msgr2=0x7f1fa815a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 shutdown_connections 2024-03-18T00:25:54.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.499+0000 7f1fadcdc640 1 -- 172.21.15.81:0/3912176151 wait complete. 2024-03-18T00:25:54.511 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:54.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.614+0000 7f4fd8226640 1 Processor -- start 2024-03-18T00:25:54.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.614+0000 7f4fd8226640 1 -- start start 2024-03-18T00:25:54.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd8226640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4fd00ce840 0x7f4fd00ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd8226640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd00b7110 0x7f4fd00b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd8226640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fd00cce20 con 0x7f4fd015c140 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd8226640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4fd00cf1e0 con 0x7f4fd00ce840 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd8226640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd00cd100 con 0x7f4fd00b7110 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd5fc2640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4fd015c140 0x7f4fd00d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34664/0 (socket says 172.21.15.81:34664) 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd5fc2640 1 -- 172.21.15.81:0/587765434 learned_addr learned my addr 172.21.15.81:0/587765434 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/587765434 >> v2:172.21.15.81:3300/0 conn(0x7f4fd00ce840 0x7f4fd00ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.615+0000 7f4fd67c3640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd00b7110 0x7f4fd00b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd4fc0640 1 -- 172.21.15.81:0/587765434 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656747057 0 0) 0x7f4fd00cce20 con 0x7f4fd015c140 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd4fc0640 1 -- 172.21.15.81:0/587765434 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fbc003520 con 0x7f4fd015c140 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd57c1640 1 -- 172.21.15.81:0/587765434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd00b7110 msgr2=0x7f4fd00b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:54.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd00b7110 0x7f4fd00b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd57c1640 1 -- 172.21.15.81:0/587765434 >> v1:172.21.15.81:6789/0 conn(0x7f4fd015c140 legacy=0x7f4fd00d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd57c1640 1 -- 172.21.15.81:0/587765434 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd00cd3e0 con 0x7f4fd00ce840 2024-03-18T00:25:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.616+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00ce840 0x7f4fd00ceca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6504cc70a80259e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd4fc0640 1 -- 172.21.15.81:0/587765434 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0035020 con 0x7f4fd00ce840 2024-03-18T00:25:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd4fc0640 1 -- 172.21.15.81:0/587765434 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0031830 con 0x7f4fd00ce840 2024-03-18T00:25:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd4fc0640 1 -- 172.21.15.81:0/587765434 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0031c00 con 0x7f4fd00ce840 2024-03-18T00:25:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 -- 172.21.15.81:0/587765434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00ce840 msgr2=0x7f4fd00ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00ce840 0x7f4fd00ceca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4fc00097a0 tx=0x7f4fc002b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 -- 172.21.15.81:0/587765434 shutdown_connections 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd00b7110 0x7f4fd00b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 --2- 172.21.15.81:0/587765434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00ce840 0x7f4fd00ceca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 -- 172.21.15.81:0/587765434 >> 172.21.15.81:0/587765434 conn(0x7f4fd009b160 msgr2=0x7f4fd00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 -- 172.21.15.81:0/587765434 shutdown_connections 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.617+0000 7f4fd8226640 1 -- 172.21.15.81:0/587765434 wait complete. 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.618+0000 7f4fd8226640 1 Processor -- start 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.618+0000 7f4fd8226640 1 -- start start 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd00ce840 0x7f4fd01e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd015c140 0x7f4fd01f1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd00d2710 con 0x7f4fd00b7110 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd00cd9a0 con 0x7f4fd00ce840 2024-03-18T00:25:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd8226640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4fd00d2890 con 0x7f4fd015c140 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd5fc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd5fc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32896/0 (socket says 172.21.15.81:32896) 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd5fc2640 1 -- 172.21.15.81:0/3337616997 learned_addr learned my addr 172.21.15.81:0/3337616997 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd00ce840 0x7f4fd01e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.619+0000 7f4fd67c3640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd015c140 0x7f4fd01f1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 -- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd015c140 msgr2=0x7f4fd01f1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd015c140 0x7f4fd01f1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 -- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd00ce840 msgr2=0x7f4fd01e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd00ce840 0x7f4fd01e59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 -- 172.21.15.81:0/3337616997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd01e5f20 con 0x7f4fd00b7110 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd5fc2640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00cad0 tx=0x7f4fcc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc017070 con 0x7f4fd00b7110 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc00ac30 con 0x7f4fd00b7110 2024-03-18T00:25:54.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc012400 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd01e61c0 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.620+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01e6780 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.621+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fd004f540 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.621+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4fcc01a070 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.622+0000 7f4fc67fc640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 0x7f4fb406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.622+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4fcc08a7d0 con 0x7f4fd00b7110 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.622+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 0x7f4fb406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.622+0000 7f4fd57c1640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 0x7f4fb406e090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0036000 tx=0x7f4fc0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.626+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4fcc058c70 con 0x7f4fd00b7110 2024-03-18T00:25:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.800+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4fd00ce620 con 0x7f4fd00b7110 2024-03-18T00:25:54.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.800+0000 7f4fc67fc640 1 -- 172.21.15.81:0/3337616997 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f4fcc05cd10 con 0x7f4fd00b7110 2024-03-18T00:25:54.801 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 msgr2=0x7f4fb406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 0x7f4fb406e090 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0036000 tx=0x7f4fc0008030 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 msgr2=0x7f4fd0145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00cad0 tx=0x7f4fcc00cf90 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 shutdown_connections 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4fd015c140 0x7f4fd01f1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4fd00ce840 0x7f4fd01e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4fb406bbd0 0x7f4fb406e090 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 --2- 172.21.15.81:0/3337616997 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4fd00b7110 0x7f4fd0145ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 >> 172.21.15.81:0/3337616997 conn(0x7f4fd009b160 msgr2=0x7f4fd00b6480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:54.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 shutdown_connections 2024-03-18T00:25:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.802+0000 7f4fd8226640 1 -- 172.21.15.81:0/3337616997 wait complete. 2024-03-18T00:25:54.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:54.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.915+0000 7f7cc0328640 1 Processor -- start 2024-03-18T00:25:54.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.915+0000 7f7cc0328640 1 -- start start 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cc0328640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 0x7f7cb806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cc0328640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb815aa30 con 0x7f7cb80ce100 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cc0328640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cb806e190 con 0x7f7cb80ca940 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cc0328640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb806e7a0 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cbe8c5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f7cb80ce100 0x7f7cb80c4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34676/0 (socket says 172.21.15.81:34676) 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cbe8c5640 1 -- 172.21.15.81:0/2395466024 learned_addr learned my addr 172.21.15.81:0/2395466024 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cbd8c3640 1 --2- 172.21.15.81:0/2395466024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 0x7f7cb806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944869376 0 0) 0x7f7cb0001110 con 0x7f7cb80ce100 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.916+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ca4003520 con 0x7f7cb80ce100 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985640595 0 0) 0x7f7cb806e190 con 0x7f7cb80ca940 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb0001110 con 0x7f7cb80ca940 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/2395466024 >> v1:172.21.15.136:6789/0 conn(0x7f7cb80ca940 legacy=0x7f7cb80cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/2395466024 >> v1:172.21.15.81:6789/0 conn(0x7f7cb80ce100 legacy=0x7f7cb80c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/2395466024 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb80ce6c0 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.917+0000 7f7cbd8c3640 1 --2- 172.21.15.81:0/2395466024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 0x7f7cb806ec30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80097d0 tx=0x7f7ca802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c727988ed48ed7e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8035020 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca8031800 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cbd0c2640 1 -- 172.21.15.81:0/2395466024 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8031bd0 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 -- 172.21.15.81:0/2395466024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 msgr2=0x7f7cb806ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 --2- 172.21.15.81:0/2395466024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 0x7f7cb806ec30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7ca80097d0 tx=0x7f7ca802b8a0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 -- 172.21.15.81:0/2395466024 shutdown_connections 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 --2- 172.21.15.81:0/2395466024 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80cd7c0 0x7f7cb806ec30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 -- 172.21.15.81:0/2395466024 >> 172.21.15.81:0/2395466024 conn(0x7f7cb80cfbf0 msgr2=0x7f7cb80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 -- 172.21.15.81:0/2395466024 shutdown_connections 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.918+0000 7f7cc0328640 1 -- 172.21.15.81:0/2395466024 wait complete. 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.919+0000 7f7cc0328640 1 Processor -- start 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.919+0000 7f7cc0328640 1 -- start start 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80ca940 0x7f7cb81528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb80ce100 0x7f7cb81efe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb80cb430 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb80ce9a0 con 0x7f7cb80ce100 2024-03-18T00:25:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cc0328640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb80cc260 con 0x7f7cb80ca940 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cbd8c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cbd8c3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32910/0 (socket says 172.21.15.81:32910) 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/3350325015 learned_addr learned my addr 172.21.15.81:0/3350325015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cbe0c4640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80ca940 0x7f7cb81528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.920+0000 7f7cbe8c5640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb80ce100 0x7f7cb81efe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80ca940 msgr2=0x7f7cb81528f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80ca940 0x7f7cb81528f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb80ce100 msgr2=0x7f7cb81efe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb80ce100 0x7f7cb81efe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 -- 172.21.15.81:0/3350325015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb81f4430 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cbd8c3640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8034040 tx=0x7f7ca80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8040070 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca8031e30 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8035040 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb81f4710 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.921+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb81f4cd0 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.922+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb804f540 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.922+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7ca804b060 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.923+0000 7f7caeffd640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 0x7f7c9c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.923+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f7ca80ac250 con 0x7f7cb80cd7c0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.923+0000 7f7cbe0c4640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 0x7f7c9c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:54.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.923+0000 7f7cbe0c4640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 0x7f7c9c06e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4001e00 tx=0x7f7cb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:54.927+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7ca807a780 con 0x7f7cb80cd7c0 2024-03-18T00:25:55.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.098+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7cb80c9cf0 con 0x7f7cb80cd7c0 2024-03-18T00:25:55.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.099+0000 7f7caeffd640 1 -- 172.21.15.81:0/3350325015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f7ca807e820 con 0x7f7cb80cd7c0 2024-03-18T00:25:55.099 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 msgr2=0x7f7c9c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 0x7f7c9c06e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7cb4001e00 tx=0x7f7cb4009040 comp rx=0 tx=0).stop 2024-03-18T00:25:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 msgr2=0x7f7cb8152e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8034040 tx=0x7f7ca80046c0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 shutdown_connections 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f7cb80ce100 0x7f7cb81efe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f7c9c06bbd0 0x7f7c9c06e090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb80cd7c0 0x7f7cb8152e30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 --2- 172.21.15.81:0/3350325015 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f7cb80ca940 0x7f7cb81528f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.100+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 >> 172.21.15.81:0/3350325015 conn(0x7f7cb80cfbf0 msgr2=0x7f7cb81563c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.101+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 shutdown_connections 2024-03-18T00:25:55.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.101+0000 7f7cc0328640 1 -- 172.21.15.81:0/3350325015 wait complete. 2024-03-18T00:25:55.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:55.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.214+0000 7f2a48652640 1 Processor -- start 2024-03-18T00:25:55.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 -- start start 2024-03-18T00:25:55.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4015c140 0x7f2a400d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f2a400ce840 0x7f2a400ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b7110 0x7f2a400b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400cf1e0 con 0x7f2a400b7110 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f2a400cce20 con 0x7f2a400ce840 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.215+0000 7f2a48652640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400cd100 con 0x7f2a4015c140 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b7110 0x7f2a400b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2a400b7110 0x7f2a400b75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32918/0 (socket says 172.21.15.81:32918) 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 -- 172.21.15.81:0/4135527243 learned_addr learned my addr 172.21.15.81:0/4135527243 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a463ee640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4015c140 0x7f2a400d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a45bed640 1 --2- 172.21.15.81:0/4135527243 >> v2:172.21.15.136:3300/0 conn(0x7f2a400ce840 0x7f2a400ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 -- 172.21.15.81:0/4135527243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4015c140 msgr2=0x7f2a400d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4015c140 0x7f2a400d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 -- 172.21.15.81:0/4135527243 >> v2:172.21.15.136:3300/0 conn(0x7f2a400ce840 msgr2=0x7f2a400ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 --2- 172.21.15.81:0/4135527243 >> v2:172.21.15.136:3300/0 conn(0x7f2a400ce840 0x7f2a400ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.216+0000 7f2a46bef640 1 -- 172.21.15.81:0/4135527243 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400cd3e0 con 0x7f2a400b7110 2024-03-18T00:25:55.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a46bef640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b7110 0x7f2a400b75a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a4006bc40 tx=0x7f2a3802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff750400b8fffa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a453ec640 1 -- 172.21.15.81:0/4135527243 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3802ca70 con 0x7f2a400b7110 2024-03-18T00:25:55.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a453ec640 1 -- 172.21.15.81:0/4135527243 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3802cc10 con 0x7f2a400b7110 2024-03-18T00:25:55.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a453ec640 1 -- 172.21.15.81:0/4135527243 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a380343f0 con 0x7f2a400b7110 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 -- 172.21.15.81:0/4135527243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b7110 msgr2=0x7f2a400b75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b7110 0x7f2a400b75a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2a4006bc40 tx=0x7f2a3802bed0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 -- 172.21.15.81:0/4135527243 shutdown_connections 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a400b7110 0x7f2a400b75a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 --2- 172.21.15.81:0/4135527243 >> v2:172.21.15.136:3300/0 conn(0x7f2a400ce840 0x7f2a400ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 --2- 172.21.15.81:0/4135527243 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a4015c140 0x7f2a400d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.217+0000 7f2a48652640 1 -- 172.21.15.81:0/4135527243 >> 172.21.15.81:0/4135527243 conn(0x7f2a4009b160 msgr2=0x7f2a400d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.218+0000 7f2a48652640 1 -- 172.21.15.81:0/4135527243 shutdown_connections 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.218+0000 7f2a48652640 1 -- 172.21.15.81:0/4135527243 wait complete. 2024-03-18T00:25:55.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 Processor -- start 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 -- start start 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 0x7f2a401503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 0x7f2a4006d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2a400d0e00 con 0x7f2a4015c140 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2a400cd9a0 con 0x7f2a400b7110 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a48652640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2a400d2710 con 0x7f2a400ce840 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a46bef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a46bef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:32934/0 (socket says 172.21.15.81:32934) 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.219+0000 7f2a46bef640 1 -- 172.21.15.81:0/3793538398 learned_addr learned my addr 172.21.15.81:0/3793538398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a463ee640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 0x7f2a401503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a45bed640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 0x7f2a4006d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 -- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 msgr2=0x7f2a4006d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 0x7f2a4006d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 -- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 msgr2=0x7f2a401503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 0x7f2a401503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 -- 172.21.15.81:0/3793538398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a400c9400 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a463ee640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 0x7f2a401503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a45bed640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 0x7f2a4006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a46bef640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a38036040 tx=0x7f2a38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38043020 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a3803e450 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a400c96e0 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a38009510 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.220+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a400c9ca0 con 0x7f2a4015c140 2024-03-18T00:25:55.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.221+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a4004f540 con 0x7f2a4015c140 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.222+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2a38046020 con 0x7f2a4015c140 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.222+0000 7f2a36ffd640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 0x7f2a2406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.222+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2a380ad0b0 con 0x7f2a4015c140 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.222+0000 7f2a463ee640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 0x7f2a2406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.222+0000 7f2a463ee640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 0x7f2a2406e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009b90 tx=0x7f2a3c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.226+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2a3804d030 con 0x7f2a4015c140 2024-03-18T00:25:55.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.402+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2a400ce620 con 0x7f2a4015c140 2024-03-18T00:25:55.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.402+0000 7f2a36ffd640 1 -- 172.21.15.81:0/3793538398 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2a3807bc30 con 0x7f2a4015c140 2024-03-18T00:25:55.403 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 msgr2=0x7f2a2406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 0x7f2a2406e090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c009b90 tx=0x7f2a3c008040 comp rx=0 tx=0).stop 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 msgr2=0x7f2a401e7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a38036040 tx=0x7f2a38004a40 comp rx=0 tx=0).stop 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 shutdown_connections 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2a2406bbd0 0x7f2a2406e090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2a4015c140 0x7f2a401e7530 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2a400ce840 0x7f2a4006d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 --2- 172.21.15.81:0/3793538398 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2a400b7110 0x7f2a401503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 >> 172.21.15.81:0/3793538398 conn(0x7f2a4009b160 msgr2=0x7f2a400c7970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 shutdown_connections 2024-03-18T00:25:55.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.404+0000 7f2a48652640 1 -- 172.21.15.81:0/3793538398 wait complete. 2024-03-18T00:25:55.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T00:25:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.515+0000 7f11f4885640 1 Processor -- start 2024-03-18T00:25:55.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.515+0000 7f11f4885640 1 -- start start 2024-03-18T00:25:55.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11f015e5a0 0x7f11f00d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 0x7f11f00ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f11f00cff90 con 0x7f11f015e5a0 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f11f00b34d0 con 0x7f11f00d2b80 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11f4885640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11f00d3010 con 0x7f11f00d1e40 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11ee59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11f015e5a0 0x7f11f00d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11ee59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11f015e5a0 0x7f11f00d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41068/0 (socket says 172.21.15.81:41068) 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.516+0000 7f11ee59c640 1 -- 172.21.15.81:0/1047633915 learned_addr learned my addr 172.21.15.81:0/1047633915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11edd9b640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11eed9d640 1 --2- 172.21.15.81:0/1047633915 >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 0x7f11f00ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 -- 172.21.15.81:0/1047633915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 msgr2=0x7f11f00d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f00d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 -- 172.21.15.81:0/1047633915 >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 msgr2=0x7f11f00ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 --2- 172.21.15.81:0/1047633915 >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 0x7f11f00ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 -- 172.21.15.81:0/1047633915 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f00d1200 con 0x7f11f015e5a0 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11eed9d640 1 --2- 172.21.15.81:0/1047633915 >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 0x7f11f00ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11edd9b640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f00d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.517+0000 7f11ee59c640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f015e5a0 0x7f11f00d4b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11f008d940 tx=0x7f11e002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5337d2749ed5cf22 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11ed59a640 1 -- 172.21.15.81:0/1047633915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e002c9e0 con 0x7f11f015e5a0 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11ed59a640 1 -- 172.21.15.81:0/1047633915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e002cb80 con 0x7f11f015e5a0 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11ed59a640 1 -- 172.21.15.81:0/1047633915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e00343f0 con 0x7f11f015e5a0 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 -- 172.21.15.81:0/1047633915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f015e5a0 msgr2=0x7f11f00d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f015e5a0 0x7f11f00d4b80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f11f008d940 tx=0x7f11e002be40 comp rx=0 tx=0).stop 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 -- 172.21.15.81:0/1047633915 shutdown_connections 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 --2- 172.21.15.81:0/1047633915 >> v2:172.21.15.136:3300/0 conn(0x7f11f00d2b80 0x7f11f00ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f00d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 --2- 172.21.15.81:0/1047633915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f015e5a0 0x7f11f00d4b80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 -- 172.21.15.81:0/1047633915 >> 172.21.15.81:0/1047633915 conn(0x7f11f00d4060 msgr2=0x7f11f00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 -- 172.21.15.81:0/1047633915 shutdown_connections 2024-03-18T00:25:55.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.518+0000 7f11f4885640 1 -- 172.21.15.81:0/1047633915 wait complete. 2024-03-18T00:25:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 Processor -- start 2024-03-18T00:25:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 -- start start 2024-03-18T00:25:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f009dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f015e5a0 0x7f11f00d0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11f00cf090 con 0x7f11f00d2b80 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11f00d17c0 con 0x7f11f015e5a0 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11f4885640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11f00cf210 con 0x7f11f00d1e40 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11edd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41082/0 (socket says 172.21.15.81:41082) 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11edd9b640 1 -- 172.21.15.81:0/708596240 learned_addr learned my addr 172.21.15.81:0/708596240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11ee59c640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f009dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.520+0000 7f11eed9d640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f015e5a0 0x7f11f00d0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 -- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 msgr2=0x7f11f009dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f009dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 -- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f015e5a0 msgr2=0x7f11f00d0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f015e5a0 0x7f11f00d0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 -- 172.21.15.81:0/708596240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f01f8040 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11edd9b640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11e400e810 tx=0x7f11e400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e400f040 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11e4004030 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f00b9590 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e4004400 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.521+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f00b6dc0 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.522+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f004f5b0 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.522+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f11e400c6d0 con 0x7f11f00d2b80 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.523+0000 7f11deffd640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 0x7f11d006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.523+0000 7f11ee59c640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 0x7f11d006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:55.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.523+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f11e408a5c0 con 0x7f11f00d2b80 2024-03-18T00:25:55.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.523+0000 7f11ee59c640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 0x7f11d006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11e0035000 tx=0x7f11e0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:55.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.527+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f11f01f8040 con 0x7f11f00d2b80 2024-03-18T00:25:55.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.717+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f11f0074d40 con 0x7f11f00d2b80 2024-03-18T00:25:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.717+0000 7f11deffd640 1 -- 172.21.15.81:0/708596240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7f11e4017020 con 0x7f11f00d2b80 2024-03-18T00:25:55.718 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 msgr2=0x7f11d006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 0x7f11d006e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f11e0035000 tx=0x7f11e0030000 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 msgr2=0x7f11f01f7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f11e400e810 tx=0x7f11e400ecd0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 shutdown_connections 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11f015e5a0 0x7f11f00d0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11d006bbd0 0x7f11d006e090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11f00d2b80 0x7f11f01f7b00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 --2- 172.21.15.81:0/708596240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11f00d1e40 0x7f11f009dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 >> 172.21.15.81:0/708596240 conn(0x7f11f00d4060 msgr2=0x7f11f00b5330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 shutdown_connections 2024-03-18T00:25:55.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:55.719+0000 7f11f4885640 1 -- 172.21.15.81:0/708596240 wait complete. 2024-03-18T00:25:55.730 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-18T00:25:55.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:55.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-18T00:25:55.758 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:25:55.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:55.759 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-18T00:25:55.822 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:55.822 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:55.839 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:55.839 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:55.894 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:55.895 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:55.951 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:56.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.051+0000 7f953191b640 1 Processor -- start 2024-03-18T00:25:56.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.051+0000 7f953191b640 1 -- start start 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.051+0000 7f953191b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f952c162da0 0x7f952c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.051+0000 7f953191b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c0b3440 con 0x7f952c1622b0 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.051+0000 7f953191b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f952c0d20a0 con 0x7f952c0d10d0 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f953191b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f952c0d16c0 con 0x7f952c162da0 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952b7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f952c162da0 0x7f952c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f952c1622b0 0x7f952c162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37606/0 (socket says 172.21.15.81:37606) 2024-03-18T00:25:56.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952affd640 1 -- 172.21.15.81:0/916484639 learned_addr learned my addr 172.21.15.81:0/916484639 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952b7fe640 1 -- 172.21.15.81:0/916484639 >> v1:172.21.15.136:6789/0 conn(0x7f952c0d10d0 legacy=0x7f952c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952b7fe640 1 -- 172.21.15.81:0/916484639 >> v1:172.21.15.81:6789/0 conn(0x7f952c1622b0 legacy=0x7f952c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f952b7fe640 1 -- 172.21.15.81:0/916484639 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c0d2380 con 0x7f952c162da0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.052+0000 7f9529ffb640 1 -- 172.21.15.81:0/916484639 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282396265 0 0) 0x7f952c0b3440 con 0x7f952c1622b0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f952b7fe640 1 --2- 172.21.15.81:0/916484639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c162da0 0x7f952c15f1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9524009dc0 tx=0x7f952402be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b75b66aac60e058 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f9529ffb640 1 -- 172.21.15.81:0/916484639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524039070 con 0x7f952c162da0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f9529ffb640 1 -- 172.21.15.81:0/916484639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952402cbb0 con 0x7f952c162da0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f9529ffb640 1 -- 172.21.15.81:0/916484639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9524034440 con 0x7f952c162da0 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 -- 172.21.15.81:0/916484639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c162da0 msgr2=0x7f952c15f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 --2- 172.21.15.81:0/916484639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c162da0 0x7f952c15f1a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9524009dc0 tx=0x7f952402be00 comp rx=0 tx=0).stop 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 -- 172.21.15.81:0/916484639 shutdown_connections 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 --2- 172.21.15.81:0/916484639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c162da0 0x7f952c15f1a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 -- 172.21.15.81:0/916484639 >> 172.21.15.81:0/916484639 conn(0x7f952c0d4070 msgr2=0x7f952c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 -- 172.21.15.81:0/916484639 shutdown_connections 2024-03-18T00:25:56.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.053+0000 7f953191b640 1 -- 172.21.15.81:0/916484639 wait complete. 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.054+0000 7f953191b640 1 Processor -- start 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 -- start start 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f952c0d10d0 0x7f952c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f952c162da0 0x7f952c0b5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f952c1631f0 con 0x7f952c1622b0 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f952c0d2660 con 0x7f952c162da0 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f953191b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f952c0cfc90 con 0x7f952c0d10d0 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.055+0000 7f952a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41096/0 (socket says 172.21.15.81:41096) 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 -- 172.21.15.81:0/2491869383 learned_addr learned my addr 172.21.15.81:0/2491869383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952b7fe640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f952c162da0 0x7f952c0b5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952affd640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f952c0d10d0 0x7f952c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 -- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f952c0d10d0 msgr2=0x7f952c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f952c0d10d0 0x7f952c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 -- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f952c162da0 msgr2=0x7f952c0b5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f952c162da0 0x7f952c0b5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 -- 172.21.15.81:0/2491869383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f952c1568d0 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f952a7fc640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f952000c400 tx=0x7f952000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520017070 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95200052d0 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9520003830 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f952c0b4770 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.056+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f952c0b4d30 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.057+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f952c04f5b0 con 0x7f952c1622b0 2024-03-18T00:25:56.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.058+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f952001a070 con 0x7f952c1622b0 2024-03-18T00:25:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.058+0000 7f9513fff640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 0x7f951806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.058+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f9520089c70 con 0x7f952c1622b0 2024-03-18T00:25:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.058+0000 7f952affd640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 0x7f951806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.058+0000 7f952affd640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 0x7f951806e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f951c000f60 tx=0x7f951c007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.062+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f95200581a0 con 0x7f952c1622b0 2024-03-18T00:25:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.236+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f952c0d18d0 con 0x7f952c1622b0 2024-03-18T00:25:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.237+0000 7f9513fff640 1 -- 172.21.15.81:0/2491869383 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f952005c240 con 0x7f952c1622b0 2024-03-18T00:25:56.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:56.238 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 msgr2=0x7f951806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 0x7f951806e0c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f951c000f60 tx=0x7f951c007e40 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 msgr2=0x7f952c15ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f952000c400 tx=0x7f952000c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 shutdown_connections 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f952c162da0 0x7f952c0b5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f951806bc00 0x7f951806e0c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f952c1622b0 0x7f952c15ea90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 --2- 172.21.15.81:0/2491869383 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f952c0d10d0 0x7f952c15b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 >> 172.21.15.81:0/2491869383 conn(0x7f952c0d4070 msgr2=0x7f952c06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 shutdown_connections 2024-03-18T00:25:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.240+0000 7f953191b640 1 -- 172.21.15.81:0/2491869383 wait complete. 2024-03-18T00:25:56.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:56.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.354+0000 7f5f31160640 1 Processor -- start 2024-03-18T00:25:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.354+0000 7f5f31160640 1 -- start start 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5f2c0cb260 0x7f5f2c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5f2c06e7a0 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f5f2c15aa30 con 0x7f5f2c0cb260 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f31160640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c06e190 con 0x7f5f2c0ca940 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f2a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f2a59c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41100/0 (socket says 172.21.15.81:41100) 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f2a59c640 1 -- 172.21.15.81:0/2982284017 learned_addr learned my addr 172.21.15.81:0/2982284017 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f2ad9d640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.355+0000 7f5f2b59e640 1 --2- 172.21.15.81:0/2982284017 >> v2:172.21.15.136:3300/0 conn(0x7f5f2c0cb260 0x7f5f2c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 -- 172.21.15.81:0/2982284017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 msgr2=0x7f5f2c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c06ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 -- 172.21.15.81:0/2982284017 >> v2:172.21.15.136:3300/0 conn(0x7f5f2c0cb260 msgr2=0x7f5f2c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/2982284017 >> v2:172.21.15.136:3300/0 conn(0x7f5f2c0cb260 0x7f5f2c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 -- 172.21.15.81:0/2982284017 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c0ce6c0 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c068ed0 tx=0x7f5f1c02cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a38d33468af4f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f29d9b640 1 -- 172.21.15.81:0/2982284017 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c03a070 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.356+0000 7f5f29d9b640 1 -- 172.21.15.81:0/2982284017 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c02daf0 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f29d9b640 1 -- 172.21.15.81:0/2982284017 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c00b040 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 -- 172.21.15.81:0/2982284017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cd7c0 msgr2=0x7f5f2c0cad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c068ed0 tx=0x7f5f1c02cd40 comp rx=0 tx=0).stop 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 -- 172.21.15.81:0/2982284017 shutdown_connections 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 --2- 172.21.15.81:0/2982284017 >> v2:172.21.15.136:3300/0 conn(0x7f5f2c0cb260 0x7f5f2c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c0cad20 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 --2- 172.21.15.81:0/2982284017 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c06ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 -- 172.21.15.81:0/2982284017 >> 172.21.15.81:0/2982284017 conn(0x7f5f2c0cfbf0 msgr2=0x7f5f2c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 -- 172.21.15.81:0/2982284017 shutdown_connections 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.357+0000 7f5f31160640 1 -- 172.21.15.81:0/2982284017 wait complete. 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.358+0000 7f5f31160640 1 Processor -- start 2024-03-18T00:25:56.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 -- start start 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c1540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0cc260 con 0x7f5f2c0cb260 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c0ce9a0 con 0x7f5f2c0cd7c0 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f31160640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c0ce100 con 0x7f5f2c0ca940 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f2a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f2a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41114/0 (socket says 172.21.15.81:41114) 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f2a59c640 1 -- 172.21.15.81:0/447327552 learned_addr learned my addr 172.21.15.81:0/447327552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f2b59e640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.359+0000 7f5f2ad9d640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c1540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 -- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 msgr2=0x7f5f2c1540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c1540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 -- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c0cd7c0 msgr2=0x7f5f2c158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 -- 172.21.15.81:0/447327552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c159760 con 0x7f5f2c0cb260 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f2a59c640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c038040 tx=0x7f5f1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c043070 con 0x7f5f2c0cb260 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c02d8f0 con 0x7f5f2c0cb260 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1c03a030 con 0x7f5f2c0cb260 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c159a40 con 0x7f5f2c0cb260 2024-03-18T00:25:56.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.360+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c15a2e0 con 0x7f5f2c0cb260 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.361+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f2c159e30 con 0x7f5f2c0cb260 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.361+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5f1c046070 con 0x7f5f2c0cb260 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.362+0000 7f5f137fe640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.362+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5f1c0abcb0 con 0x7f5f2c0cb260 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.362+0000 7f5f2ad9d640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.362+0000 7f5f2ad9d640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 0x7f5f1806e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0afa20 tx=0x7f5f20009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.366+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5f1c07a150 con 0x7f5f2c0cb260 2024-03-18T00:25:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.541+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5f2c04f540 con 0x7f5f2c0cb260 2024-03-18T00:25:56.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.541+0000 7f5f137fe640 1 -- 172.21.15.81:0/447327552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5f1c07e1f0 con 0x7f5f2c0cb260 2024-03-18T00:25:56.542 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 msgr2=0x7f5f1806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 0x7f5f1806e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c0afa20 tx=0x7f5f20009190 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 msgr2=0x7f5f2c0b52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5f1c038040 tx=0x7f5f1c004730 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 shutdown_connections 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f2c0cd7c0 0x7f5f2c158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5f1806bbd0 0x7f5f1806e090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f2c0cb260 0x7f5f2c0b52e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 --2- 172.21.15.81:0/447327552 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f2c0ca940 0x7f5f2c1540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 >> 172.21.15.81:0/447327552 conn(0x7f5f2c0cfbf0 msgr2=0x7f5f2c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 shutdown_connections 2024-03-18T00:25:56.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.543+0000 7f5f31160640 1 -- 172.21.15.81:0/447327552 wait complete. 2024-03-18T00:25:56.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.657+0000 7f85f747e640 1 Processor -- start 2024-03-18T00:25:56.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 -- start start 2024-03-18T00:25:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00ceee0 0x7f85f006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f85f00d0c50 0x7f85f00cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85f00cf2c0 con 0x7f85f006d000 2024-03-18T00:25:56.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f85f0161c70 con 0x7f85f00d0c50 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f747e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f85f00d1590 con 0x7f85f00ceee0 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f4a19640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f85f006d000 0x7f85f00d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37612/0 (socket says 172.21.15.81:37612) 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f4a19640 1 -- 172.21.15.81:0/1397541256 learned_addr learned my addr 172.21.15.81:0/1397541256 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f5a1b640 1 --2- 172.21.15.81:0/1397541256 >> v2:172.21.15.136:3300/0 conn(0x7f85f00d0c50 0x7f85f00cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.658+0000 7f85f521a640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00ceee0 0x7f85f006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85e7fff640 1 -- 172.21.15.81:0/1397541256 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339154021 0 0) 0x7f85f00cf2c0 con 0x7f85f006d000 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85e7fff640 1 -- 172.21.15.81:0/1397541256 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85dc003520 con 0x7f85f006d000 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85f5a1b640 1 -- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00ceee0 msgr2=0x7f85f006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85f5a1b640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00ceee0 0x7f85f006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85f5a1b640 1 -- 172.21.15.81:0/1397541256 >> v1:172.21.15.81:6789/0 conn(0x7f85f006d000 legacy=0x7f85f00d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.659+0000 7f85f5a1b640 1 -- 172.21.15.81:0/1397541256 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f006d440 con 0x7f85f00d0c50 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f5a1b640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f00d0c50 0x7f85f00cd090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85e80097a0 tx=0x7f85e802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc3b825add011b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85e7fff640 1 -- 172.21.15.81:0/1397541256 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e80315a0 con 0x7f85f00d0c50 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85e7fff640 1 -- 172.21.15.81:0/1397541256 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e8037070 con 0x7f85f00d0c50 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85e7fff640 1 -- 172.21.15.81:0/1397541256 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8031960 con 0x7f85f00d0c50 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 -- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f00d0c50 msgr2=0x7f85f00cd090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f00d0c50 0x7f85f00cd090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f85e80097a0 tx=0x7f85e802b840 comp rx=0 tx=0).stop 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 -- 172.21.15.81:0/1397541256 shutdown_connections 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f00d0c50 0x7f85f00cd090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 --2- 172.21.15.81:0/1397541256 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00ceee0 0x7f85f006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 -- 172.21.15.81:0/1397541256 >> 172.21.15.81:0/1397541256 conn(0x7f85f009b160 msgr2=0x7f85f00d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 -- 172.21.15.81:0/1397541256 shutdown_connections 2024-03-18T00:25:56.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.660+0000 7f85f747e640 1 -- 172.21.15.81:0/1397541256 wait complete. 2024-03-18T00:25:56.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 Processor -- start 2024-03-18T00:25:56.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 -- start start 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f006d000 0x7f85f0152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00d0c50 0x7f85f0153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00cc5b0 con 0x7f85f00ceee0 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f85f00ccc00 con 0x7f85f006d000 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f747e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f85f00cc890 con 0x7f85f00d0c50 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f4a19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f4a19640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41116/0 (socket says 172.21.15.81:41116) 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.662+0000 7f85f4a19640 1 -- 172.21.15.81:0/3241671172 learned_addr learned my addr 172.21.15.81:0/3241671172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f5a1b640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00d0c50 0x7f85f0153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f521a640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f006d000 0x7f85f0152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 -- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00d0c50 msgr2=0x7f85f0153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00d0c50 0x7f85f0153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 -- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f006d000 msgr2=0x7f85f0152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f006d000 0x7f85f0152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 -- 172.21.15.81:0/3241671172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f00b1600 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f4a19640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0017070 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85e0005ce0 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e0007330 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f00b18e0 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.663+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f00b1ea0 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.664+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85f004f540 con 0x7f85f00ceee0 2024-03-18T00:25:56.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.665+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f85e001a070 con 0x7f85f00ceee0 2024-03-18T00:25:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.665+0000 7f85e5ffb640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 0x7f85d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.665+0000 7f85f521a640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 0x7f85d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.665+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f85e0089db0 con 0x7f85f00ceee0 2024-03-18T00:25:56.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.665+0000 7f85f521a640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 0x7f85d406e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0113e0 tx=0x7f85ec00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.669+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f85e00583a0 con 0x7f85f00ceee0 2024-03-18T00:25:56.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.842+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f85f0160940 con 0x7f85f00ceee0 2024-03-18T00:25:56.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.843+0000 7f85e5ffb640 1 -- 172.21.15.81:0/3241671172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f85e005c440 con 0x7f85f00ceee0 2024-03-18T00:25:56.843 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:56.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 msgr2=0x7f85d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 0x7f85d406e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f85ec0113e0 tx=0x7f85ec00b040 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 msgr2=0x7f85f0153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f85e000c500 tx=0x7f85e000c9c0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 shutdown_connections 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f85f00d0c50 0x7f85f0153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f85d406bbd0 0x7f85d406e090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85f00ceee0 0x7f85f0153140 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 --2- 172.21.15.81:0/3241671172 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f85f006d000 0x7f85f0152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 >> 172.21.15.81:0/3241671172 conn(0x7f85f009b160 msgr2=0x7f85f00d0060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 shutdown_connections 2024-03-18T00:25:56.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.845+0000 7f85f747e640 1 -- 172.21.15.81:0/3241671172 wait complete. 2024-03-18T00:25:56.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.958+0000 7f4b82c30640 1 Processor -- start 2024-03-18T00:25:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 -- start start 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 0x7f4b7c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0cebe0 0x7f4b7c0d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c0cc470 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c0cf010 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b82c30640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c06cf40 con 0x7f4b7c0cebe0 2024-03-18T00:25:56.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b7bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b7bfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41122/0 (socket says 172.21.15.81:41122) 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.959+0000 7f4b7bfff640 1 -- 172.21.15.81:0/256345584 learned_addr learned my addr 172.21.15.81:0/256345584 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b809cc640 1 --2- 172.21.15.81:0/256345584 >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 0x7f4b7c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b811cd640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0cebe0 0x7f4b7c0d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 -- 172.21.15.81:0/256345584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0cebe0 msgr2=0x7f4b7c0d0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0cebe0 0x7f4b7c0d0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 -- 172.21.15.81:0/256345584 >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 msgr2=0x7f4b7c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 --2- 172.21.15.81:0/256345584 >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 0x7f4b7c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 -- 172.21.15.81:0/256345584 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c06d220 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b809cc640 1 --2- 172.21.15.81:0/256345584 >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 0x7f4b7c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.960+0000 7f4b7bfff640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c072830 tx=0x7f4b7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25dd1f9e1919a7cf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b7b7fe640 1 -- 172.21.15.81:0/256345584 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70034070 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b7b7fe640 1 -- 172.21.15.81:0/256345584 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b70030860 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b7b7fe640 1 -- 172.21.15.81:0/256345584 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b70030c30 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 -- 172.21.15.81:0/256345584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c0b34b0 msgr2=0x7f4b7c0ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c072830 tx=0x7f4b7002b9a0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 -- 172.21.15.81:0/256345584 shutdown_connections 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0cebe0 0x7f4b7c0d0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 --2- 172.21.15.81:0/256345584 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c0b34b0 0x7f4b7c0ce6a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 --2- 172.21.15.81:0/256345584 >> v2:172.21.15.136:3300/0 conn(0x7f4b7c15e3f0 0x7f4b7c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 -- 172.21.15.81:0/256345584 >> 172.21.15.81:0/256345584 conn(0x7f4b7c0d1e20 msgr2=0x7f4b7c0d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 -- 172.21.15.81:0/256345584 shutdown_connections 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.961+0000 7f4b82c30640 1 -- 172.21.15.81:0/256345584 wait complete. 2024-03-18T00:25:56.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.962+0000 7f4b82c30640 1 Processor -- start 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.962+0000 7f4b82c30640 1 -- start start 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0b34b0 0x7f4b7c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 0x7f4b7c1f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d13a0 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c06d7e0 con 0x7f4b7c0cebe0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b82c30640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0d1520 con 0x7f4b7c0b34b0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b811cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b811cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41132/0 (socket says 172.21.15.81:41132) 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b811cd640 1 -- 172.21.15.81:0/3942755579 learned_addr learned my addr 172.21.15.81:0/3942755579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b809cc640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0b34b0 0x7f4b7c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.963+0000 7f4b7bfff640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 0x7f4b7c1f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 -- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0b34b0 msgr2=0x7f4b7c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0b34b0 0x7f4b7c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 -- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 msgr2=0x7f4b7c1f4c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 0x7f4b7c1f4c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 -- 172.21.15.81:0/3942755579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c1f5160 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b7bfff640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 0x7f4b7c1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b811cd640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400ef00 tx=0x7f4b7400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b74018020 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b74014400 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b740147f0 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c0af670 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.964+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c0afc30 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.965+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c04f540 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.965+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4b74005d10 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.966+0000 7f4b797fa640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 0x7f4b6806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.966+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f4b7408b020 con 0x7f4b7c15e3f0 2024-03-18T00:25:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.966+0000 7f4b809cc640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 0x7f4b6806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:56.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.966+0000 7f4b809cc640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 0x7f4b6806e0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009560 tx=0x7f4b6c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:56.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:56.970+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4b74022070 con 0x7f4b7c15e3f0 2024-03-18T00:25:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.142+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4b7c0b15e0 con 0x7f4b7c15e3f0 2024-03-18T00:25:57.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.143+0000 7f4b797fa640 1 -- 172.21.15.81:0/3942755579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f4b7c1f5160 con 0x7f4b7c15e3f0 2024-03-18T00:25:57.143 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.144+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 msgr2=0x7f4b6806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.144+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 0x7f4b6806e0c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009560 tx=0x7f4b6c009190 comp rx=0 tx=0).stop 2024-03-18T00:25:57.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.144+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 msgr2=0x7f4b7c0b1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.144+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400ef00 tx=0x7f4b7400b480 comp rx=0 tx=0).stop 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 shutdown_connections 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4b6806bc00 0x7f4b6806e0c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b7c15e3f0 0x7f4b7c0b1800 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4b7c0cebe0 0x7f4b7c1f4c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 --2- 172.21.15.81:0/3942755579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4b7c0b34b0 0x7f4b7c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 >> 172.21.15.81:0/3942755579 conn(0x7f4b7c0d1e20 msgr2=0x7f4b7c06f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 shutdown_connections 2024-03-18T00:25:57.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.145+0000 7f4b82c30640 1 -- 172.21.15.81:0/3942755579 wait complete. 2024-03-18T00:25:57.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T00:25:57.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.257+0000 7fb7a56dc640 1 Processor -- start 2024-03-18T00:25:57.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.257+0000 7fb7a56dc640 1 -- start start 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a01622b0 0x7fb7a00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb7a0162690 0x7fb7a0162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a00cec80 0x7fb7a00cf110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a00d16c0 con 0x7fb7a01622b0 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a00d2660 con 0x7fb7a0162690 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb7a56dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00b3440 con 0x7fb7a00cec80 2024-03-18T00:25:57.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a01622b0 0x7fb7a00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb7a01622b0 0x7fb7a00d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41142/0 (socket says 172.21.15.81:41142) 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 -- 172.21.15.81:0/405288504 learned_addr learned my addr 172.21.15.81:0/405288504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79e7fc640 1 --2- 172.21.15.81:0/405288504 >> v2:172.21.15.136:3300/0 conn(0x7fb7a0162690 0x7fb7a0162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79f7fe640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a00cec80 0x7fb7a00cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 -- 172.21.15.81:0/405288504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a00cec80 msgr2=0x7fb7a00cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a00cec80 0x7fb7a00cf110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 -- 172.21.15.81:0/405288504 >> v2:172.21.15.136:3300/0 conn(0x7fb7a0162690 msgr2=0x7fb7a0162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 --2- 172.21.15.81:0/405288504 >> v2:172.21.15.136:3300/0 conn(0x7fb7a0162690 0x7fb7a0162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.258+0000 7fb79effd640 1 -- 172.21.15.81:0/405288504 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a00d20a0 con 0x7fb7a01622b0 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb79effd640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00d10d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb790009870 tx=0x7fb79002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543a78824494c5d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb79dffb640 1 -- 172.21.15.81:0/405288504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790038070 con 0x7fb7a01622b0 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb79dffb640 1 -- 172.21.15.81:0/405288504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb790031740 con 0x7fb7a01622b0 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb79dffb640 1 -- 172.21.15.81:0/405288504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79002f050 con 0x7fb7a01622b0 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb7a56dc640 1 -- 172.21.15.81:0/405288504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 msgr2=0x7fb7a00d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.259+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00d10d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb790009870 tx=0x7fb79002b7e0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 -- 172.21.15.81:0/405288504 shutdown_connections 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a00cec80 0x7fb7a00cf110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/405288504 >> v2:172.21.15.136:3300/0 conn(0x7fb7a0162690 0x7fb7a0162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/405288504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00d10d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 -- 172.21.15.81:0/405288504 >> 172.21.15.81:0/405288504 conn(0x7fb7a00d4070 msgr2=0x7fb7a00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 -- 172.21.15.81:0/405288504 shutdown_connections 2024-03-18T00:25:57.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.260+0000 7fb7a56dc640 1 -- 172.21.15.81:0/405288504 wait complete. 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.261+0000 7fb7a56dc640 1 Processor -- start 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.261+0000 7fb7a56dc640 1 -- start start 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a00cec80 0x7fb7a00ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a0162690 0x7fb7a015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a0163060 con 0x7fb7a01622b0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00d2ab0 con 0x7fb7a00cec80 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a01631e0 con 0x7fb7a0162690 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41148/0 (socket says 172.21.15.81:41148) 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 -- 172.21.15.81:0/4013295624 learned_addr learned my addr 172.21.15.81:0/4013295624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79effd640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a00cec80 0x7fb7a00ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79f7fe640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a0162690 0x7fb7a015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 -- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a0162690 msgr2=0x7fb7a015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a0162690 0x7fb7a015d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 -- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a00cec80 msgr2=0x7fb7a00ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a00cec80 0x7fb7a00ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 -- 172.21.15.81:0/4013295624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a00ce120 con 0x7fb7a01622b0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb79e7fc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb79400e9e0 tx=0x7fb79400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb794017070 con 0x7fb7a01622b0 2024-03-18T00:25:57.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb79400c9d0 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79400cdc0 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a00b38a0 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.262+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a00b3e60 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.263+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7a00d3060 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.264+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb79401a070 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.264+0000 7fb7877fe640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 0x7fb78c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.264+0000 7fb79effd640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 0x7fb78c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.264+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb79408aa50 con 0x7fb7a01622b0 2024-03-18T00:25:57.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.265+0000 7fb79effd640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 0x7fb78c06e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb790035000 tx=0x7fb790008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.269+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb7a00d3060 con 0x7fb7a01622b0 2024-03-18T00:25:57.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.453+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb7a004f5b0 con 0x7fb7a01622b0 2024-03-18T00:25:57.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.454+0000 7fb7877fe640 1 -- 172.21.15.81:0/4013295624 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fb7a00ce120 con 0x7fb7a01622b0 2024-03-18T00:25:57.454 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-03-18T00:25:57.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 msgr2=0x7fb78c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 0x7fb78c06e090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb790035000 tx=0x7fb790008030 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 msgr2=0x7fb7a00cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb79400e9e0 tx=0x7fb79400eea0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 shutdown_connections 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb7a0162690 0x7fb7a015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb78c06bbd0 0x7fb78c06e090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7a01622b0 0x7fb7a00cb140 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 --2- 172.21.15.81:0/4013295624 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb7a00cec80 0x7fb7a00ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 >> 172.21.15.81:0/4013295624 conn(0x7fb7a00d4070 msgr2=0x7fb7a00d4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 shutdown_connections 2024-03-18T00:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.456+0000 7fb7a56dc640 1 -- 172.21.15.81:0/4013295624 wait complete. 2024-03-18T00:25:57.467 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-18T00:25:57.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:57.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-18T00:25:57.496 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:25:57.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:57.496 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-18T00:25:57.562 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:57.562 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:57.578 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:57.578 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:57.633 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:25:57.633 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:57.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.831+0000 7f0acabf4640 1 Processor -- start 2024-03-18T00:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.831+0000 7f0acabf4640 1 -- start start 2024-03-18T00:25:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0acabf4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0ac40b0010 0x7f0ac40d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0acabf4640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac40cf690 con 0x7f0ac415c3a0 2024-03-18T00:25:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0acabf4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac40cd510 con 0x7f0ac415c780 2024-03-18T00:25:57.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0acabf4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0ac40cd7f0 con 0x7f0ac40b0010 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0ac8990640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0ac415c3a0 0x7f0ac40ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37628/0 (socket says 172.21.15.81:37628) 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.832+0000 7f0ac8990640 1 -- 172.21.15.81:0/3817268826 learned_addr learned my addr 172.21.15.81:0/3817268826 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071056087 0 0) 0x7f0ac40cf690 con 0x7f0ac415c3a0 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aac003520 con 0x7f0ac415c3a0 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 29899938 0 0) 0x7f0ac40cd510 con 0x7f0ac415c780 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac40cf690 con 0x7f0ac415c780 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3912494144 0 0) 0x7f0aac003520 con 0x7f0ac415c3a0 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 >> v2:172.21.15.136:3300/0 conn(0x7f0ac40b0010 msgr2=0x7f0ac40d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 --2- 172.21.15.81:0/3817268826 >> v2:172.21.15.136:3300/0 conn(0x7f0ac40b0010 0x7f0ac40d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 >> v1:172.21.15.136:6789/0 conn(0x7f0ac415c780 legacy=0x7f0ac40cef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac40cdad0 con 0x7f0ac415c3a0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f0ab4001670 con 0x7f0ac415c3a0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 >> v1:172.21.15.81:6789/0 conn(0x7f0ac415c3a0 legacy=0x7f0ac40ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac003bb0 0x7f0aac003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0aac004800 0x7f0aac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 0x7f0aac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40cd7f0 con 0x7f0aac0053c0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0aac00c230 con 0x7f0aac003bb0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0aac00c430 con 0x7f0aac004800 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 0x7f0aac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac8990640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac003bb0 0x7f0aac003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 -- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0aac004800 msgr2=0x7f0aac004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0aac004800 0x7f0aac004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 -- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac003bb0 msgr2=0x7f0aac003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:57.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac003bb0 0x7f0aac003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.833+0000 7f0ac9191640 1 -- 172.21.15.81:0/3817268826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aac003520 con 0x7f0aac0053c0 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.834+0000 7f0ac9191640 1 -- 172.21.15.81:0/3817268826 reap_dead start 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.834+0000 7f0ac9191640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 0x7f0aac00b9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009e40 tx=0x7f0aac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce938c4137a1755 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.834+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc009a10 con 0x7f0aac0053c0 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.834+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc006e50 con 0x7f0aac0053c0 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.834+0000 7f0ac37fe640 1 -- 172.21.15.81:0/3817268826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc003970 con 0x7f0aac0053c0 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 -- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 msgr2=0x7f0aac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 0x7f0aac00b9c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0abc009e40 tx=0x7f0aac005830 comp rx=0 tx=0).stop 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 -- 172.21.15.81:0/3817268826 shutdown_connections 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 --2- 172.21.15.81:0/3817268826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0aac0053c0 0x7f0aac00b9c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 -- 172.21.15.81:0/3817268826 >> 172.21.15.81:0/3817268826 conn(0x7f0ac40d1e60 msgr2=0x7f0ac40d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:57.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 -- 172.21.15.81:0/3817268826 shutdown_connections 2024-03-18T00:25:57.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.835+0000 7f0acabf4640 1 -- 172.21.15.81:0/3817268826 wait complete. 2024-03-18T00:25:57.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.836+0000 7f0acabf4640 1 Processor -- start 2024-03-18T00:25:57.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.836+0000 7f0acabf4640 1 -- start start 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac0053c0 0x7f0ac40b2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ac406de20 0x7f0ac41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40d2980 con 0x7f0ac40caf40 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac40ce590 con 0x7f0aac0053c0 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0acabf4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac40d2b00 con 0x7f0ac406de20 2024-03-18T00:25:57.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41166/0 (socket says 172.21.15.81:41166) 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 -- 172.21.15.81:0/327201230 learned_addr learned my addr 172.21.15.81:0/327201230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac8990640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac0053c0 0x7f0ac40b2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac3fff640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ac406de20 0x7f0ac41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 -- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ac406de20 msgr2=0x7f0ac41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ac406de20 0x7f0ac41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 -- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac0053c0 msgr2=0x7f0ac40b2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac0053c0 0x7f0ac40b2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 -- 172.21.15.81:0/327201230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac40b0840 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.837+0000 7f0ac9191640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0abc02c800 tx=0x7f0abc004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.838+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc043070 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.838+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0abc004450 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.838+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0abc004800 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.838+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac40b0b20 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.838+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac40b10e0 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.839+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac404f5b0 con 0x7f0ac40caf40 2024-03-18T00:25:57.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.839+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0abc046070 con 0x7f0ac40caf40 2024-03-18T00:25:57.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.839+0000 7f0ac17fa640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 0x7f0ab006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:57.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.840+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0abc0ac1c0 con 0x7f0ac40caf40 2024-03-18T00:25:57.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.840+0000 7f0ac8990640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 0x7f0ab006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:57.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.840+0000 7f0ac8990640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 0x7f0ab006e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001010 tx=0x7f0ab4000f80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:57.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:57.844+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0abc008070 con 0x7f0ac40caf40 2024-03-18T00:25:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.016+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ac40ce370 con 0x7f0ac40caf40 2024-03-18T00:25:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.017+0000 7f0ac17fa640 1 -- 172.21.15.81:0/327201230 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f0abc07a5d0 con 0x7f0ac40caf40 2024-03-18T00:25:58.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:58.018 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 msgr2=0x7f0ab006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 0x7f0ab006e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ab4001010 tx=0x7f0ab4000f80 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 msgr2=0x7f0ac40cb3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0abc02c800 tx=0x7f0abc004b50 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 shutdown_connections 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0ab006bbd0 0x7f0ab006e090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ac40caf40 0x7f0ac40cb3c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0ac406de20 0x7f0ac41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 --2- 172.21.15.81:0/327201230 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0aac0053c0 0x7f0ac40b2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 >> 172.21.15.81:0/327201230 conn(0x7f0ac40d1e60 msgr2=0x7f0ac40d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 shutdown_connections 2024-03-18T00:25:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.019+0000 7f0acabf4640 1 -- 172.21.15.81:0/327201230 wait complete. 2024-03-18T00:25:58.030 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:58.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:58.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.133+0000 7f85a1553640 1 Processor -- start 2024-03-18T00:25:58.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.133+0000 7f85a1553640 1 -- start start 2024-03-18T00:25:58.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f85a1553640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f859c0d1210 0x7f859c0d1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f85a1553640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c0b33b0 con 0x7f859c15e3b0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f85a1553640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c0d17f0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f85a1553640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f859c0cef00 con 0x7f859c0d1210 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f859c0d1210 0x7f859c0d1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859affd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f859c15e3b0 0x7f859c0b0c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37640/0 (socket says 172.21.15.81:37640) 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859affd640 1 -- 172.21.15.81:0/833150681 learned_addr learned my addr 172.21.15.81:0/833150681 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744447441 0 0) 0x7f858c001490 con 0x7f859c15e3b0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8584003520 con 0x7f859c15e3b0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275177383 0 0) 0x7f859c0d17f0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f858c001490 con 0x7f859c0cf9e0 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859a7fc640 1 -- 172.21.15.81:0/833150681 >> v1:172.21.15.136:6789/0 conn(0x7f859c0cf9e0 legacy=0x7f859c0d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859a7fc640 1 -- 172.21.15.81:0/833150681 >> v1:172.21.15.81:6789/0 conn(0x7f859c15e3b0 legacy=0x7f859c0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.134+0000 7f859a7fc640 1 -- 172.21.15.81:0/833150681 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c0cf1e0 con 0x7f859c0d1210 2024-03-18T00:25:58.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.135+0000 7f859a7fc640 1 --2- 172.21.15.81:0/833150681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d1210 0x7f859c0d1e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f85900097a0 tx=0x7f859002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af9a21c2a1ddf79 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.135+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590035020 con 0x7f859c0d1210 2024-03-18T00:25:58.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.135+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8590031830 con 0x7f859c0d1210 2024-03-18T00:25:58.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.135+0000 7f8599ffb640 1 -- 172.21.15.81:0/833150681 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8590031c00 con 0x7f859c0d1210 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 -- 172.21.15.81:0/833150681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d1210 msgr2=0x7f859c0d1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 --2- 172.21.15.81:0/833150681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d1210 0x7f859c0d1e80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f85900097a0 tx=0x7f859002b8d0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 -- 172.21.15.81:0/833150681 shutdown_connections 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 --2- 172.21.15.81:0/833150681 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d1210 0x7f859c0d1e80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 -- 172.21.15.81:0/833150681 >> 172.21.15.81:0/833150681 conn(0x7f859c0d40a0 msgr2=0x7f859c0d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 -- 172.21.15.81:0/833150681 shutdown_connections 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.136+0000 7f85a1553640 1 -- 172.21.15.81:0/833150681 wait complete. 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.137+0000 7f85a1553640 1 Processor -- start 2024-03-18T00:25:58.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.137+0000 7f85a1553640 1 -- start start 2024-03-18T00:25:58.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 0x7f859c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f859c15e3b0 0x7f859c1f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f859c15e790 con 0x7f859c0cf9e0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0b1370 con 0x7f859c0d1210 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f85a1553640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f859c15e910 con 0x7f859c15e3b0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41178/0 (socket says 172.21.15.81:41178) 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 -- 172.21.15.81:0/4291555010 learned_addr learned my addr 172.21.15.81:0/4291555010 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859a7fc640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 0x7f859c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859b7fe640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f859c15e3b0 0x7f859c1f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 -- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f859c15e3b0 msgr2=0x7f859c1f7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f859c15e3b0 0x7f859c1f7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 -- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 msgr2=0x7f859c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 0x7f859c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 -- 172.21.15.81:0/4291555010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c1f7650 con 0x7f859c0cf9e0 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859a7fc640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 0x7f859c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:58.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.138+0000 7f859affd640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f858c001f70 tx=0x7f858c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.139+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c017070 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.139+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858c012400 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.139+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0127b0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.139+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c0c9b00 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.139+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c0ca0c0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.140+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c04f540 con 0x7f859c0cf9e0 2024-03-18T00:25:58.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.140+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f858c01a070 con 0x7f859c0cf9e0 2024-03-18T00:25:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.141+0000 7f85837fe640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 0x7f858806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.141+0000 7f859a7fc640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 0x7f858806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.141+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f858c08a910 con 0x7f859c0cf9e0 2024-03-18T00:25:58.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.141+0000 7f859a7fc640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 0x7f858806e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8590036000 tx=0x7f859003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.145+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f859c0b33b0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.316+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f859c0686b0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.317+0000 7f85837fe640 1 -- 172.21.15.81:0/4291555010 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f858c058db0 con 0x7f859c0cf9e0 2024-03-18T00:25:58.318 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 msgr2=0x7f858806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 0x7f858806e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8590036000 tx=0x7f859003c040 comp rx=0 tx=0).stop 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 msgr2=0x7f859c0c9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f858c001f70 tx=0x7f858c00a430 comp rx=0 tx=0).stop 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 shutdown_connections 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f859c15e3b0 0x7f859c1f7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f859c0d1210 0x7f859c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f858806bbd0 0x7f858806e090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 --2- 172.21.15.81:0/4291555010 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0cf9e0 0x7f859c0c9420 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 >> 172.21.15.81:0/4291555010 conn(0x7f859c0d40a0 msgr2=0x7f859c0d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 shutdown_connections 2024-03-18T00:25:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.319+0000 7f85a1553640 1 -- 172.21.15.81:0/4291555010 wait complete. 2024-03-18T00:25:58.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:25:58.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.432+0000 7f931f11d640 1 Processor -- start 2024-03-18T00:25:58.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.432+0000 7f931f11d640 1 -- start start 2024-03-18T00:25:58.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931f11d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f93180b1ea0 0x7f93180d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931f11d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93180ce2d0 con 0x7f93180cdef0 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931f11d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931806c970 con 0x7f931806c490 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931f11d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f931806cc50 con 0x7f93180b1ea0 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931ceb9640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f93180cdef0 0x7f93180b1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37652/0 (socket says 172.21.15.81:37652) 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931ceb9640 1 -- 172.21.15.81:0/2980206008 learned_addr learned my addr 172.21.15.81:0/2980206008 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.433+0000 7f931d6ba640 1 --2- 172.21.15.81:0/2980206008 >> v2:172.21.15.136:3300/0 conn(0x7f93180b1ea0 0x7f93180d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 166258291 0 0) 0x7f93180ce2d0 con 0x7f93180cdef0 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9300003520 con 0x7f93180cdef0 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688854785 0 0) 0x7f931806c970 con 0x7f931806c490 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93180ce2d0 con 0x7f931806c490 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f931d6ba640 1 -- 172.21.15.81:0/2980206008 >> v1:172.21.15.136:6789/0 conn(0x7f931806c490 legacy=0x7f93180d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f931d6ba640 1 -- 172.21.15.81:0/2980206008 >> v1:172.21.15.81:6789/0 conn(0x7f93180cdef0 legacy=0x7f93180b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f931d6ba640 1 -- 172.21.15.81:0/2980206008 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931806cf30 con 0x7f93180b1ea0 2024-03-18T00:25:58.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.434+0000 7f931d6ba640 1 --2- 172.21.15.81:0/2980206008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93180b1ea0 0x7f93180d29c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9310009d90 tx=0x7f931002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a60404798b762f1a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310039070 con 0x7f93180b1ea0 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f931002cd00 con 0x7f93180b1ea0 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f93177fe640 1 -- 172.21.15.81:0/2980206008 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9310034660 con 0x7f93180b1ea0 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 -- 172.21.15.81:0/2980206008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93180b1ea0 msgr2=0x7f93180d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 --2- 172.21.15.81:0/2980206008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93180b1ea0 0x7f93180d29c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9310009d90 tx=0x7f931002bf50 comp rx=0 tx=0).stop 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 -- 172.21.15.81:0/2980206008 shutdown_connections 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 --2- 172.21.15.81:0/2980206008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f93180b1ea0 0x7f93180d29c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 -- 172.21.15.81:0/2980206008 >> 172.21.15.81:0/2980206008 conn(0x7f93180d1ea0 msgr2=0x7f93180d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 -- 172.21.15.81:0/2980206008 shutdown_connections 2024-03-18T00:25:58.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.435+0000 7f931f11d640 1 -- 172.21.15.81:0/2980206008 wait complete. 2024-03-18T00:25:58.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.436+0000 7f931f11d640 1 Processor -- start 2024-03-18T00:25:58.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.436+0000 7f931f11d640 1 -- start start 2024-03-18T00:25:58.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f931806c490 0x7f93180706e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93180cdef0 0x7f9318153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93180b31f0 con 0x7f93180b1ea0 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f931806d4f0 con 0x7f931806c490 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931f11d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f93180cc4f0 con 0x7f93180cdef0 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f9317fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f9317fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41194/0 (socket says 172.21.15.81:41194) 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f9317fff640 1 -- 172.21.15.81:0/3421320522 learned_addr learned my addr 172.21.15.81:0/3421320522 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931ceb9640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f931806c490 0x7f93180706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.437+0000 7f931d6ba640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93180cdef0 0x7f9318153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 -- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93180cdef0 msgr2=0x7f9318153380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93180cdef0 0x7f9318153380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 -- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f931806c490 msgr2=0x7f93180706e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f931806c490 0x7f93180706e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 -- 172.21.15.81:0/3421320522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93180b5ba0 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f9317fff640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f930c00c480 tx=0x7f930c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c0052d0 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f930c005470 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93180b4b00 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f930c012870 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.438+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93180b50c0 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.439+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931804f540 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.439+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f930c012a10 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.440+0000 7f93157fa640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 0x7f930406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.440+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f930c08a5a0 con 0x7f93180b1ea0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.440+0000 7f931ceb9640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 0x7f930406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.440+0000 7f931ceb9640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 0x7f930406e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9308000f60 tx=0x7f9308007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.444+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f930c058b90 con 0x7f93180b1ea0 2024-03-18T00:25:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.615+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f93180b3770 con 0x7f93180b1ea0 2024-03-18T00:25:58.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.616+0000 7f93157fa640 1 -- 172.21.15.81:0/3421320522 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f930c05cc30 con 0x7f93180b1ea0 2024-03-18T00:25:58.616 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:25:58.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.617+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 msgr2=0x7f930406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.617+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 0x7f930406e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f9308000f60 tx=0x7f9308007d70 comp rx=0 tx=0).stop 2024-03-18T00:25:58.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.617+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 msgr2=0x7f9318152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.617+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f930c00c480 tx=0x7f930c00c940 comp rx=0 tx=0).stop 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 shutdown_connections 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f93180cdef0 0x7f9318153380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f930406bbd0 0x7f930406e090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93180b1ea0 0x7f9318152e40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 --2- 172.21.15.81:0/3421320522 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f931806c490 0x7f93180706e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 >> 172.21.15.81:0/3421320522 conn(0x7f93180d1ea0 msgr2=0x7f931806f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 shutdown_connections 2024-03-18T00:25:58.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.618+0000 7f931f11d640 1 -- 172.21.15.81:0/3421320522 wait complete. 2024-03-18T00:25:58.629 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:25:58.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.731+0000 7f2cb7ed1640 1 Processor -- start 2024-03-18T00:25:58.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.731+0000 7f2cb7ed1640 1 -- start start 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb7ed1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb006b1c0 0x7f2cb006b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb7ed1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cb015da20 0x7f2cb015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb7ed1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cb0071ee0 con 0x7f2cb00b0150 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb7ed1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f2cb0072af0 con 0x7f2cb015da20 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb7ed1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb006bb60 con 0x7f2cb006b1c0 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb646e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cb015da20 0x7f2cb015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb646e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f2cb015da20 0x7f2cb015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41198/0 (socket says 172.21.15.81:41198) 2024-03-18T00:25:58.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb646e640 1 -- 172.21.15.81:0/2081574628 learned_addr learned my addr 172.21.15.81:0/2081574628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.732+0000 7f2cb546c640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb006b1c0 0x7f2cb006b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.733+0000 7f2cb646e640 1 -- 172.21.15.81:0/2081574628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb006b1c0 msgr2=0x7f2cb006b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.733+0000 7f2cb646e640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb006b1c0 0x7f2cb006b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.733+0000 7f2cb646e640 1 -- 172.21.15.81:0/2081574628 >> v1:172.21.15.136:6789/0 conn(0x7f2cb00b0150 legacy=0x7f2cb00ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.733+0000 7f2cb646e640 1 -- 172.21.15.81:0/2081574628 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00721c0 con 0x7f2cb015da20 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.733+0000 7f2cb646e640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015da20 0x7f2cb015de80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd4745d62f93f91 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb4c6b640 1 -- 172.21.15.81:0/2081574628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8035020 con 0x7f2cb015da20 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb4c6b640 1 -- 172.21.15.81:0/2081574628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca8031640 con 0x7f2cb015da20 2024-03-18T00:25:58.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb4c6b640 1 -- 172.21.15.81:0/2081574628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca802d040 con 0x7f2cb015da20 2024-03-18T00:25:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/2081574628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015da20 msgr2=0x7f2cb015de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015da20 0x7f2cb015de80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8009870 tx=0x7f2ca802b8f0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/2081574628 shutdown_connections 2024-03-18T00:25:58.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb015da20 0x7f2cb015de80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/2081574628 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb006b1c0 0x7f2cb006b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/2081574628 >> 172.21.15.81:0/2081574628 conn(0x7f2cb00d0da0 msgr2=0x7f2cb00d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/2081574628 shutdown_connections 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.734+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/2081574628 wait complete. 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.735+0000 7f2cb7ed1640 1 Processor -- start 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.735+0000 7f2cb7ed1640 1 -- start start 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 0x7f2cb0153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb015da20 0x7f2cb015b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb00cf080 con 0x7f2cb00b0150 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f2cb0072780 con 0x7f2cb006b1c0 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb7ed1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f2cb00d0900 con 0x7f2cb015da20 2024-03-18T00:25:58.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41212/0 (socket says 172.21.15.81:41212) 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 -- 172.21.15.81:0/4191320694 learned_addr learned my addr 172.21.15.81:0/4191320694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb646e640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb015da20 0x7f2cb015b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb5c6d640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 0x7f2cb0153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 -- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb015da20 msgr2=0x7f2cb015b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb015da20 0x7f2cb015b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 -- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 msgr2=0x7f2cb0153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.736+0000 7f2cb546c640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 0x7f2cb0153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2cb546c640 1 -- 172.21.15.81:0/4191320694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cb00caa80 con 0x7f2cb00b0150 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2cb5c6d640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 0x7f2cb0153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2cb546c640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e9e0 tx=0x7f2ca000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0017070 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ca000c9d0 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cb01f4b40 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000cdc0 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.737+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cb00c8ec0 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.738+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cb004f540 con 0x7f2cb00b0150 2024-03-18T00:25:58.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.738+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2ca001a070 con 0x7f2cb00b0150 2024-03-18T00:25:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.738+0000 7f2ca67fc640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 0x7f2c9406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.739+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f2ca008aa50 con 0x7f2cb00b0150 2024-03-18T00:25:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.739+0000 7f2cb5c6d640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 0x7f2c9406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.739+0000 7f2cb5c6d640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 0x7f2c9406e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2cac001e00 tx=0x7f2cac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:58.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.743+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2ca0058ef0 con 0x7f2cb00b0150 2024-03-18T00:25:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.915+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f2cb00cc5d0 con 0x7f2cb00b0150 2024-03-18T00:25:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.916+0000 7f2ca67fc640 1 -- 172.21.15.81:0/4191320694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f2ca005cf90 con 0x7f2cb00b0150 2024-03-18T00:25:58.920 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 msgr2=0x7f2c9406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 0x7f2c9406e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f2cac001e00 tx=0x7f2cac009040 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 msgr2=0x7f2cb00c99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000e9e0 tx=0x7f2ca000eea0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 shutdown_connections 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f2cb015da20 0x7f2cb015b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f2c9406bbd0 0x7f2c9406e090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cb00b0150 0x7f2cb00c99a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 --2- 172.21.15.81:0/4191320694 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f2cb006b1c0 0x7f2cb0153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 >> 172.21.15.81:0/4191320694 conn(0x7f2cb00d0da0 msgr2=0x7f2cb00b0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:58.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 shutdown_connections 2024-03-18T00:25:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:58.918+0000 7f2cb7ed1640 1 -- 172.21.15.81:0/4191320694 wait complete. 2024-03-18T00:25:58.929 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T00:25:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.029+0000 7fe61735b640 1 Processor -- start 2024-03-18T00:25:59.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 -- start start 2024-03-18T00:25:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 0x7fe6100ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6100d07f0 0x7fe6100722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe61015ee60 con 0x7fe6100b3400 2024-03-18T00:25:59.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe61015f140 con 0x7fe6100d07f0 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.030+0000 7fe61735b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe61015f420 con 0x7fe61015ad40 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6100d07f0 0x7fe6100722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe6100d07f0 0x7fe6100722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41216/0 (socket says 172.21.15.81:41216) 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 -- 172.21.15.81:0/3601442303 learned_addr learned my addr 172.21.15.81:0/3601442303 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6150f7640 1 --2- 172.21.15.81:0/3601442303 >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 0x7fe6100ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 -- 172.21.15.81:0/3601442303 >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 msgr2=0x7fe6100ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 --2- 172.21.15.81:0/3601442303 >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 0x7fe6100ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 -- 172.21.15.81:0/3601442303 >> v1:172.21.15.136:6789/0 conn(0x7fe6100b3400 legacy=0x7fe6100d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6158f8640 1 -- 172.21.15.81:0/3601442303 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61015f700 con 0x7fe6100d07f0 2024-03-18T00:25:59.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.031+0000 7fe6150f7640 1 --2- 172.21.15.81:0/3601442303 >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 0x7fe6100ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe6158f8640 1 --2- 172.21.15.81:0/3601442303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100d07f0 0x7fe6100722c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe610071130 tx=0x7fe60c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e662b71f1c53bf8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe607fff640 1 -- 172.21.15.81:0/3601442303 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c02ca80 con 0x7fe6100d07f0 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe607fff640 1 -- 172.21.15.81:0/3601442303 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60c02cc20 con 0x7fe6100d07f0 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe607fff640 1 -- 172.21.15.81:0/3601442303 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60c0343f0 con 0x7fe6100d07f0 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 -- 172.21.15.81:0/3601442303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100d07f0 msgr2=0x7fe6100722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 --2- 172.21.15.81:0/3601442303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100d07f0 0x7fe6100722c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe610071130 tx=0x7fe60c02bee0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 -- 172.21.15.81:0/3601442303 shutdown_connections 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 --2- 172.21.15.81:0/3601442303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100d07f0 0x7fe6100722c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 --2- 172.21.15.81:0/3601442303 >> v2:172.21.15.136:3300/0 conn(0x7fe61015ad40 0x7fe6100ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 -- 172.21.15.81:0/3601442303 >> 172.21.15.81:0/3601442303 conn(0x7fe61006b5e0 msgr2=0x7fe61006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 -- 172.21.15.81:0/3601442303 shutdown_connections 2024-03-18T00:25:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.032+0000 7fe61735b640 1 -- 172.21.15.81:0/3601442303 wait complete. 2024-03-18T00:25:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.033+0000 7fe61735b640 1 Processor -- start 2024-03-18T00:25:59.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.033+0000 7fe61735b640 1 -- start start 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6100d07f0 0x7fe610149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 0x7fe61006dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe61015eb90 con 0x7fe6100b3400 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe61015ea10 con 0x7fe61015ad40 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe61735b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe6100b3860 con 0x7fe6100d07f0 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe6150f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe6150f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41226/0 (socket says 172.21.15.81:41226) 2024-03-18T00:25:59.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe6150f7640 1 -- 172.21.15.81:0/1306079955 learned_addr learned my addr 172.21.15.81:0/1306079955 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe6158f8640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 0x7fe61006dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.034+0000 7fe6148f6640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6100d07f0 0x7fe610149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 -- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6100d07f0 msgr2=0x7fe610149e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6100d07f0 0x7fe610149e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 -- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 msgr2=0x7fe61006dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 0x7fe61006dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 -- 172.21.15.81:0/1306079955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe61009c270 con 0x7fe6100b3400 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6158f8640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 0x7fe61006dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe6150f7640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e960 tx=0x7fe60800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe608017070 con 0x7fe6100b3400 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe60800ca00 con 0x7fe6100b3400 2024-03-18T00:25:59.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe61009c550 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe60800cdd0 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.035+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe610167c50 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.036+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe61009cc60 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.036+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe60801a070 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.037+0000 7fe605ffb640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 0x7fe5f406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.037+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fe60808acf0 con 0x7fe6100b3400 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.037+0000 7fe6148f6640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 0x7fe5f406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.037+0000 7fe6148f6640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 0x7fe5f406e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe61006ea50 tx=0x7fe600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.041+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe60808f070 con 0x7fe6100b3400 2024-03-18T00:25:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.226+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe61004f5b0 con 0x7fe6100b3400 2024-03-18T00:25:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.226+0000 7fe605ffb640 1 -- 172.21.15.81:0/1306079955 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fe6080597e0 con 0x7fe6100b3400 2024-03-18T00:25:59.227 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 msgr2=0x7fe5f406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 0x7fe5f406e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe61006ea50 tx=0x7fe600009040 comp rx=0 tx=0).stop 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 msgr2=0x7fe610167710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe60800e960 tx=0x7fe60800ee20 comp rx=0 tx=0).stop 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 shutdown_connections 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe61015ad40 0x7fe61006dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe6100d07f0 0x7fe610149e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe5f406bbd0 0x7fe5f406e090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 --2- 172.21.15.81:0/1306079955 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe6100b3400 0x7fe610167710 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 >> 172.21.15.81:0/1306079955 conn(0x7fe61006b5e0 msgr2=0x7fe61015b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 shutdown_connections 2024-03-18T00:25:59.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.228+0000 7fe61735b640 1 -- 172.21.15.81:0/1306079955 wait complete. 2024-03-18T00:25:59.240 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-18T00:25:59.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:59.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-18T00:25:59.268 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T00:25:59.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:25:59.268 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-18T00:25:59.323 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:59.323 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:59.338 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:59.338 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:59.393 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T00:25:59.393 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:25:59.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:25:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.547+0000 7f6c6e2b2640 1 Processor -- start 2024-03-18T00:25:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.547+0000 7f6c6e2b2640 1 -- start start 2024-03-18T00:25:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.547+0000 7f6c6e2b2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 0x7f6c680ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.547+0000 7f6c6e2b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.547+0000 7f6c6e2b2640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c6815ee60 con 0x7f6c680b3400 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6e2b2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6c6815f140 con 0x7f6c6815ad40 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6e2b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6815f420 con 0x7f6c680d07f0 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c67fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 0x7f6c680ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:36834/0 (socket says 172.21.15.81:36834) 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c677fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f6c680b3400 0x7f6c680d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:54296/0 (socket says 172.21.15.81:54296) 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 -- 172.21.15.81:0/1427768697 learned_addr learned my addr 172.21.15.81:0/1427768697 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 -- 172.21.15.81:0/1427768697 >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 msgr2=0x7f6c680ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 --2- 172.21.15.81:0/1427768697 >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 0x7f6c680ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 -- 172.21.15.81:0/1427768697 >> v1:172.21.15.136:6789/0 conn(0x7f6c680b3400 legacy=0x7f6c680d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c6c84f640 1 -- 172.21.15.81:0/1427768697 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6815f700 con 0x7f6c680d07f0 2024-03-18T00:25:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.548+0000 7f6c67fff640 1 --2- 172.21.15.81:0/1427768697 >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 0x7f6c680ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.549+0000 7f6c6c84f640 1 --2- 172.21.15.81:0/1427768697 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009e50 tx=0x7f6c6002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fb2d597ccff3a2a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.549+0000 7f6c66ffd640 1 -- 172.21.15.81:0/1427768697 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6002ca70 con 0x7f6c680d07f0 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.549+0000 7f6c66ffd640 1 -- 172.21.15.81:0/1427768697 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c6002cc10 con 0x7f6c680d07f0 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.549+0000 7f6c66ffd640 1 -- 172.21.15.81:0/1427768697 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c600343f0 con 0x7f6c680d07f0 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/1427768697 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 msgr2=0x7f6c680722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/1427768697 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009e50 tx=0x7f6c6002bed0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/1427768697 shutdown_connections 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/1427768697 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c680d07f0 0x7f6c680722c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/1427768697 >> v2:172.21.15.136:3300/0 conn(0x7f6c6815ad40 0x7f6c680ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/1427768697 >> 172.21.15.81:0/1427768697 conn(0x7f6c6806b5e0 msgr2=0x7f6c6806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/1427768697 shutdown_connections 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.550+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/1427768697 wait complete. 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.551+0000 7f6c6e2b2640 1 Processor -- start 2024-03-18T00:25:59.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.551+0000 7f6c6e2b2640 1 -- start start 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c680b3400 0x7f6c681e5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c6815ad40 0x7f6c68149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6815eb90 con 0x7f6c680d07f0 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6815ea10 con 0x7f6c680b3400 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6c680b3860 con 0x7f6c6815ad40 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c67fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c680b3400 0x7f6c681e5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41242/0 (socket says 172.21.15.81:41242) 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 -- 172.21.15.81:0/107055944 learned_addr learned my addr 172.21.15.81:0/107055944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6c84f640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c6815ad40 0x7f6c68149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 -- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c6815ad40 msgr2=0x7f6c68149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c6815ad40 0x7f6c68149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 -- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c680b3400 msgr2=0x7f6c681e5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c680b3400 0x7f6c681e5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 -- 172.21.15.81:0/107055944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c680b0110 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c677fe640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c400 tx=0x7f6c5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c0074e0 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c5c007680 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c680b03f0 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c004a00 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.552+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c680b09b0 con 0x7f6c680d07f0 2024-03-18T00:25:59.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.553+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6804f5b0 con 0x7f6c680d07f0 2024-03-18T00:25:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.554+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6c5c01a020 con 0x7f6c680d07f0 2024-03-18T00:25:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.554+0000 7f6c64ff9640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 0x7f6c5406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.554+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c08a140 con 0x7f6c680d07f0 2024-03-18T00:25:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.554+0000 7f6c67fff640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 0x7f6c5406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.555+0000 7f6c67fff640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 0x7f6c5406e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009560 tx=0x7f6c58009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.559+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6c5c0585e0 con 0x7f6c680d07f0 2024-03-18T00:25:59.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.736+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c68071ad0 con 0x7f6c680d07f0 2024-03-18T00:25:59.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.737+0000 7f6c64ff9640 1 -- 172.21.15.81:0/107055944 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f6c5c05c680 con 0x7f6c680d07f0 2024-03-18T00:25:59.739 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:25:59.739 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:25:59.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 msgr2=0x7f6c5406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 0x7f6c5406e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6c58009560 tx=0x7f6c58009190 comp rx=0 tx=0).stop 2024-03-18T00:25:59.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 msgr2=0x7f6c680af9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00c400 tx=0x7f6c5c00c8c0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 shutdown_connections 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6c6815ad40 0x7f6c68149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6c5406bbd0 0x7f6c5406e090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c680d07f0 0x7f6c680af9a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 --2- 172.21.15.81:0/107055944 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6c680b3400 0x7f6c681e5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 >> 172.21.15.81:0/107055944 conn(0x7f6c6806b5e0 msgr2=0x7f6c6806e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 shutdown_connections 2024-03-18T00:25:59.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.739+0000 7f6c6e2b2640 1 -- 172.21.15.81:0/107055944 wait complete. 2024-03-18T00:25:59.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:25:59.751 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:25:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.854+0000 7ffb384c6640 1 Processor -- start 2024-03-18T00:25:59.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.854+0000 7ffb384c6640 1 -- start start 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb384c6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb3015c140 0x7ffb300d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb384c6640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffb300ce840 0x7ffb300ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb384c6640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb300cce20 con 0x7ffb300b7110 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb384c6640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ffb300cf1e0 con 0x7ffb300ce840 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb384c6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffb300cd100 con 0x7ffb3015c140 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb35a61640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffb300ce840 0x7ffb300ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb35a61640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ffb300ce840 0x7ffb300ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41250/0 (socket says 172.21.15.81:41250) 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.855+0000 7ffb35a61640 1 -- 172.21.15.81:0/1901394250 learned_addr learned my addr 172.21.15.81:0/1901394250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb36262640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb3015c140 0x7ffb300d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb35a61640 1 -- 172.21.15.81:0/1901394250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb3015c140 msgr2=0x7ffb300d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb35a61640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb3015c140 0x7ffb300d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb35a61640 1 -- 172.21.15.81:0/1901394250 >> v1:172.21.15.136:6789/0 conn(0x7ffb300b7110 legacy=0x7ffb300b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb35a61640 1 -- 172.21.15.81:0/1901394250 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb300cd3e0 con 0x7ffb300ce840 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.856+0000 7ffb35a61640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb300ce840 0x7ffb300ceca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009870 tx=0x7ffb2002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf10f2cc475eb7d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb35260640 1 -- 172.21.15.81:0/1901394250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20034070 con 0x7ffb300ce840 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb35260640 1 -- 172.21.15.81:0/1901394250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb20030840 con 0x7ffb300ce840 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb35260640 1 -- 172.21.15.81:0/1901394250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb20030c10 con 0x7ffb300ce840 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 -- 172.21.15.81:0/1901394250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb300ce840 msgr2=0x7ffb300ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb300ce840 0x7ffb300ceca0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb20009870 tx=0x7ffb2002b980 comp rx=0 tx=0).stop 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 -- 172.21.15.81:0/1901394250 shutdown_connections 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb300ce840 0x7ffb300ceca0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1901394250 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb3015c140 0x7ffb300d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 -- 172.21.15.81:0/1901394250 >> 172.21.15.81:0/1901394250 conn(0x7ffb3009b160 msgr2=0x7ffb300d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:25:59.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 -- 172.21.15.81:0/1901394250 shutdown_connections 2024-03-18T00:25:59.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.857+0000 7ffb384c6640 1 -- 172.21.15.81:0/1901394250 wait complete. 2024-03-18T00:25:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.858+0000 7ffb384c6640 1 Processor -- start 2024-03-18T00:25:59.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 -- start start 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb300b7110 0x7ffb3009d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb300ce840 0x7ffb3009d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300b7cb0 con 0x7ffb3015c140 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ffb300cd9a0 con 0x7ffb300ce840 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb384c6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ffb300d0e00 con 0x7ffb300b7110 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb36a63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb36a63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41256/0 (socket says 172.21.15.81:41256) 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb36a63640 1 -- 172.21.15.81:0/1292347722 learned_addr learned my addr 172.21.15.81:0/1292347722 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb36262640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb300b7110 0x7ffb3009d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.859+0000 7ffb35a61640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb300ce840 0x7ffb3009d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 -- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb300b7110 msgr2=0x7ffb3009d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb300b7110 0x7ffb3009d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 -- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb300ce840 msgr2=0x7ffb3009d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb300ce840 0x7ffb3009d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 -- 172.21.15.81:0/1292347722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3009e810 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb36a63640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c390 tx=0x7ffb2800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28017070 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb280052d0 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3009eaf0 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28003810 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.860+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3009f0b0 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.861+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3004f540 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.861+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ffb2801a070 con 0x7ffb3015c140 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.862+0000 7ffb26ffd640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 0x7ffb1406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:25:59.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.862+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ffb28089c90 con 0x7ffb3015c140 2024-03-18T00:25:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.862+0000 7ffb36262640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 0x7ffb1406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:25:59.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.862+0000 7ffb36262640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 0x7ffb1406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0113e0 tx=0x7ffb2c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:25:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:25:59.866+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ffb280581c0 con 0x7ffb3015c140 2024-03-18T00:26:00.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.038+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ffb300cf4b0 con 0x7ffb3015c140 2024-03-18T00:26:00.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.038+0000 7ffb26ffd640 1 -- 172.21.15.81:0/1292347722 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7ffb2805c260 con 0x7ffb3015c140 2024-03-18T00:26:00.039 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:26:00.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 msgr2=0x7ffb1406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 0x7ffb1406e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0113e0 tx=0x7ffb2c00b040 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 msgr2=0x7ffb3009dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ffb2800c390 tx=0x7ffb2800c850 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 shutdown_connections 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ffb1406bbd0 0x7ffb1406e090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb3015c140 0x7ffb3009dec0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ffb300ce840 0x7ffb3009d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 --2- 172.21.15.81:0/1292347722 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ffb300b7110 0x7ffb3009d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 >> 172.21.15.81:0/1292347722 conn(0x7ffb3009b160 msgr2=0x7ffb300d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 shutdown_connections 2024-03-18T00:26:00.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.040+0000 7ffb384c6640 1 -- 172.21.15.81:0/1292347722 wait complete. 2024-03-18T00:26:00.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:26:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.153+0000 7f6ea409a640 1 Processor -- start 2024-03-18T00:26:00.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.154+0000 7f6ea409a640 1 -- start start 2024-03-18T00:26:00.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.154+0000 7f6ea409a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c145700 0x7f6e9c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.154+0000 7f6ea409a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e9c160170 0x7f6e9c0cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea409a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0cb790 con 0x7f6e9c072d40 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea409a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f6e9c0cd7c0 con 0x7f6e9c160170 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea409a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c0ce340 con 0x7f6e9c145700 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e9c160170 0x7f6e9c0cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f6e9c160170 0x7f6e9c0cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41266/0 (socket says 172.21.15.81:41266) 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 -- 172.21.15.81:0/3155578902 learned_addr learned my addr 172.21.15.81:0/3155578902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea1e36640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c145700 0x7f6e9c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 -- 172.21.15.81:0/3155578902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c145700 msgr2=0x7f6e9c06cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c145700 0x7f6e9c06cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 -- 172.21.15.81:0/3155578902 >> v1:172.21.15.136:6789/0 conn(0x7f6e9c072d40 legacy=0x7f6e9c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.155+0000 7f6ea2637640 1 -- 172.21.15.81:0/3155578902 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0cda10 con 0x7f6e9c160170 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea2637640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c160170 0x7f6e9c0cb250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009e50 tx=0x7f6e9402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1532386cd3646de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea0e34640 1 -- 172.21.15.81:0/3155578902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9402c9e0 con 0x7f6e9c160170 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea0e34640 1 -- 172.21.15.81:0/3155578902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9402cb80 con 0x7f6e9c160170 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea0e34640 1 -- 172.21.15.81:0/3155578902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e940343f0 con 0x7f6e9c160170 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 -- 172.21.15.81:0/3155578902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c160170 msgr2=0x7f6e9c0cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c160170 0x7f6e9c0cb250 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009e50 tx=0x7f6e9402be40 comp rx=0 tx=0).stop 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 -- 172.21.15.81:0/3155578902 shutdown_connections 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c160170 0x7f6e9c0cb250 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 --2- 172.21.15.81:0/3155578902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c145700 0x7f6e9c06cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.156+0000 7f6ea409a640 1 -- 172.21.15.81:0/3155578902 >> 172.21.15.81:0/3155578902 conn(0x7f6e9c0cfbf0 msgr2=0x7f6e9c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.157+0000 7f6ea409a640 1 -- 172.21.15.81:0/3155578902 shutdown_connections 2024-03-18T00:26:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.157+0000 7f6ea409a640 1 -- 172.21.15.81:0/3155578902 wait complete. 2024-03-18T00:26:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 Processor -- start 2024-03-18T00:26:00.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 -- start start 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e9c145700 0x7f6e9c131d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c160170 0x7f6e9c0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c145ae0 con 0x7f6e9c072d40 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9c0cdfd0 con 0x7f6e9c145700 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea409a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6e9c145c60 con 0x7f6e9c160170 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea1e36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.158+0000 7f6ea1e36640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41276/0 (socket says 172.21.15.81:41276) 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 -- 172.21.15.81:0/1435210420 learned_addr learned my addr 172.21.15.81:0/1435210420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1635640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e9c145700 0x7f6e9c131d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea2637640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c160170 0x7f6e9c0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 -- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c160170 msgr2=0x7f6e9c0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c160170 0x7f6e9c0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 -- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e9c145700 msgr2=0x7f6e9c131d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e9c145700 0x7f6e9c131d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 -- 172.21.15.81:0/1435210420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0adb10 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea1e36640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800e9e0 tx=0x7f6e9800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98017070 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9800c9d0 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9800cdc0 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c0addf0 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.159+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e9c0ae3b0 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.160+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c04f540 con 0x7f6e9c072d40 2024-03-18T00:26:00.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.161+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6e9801a070 con 0x7f6e9c072d40 2024-03-18T00:26:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.161+0000 7f6e927fc640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 0x7f6e8006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.161+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6e9808a9c0 con 0x7f6e9c072d40 2024-03-18T00:26:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.161+0000 7f6ea1635640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 0x7f6e8006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.161+0000 7f6ea1635640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 0x7f6e8006e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0b0070 tx=0x7f6e8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.165+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6e9808ce20 con 0x7f6e9c072d40 2024-03-18T00:26:00.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.337+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6e9c0b1180 con 0x7f6e9c072d40 2024-03-18T00:26:00.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.337+0000 7f6e927fc640 1 -- 172.21.15.81:0/1435210420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f6e98058ef0 con 0x7f6e9c072d40 2024-03-18T00:26:00.338 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 msgr2=0x7f6e8006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 0x7f6e8006e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0b0070 tx=0x7f6e8c009040 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 msgr2=0x7f6e9c0b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800e9e0 tx=0x7f6e9800eea0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 shutdown_connections 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6e9c160170 0x7f6e9c0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6e9c145700 0x7f6e9c131d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6e8006bbd0 0x7f6e8006e090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 --2- 172.21.15.81:0/1435210420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6e9c072d40 0x7f6e9c0b5390 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 >> 172.21.15.81:0/1435210420 conn(0x7f6e9c0cfbf0 msgr2=0x7f6e9c1449a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 shutdown_connections 2024-03-18T00:26:00.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.339+0000 7f6ea409a640 1 -- 172.21.15.81:0/1435210420 wait complete. 2024-03-18T00:26:00.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:26:00.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 Processor -- start 2024-03-18T00:26:00.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 -- start start 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 0x7f0b880cc710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b880cfe50 con 0x7f0b8815e260 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b8806edc0 con 0x7f0b8806e4c0 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.454+0000 7f0b8edab640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8815e640 con 0x7f0b8806e970 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8cb47640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b8815e260 0x7f0b880cf740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37668/0 (socket says 172.21.15.81:37668) 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8cb47640 1 -- 172.21.15.81:0/711008533 learned_addr learned my addr 172.21.15.81:0/711008533 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8d348640 1 --2- 172.21.15.81:0/711008533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 0x7f0b880cc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879327956 0 0) 0x7f0b880cfe50 con 0x7f0b8815e260 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b74003520 con 0x7f0b8815e260 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2083714545 0 0) 0x7f0b8806edc0 con 0x7f0b8806e4c0 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b880cfe50 con 0x7f0b8806e4c0 2024-03-18T00:26:00.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8d348640 1 -- 172.21.15.81:0/711008533 >> v1:172.21.15.136:6789/0 conn(0x7f0b8806e4c0 legacy=0x7f0b880cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8d348640 1 -- 172.21.15.81:0/711008533 >> v1:172.21.15.81:6789/0 conn(0x7f0b8815e260 legacy=0x7f0b880cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.455+0000 7f0b8d348640 1 -- 172.21.15.81:0/711008533 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b8806d1c0 con 0x7f0b8806e970 2024-03-18T00:26:00.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8d348640 1 --2- 172.21.15.81:0/711008533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 0x7f0b880cc710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b780097d0 tx=0x7f0b7802b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24bdfc915729dde6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78035020 con 0x7f0b8806e970 2024-03-18T00:26:00.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78031890 con 0x7f0b8806e970 2024-03-18T00:26:00.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b877fe640 1 -- 172.21.15.81:0/711008533 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78031c60 con 0x7f0b8806e970 2024-03-18T00:26:00.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 -- 172.21.15.81:0/711008533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 msgr2=0x7f0b880cc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 --2- 172.21.15.81:0/711008533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 0x7f0b880cc710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b780097d0 tx=0x7f0b7802b930 comp rx=0 tx=0).stop 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 -- 172.21.15.81:0/711008533 shutdown_connections 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 --2- 172.21.15.81:0/711008533 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e970 0x7f0b880cc710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 -- 172.21.15.81:0/711008533 >> 172.21.15.81:0/711008533 conn(0x7f0b880b1bf0 msgr2=0x7f0b880b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 -- 172.21.15.81:0/711008533 shutdown_connections 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.456+0000 7f0b8edab640 1 -- 172.21.15.81:0/711008533 wait complete. 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 Processor -- start 2024-03-18T00:26:00.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 -- start start 2024-03-18T00:26:00.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e4c0 0x7f0b880c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b8815e260 0x7f0b880ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8806da60 con 0x7f0b8806e970 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b8806d780 con 0x7f0b8815e260 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.458+0000 7f0b8edab640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0b8806dd40 con 0x7f0b8806e4c0 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41284/0 (socket says 172.21.15.81:41284) 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 -- 172.21.15.81:0/1895919485 learned_addr learned my addr 172.21.15.81:0/1895919485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b8d348640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b8815e260 0x7f0b880ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b8cb47640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e4c0 0x7f0b880c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 -- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e4c0 msgr2=0x7f0b880c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e4c0 0x7f0b880c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 -- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b8815e260 msgr2=0x7f0b880ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b8815e260 0x7f0b880ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 -- 172.21.15.81:0/1895919485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b880acfb0 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b87fff640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c530 tx=0x7f0b7000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b700052d0 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b70005490 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b880ad290 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b70012870 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.459+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b880ad850 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.460+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b8804f540 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.461+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0b70012a10 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.461+0000 7f0b857fa640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 0x7f0b6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.461+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0b7008a5c0 con 0x7f0b8806e970 2024-03-18T00:26:00.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.461+0000 7f0b8cb47640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 0x7f0b6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.462+0000 7f0b8cb47640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 0x7f0b6806e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001560 tx=0x7f0b800019f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.465+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0b70058a70 con 0x7f0b8806e970 2024-03-18T00:26:00.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.638+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0b880cf260 con 0x7f0b8806e970 2024-03-18T00:26:00.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.638+0000 7f0b857fa640 1 -- 172.21.15.81:0/1895919485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7f0b7005cb10 con 0x7f0b8806e970 2024-03-18T00:26:00.639 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 msgr2=0x7f0b6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 0x7f0b6806e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0b80001560 tx=0x7f0b800019f0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 msgr2=0x7f0b880c3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b7000c530 tx=0x7f0b7000c9f0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 shutdown_connections 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b8815e260 0x7f0b880ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b6806bbd0 0x7f0b6806e090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b8806e970 0x7f0b880c3bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 --2- 172.21.15.81:0/1895919485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b8806e4c0 0x7f0b880c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 >> 172.21.15.81:0/1895919485 conn(0x7f0b880b1bf0 msgr2=0x7f0b880ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 shutdown_connections 2024-03-18T00:26:00.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.640+0000 7f0b8edab640 1 -- 172.21.15.81:0/1895919485 wait complete. 2024-03-18T00:26:00.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T00:26:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.752+0000 7fa5ed389640 1 Processor -- start 2024-03-18T00:26:00.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.752+0000 7fa5ed389640 1 -- start start 2024-03-18T00:26:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5ed389640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fa5e815e5a0 0x7fa5e80d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5ed389640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 0x7fa5e80b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5ed389640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5e80d1200 con 0x7fa5e80d1e40 2024-03-18T00:26:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5ed389640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fa5e80cff90 con 0x7fa5e815e5a0 2024-03-18T00:26:00.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5ed389640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e80b34d0 con 0x7fa5e80d2d50 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5e67fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa5e80d1e40 0x7fa5e80d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37682/0 (socket says 172.21.15.81:37682) 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5e67fc640 1 -- 172.21.15.81:0/2731362635 learned_addr learned my addr 172.21.15.81:0/2731362635 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/2731362635 >> v2:172.21.15.136:3300/0 conn(0x7fa5e815e5a0 0x7fa5e80d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.753+0000 7fa5e77fe640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 0x7fa5e80b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e5ffb640 1 -- 172.21.15.81:0/2731362635 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 182539518 0 0) 0x7fa5e80d1200 con 0x7fa5e80d1e40 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e5ffb640 1 -- 172.21.15.81:0/2731362635 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5d0003520 con 0x7fa5e80d1e40 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e6ffd640 1 -- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 msgr2=0x7fa5e80b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 0x7fa5e80b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e6ffd640 1 -- 172.21.15.81:0/2731362635 >> v1:172.21.15.81:6789/0 conn(0x7fa5e80d1e40 legacy=0x7fa5e80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e6ffd640 1 -- 172.21.15.81:0/2731362635 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e80d14e0 con 0x7fa5e815e5a0 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.754+0000 7fa5e77fe640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 0x7fa5e80b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:00.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e80d4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009d90 tx=0x7fa5d802be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a6f714f2b34d970 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5e5ffb640 1 -- 172.21.15.81:0/2731362635 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8039070 con 0x7fa5e815e5a0 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5e5ffb640 1 -- 172.21.15.81:0/2731362635 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5d802cbd0 con 0x7fa5e815e5a0 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5e5ffb640 1 -- 172.21.15.81:0/2731362635 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8034440 con 0x7fa5e815e5a0 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 -- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 msgr2=0x7fa5e80d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e80d4b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8009d90 tx=0x7fa5d802be20 comp rx=0 tx=0).stop 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 -- 172.21.15.81:0/2731362635 shutdown_connections 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d2d50 0x7fa5e80b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 --2- 172.21.15.81:0/2731362635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e80d4b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 -- 172.21.15.81:0/2731362635 >> 172.21.15.81:0/2731362635 conn(0x7fa5e80d4060 msgr2=0x7fa5e80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 -- 172.21.15.81:0/2731362635 shutdown_connections 2024-03-18T00:26:00.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.755+0000 7fa5ed389640 1 -- 172.21.15.81:0/2731362635 wait complete. 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 Processor -- start 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 -- start start 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d1e40 0x7fa5e81f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e815bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e80b4300 con 0x7fa5e80d2d50 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fa5e80b4180 con 0x7fa5e815e5a0 2024-03-18T00:26:00.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5ed389640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fa5e80b4480 con 0x7fa5e80d1e40 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5e67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5e67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41298/0 (socket says 172.21.15.81:41298) 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5e67fc640 1 -- 172.21.15.81:0/3256809509 learned_addr learned my addr 172.21.15.81:0/3256809509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.757+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d1e40 0x7fa5e81f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e77fe640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e815bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 -- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d1e40 msgr2=0x7fa5e81f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d1e40 0x7fa5e81f8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 -- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 msgr2=0x7fa5e815bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e815bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 -- 172.21.15.81:0/3256809509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5e81f4260 con 0x7fa5e80d2d50 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5e67fc640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c430 tx=0x7fa5dc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc017070 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5dc005ce0 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5e81f4540 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0072f0 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.758+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5e81f4b00 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.759+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5e804f5b0 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.760+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa5dc01a070 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.760+0000 7fa5cf7fe640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 0x7fa5d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.760+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fa5dc089e70 con 0x7fa5e80d2d50 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.760+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 0x7fa5d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:00.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.760+0000 7fa5e6ffd640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 0x7fa5d406e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8036000 tx=0x7fa5d8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:00.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.764+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa5dc058320 con 0x7fa5e80d2d50 2024-03-18T00:26:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.949+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa5e815b980 con 0x7fa5e80d2d50 2024-03-18T00:26:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.949+0000 7fa5cf7fe640 1 -- 172.21.15.81:0/3256809509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) ==== 80+0+0 (secure 0 0 0) 0x7fa5dc05c3c0 con 0x7fa5e80d2d50 2024-03-18T00:26:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-03-18T00:26:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 msgr2=0x7fa5d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 0x7fa5d406e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa5d8036000 tx=0x7fa5d8030000 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 msgr2=0x7fa5e815b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00c430 tx=0x7fa5dc00c8f0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 shutdown_connections 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fa5e815e5a0 0x7fa5e815bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fa5d406bbd0 0x7fa5d406e090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5e80d2d50 0x7fa5e815b440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 --2- 172.21.15.81:0/3256809509 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fa5e80d1e40 0x7fa5e81f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 >> 172.21.15.81:0/3256809509 conn(0x7fa5e80d4060 msgr2=0x7fa5e80d0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 shutdown_connections 2024-03-18T00:26:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:00.951+0000 7fa5ed389640 1 -- 172.21.15.81:0/3256809509 wait complete. 2024-03-18T00:26:00.962 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-18T00:26:00.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:00.962 DEBUG:teuthology.orchestra.run.smithi136:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-18T00:26:00.992 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T00:26:00.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:00.992 DEBUG:teuthology.orchestra.run.smithi136:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-18T00:26:01.047 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-18T00:26:01.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.148+0000 7fc378685640 1 Processor -- start 2024-03-18T00:26:01.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.148+0000 7fc378685640 1 -- start start 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc378685640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc37006f2b0 0x7fc3700d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc378685640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3700d1300 0x7fc3700cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc378685640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3700b1750 con 0x7fc37006fab0 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc378685640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc3701629b0 con 0x7fc37006f2b0 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc378685640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc370162ee0 con 0x7fc3700d1300 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc37006f2b0 0x7fc3700d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc37006f2b0 0x7fc3700d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41310/0 (socket says 172.21.15.81:41310) 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 -- 172.21.15.81:0/3517949404 learned_addr learned my addr 172.21.15.81:0/3517949404 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc376c22640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3700d1300 0x7fc3700cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 -- 172.21.15.81:0/3517949404 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3700d1300 msgr2=0x7fc3700cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3700d1300 0x7fc3700cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 -- 172.21.15.81:0/3517949404 >> v1:172.21.15.136:6789/0 conn(0x7fc37006fab0 legacy=0x7fc37006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.149+0000 7fc375c20640 1 -- 172.21.15.81:0/3517949404 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc370162c00 con 0x7fc37006f2b0 2024-03-18T00:26:01.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc375c20640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37006f2b0 0x7fc3700d0dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc360009870 tx=0x7fc36002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570ed3e540b910bd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc37541f640 1 -- 172.21.15.81:0/3517949404 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360034070 con 0x7fc37006f2b0 2024-03-18T00:26:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc37541f640 1 -- 172.21.15.81:0/3517949404 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc360030840 con 0x7fc37006f2b0 2024-03-18T00:26:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc37541f640 1 -- 172.21.15.81:0/3517949404 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc360030c10 con 0x7fc37006f2b0 2024-03-18T00:26:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc378685640 1 -- 172.21.15.81:0/3517949404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37006f2b0 msgr2=0x7fc3700d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.150+0000 7fc378685640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37006f2b0 0x7fc3700d0dc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fc360009870 tx=0x7fc36002b980 comp rx=0 tx=0).stop 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 -- 172.21.15.81:0/3517949404 shutdown_connections 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc3700d1300 0x7fc3700cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 --2- 172.21.15.81:0/3517949404 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc37006f2b0 0x7fc3700d0dc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 -- 172.21.15.81:0/3517949404 >> 172.21.15.81:0/3517949404 conn(0x7fc3700d1ee0 msgr2=0x7fc3700d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 -- 172.21.15.81:0/3517949404 shutdown_connections 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.151+0000 7fc378685640 1 -- 172.21.15.81:0/3517949404 wait complete. 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 Processor -- start 2024-03-18T00:26:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 -- start start 2024-03-18T00:26:01.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc37006f2b0 0x7fc3701f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc37006fab0 0x7fc37015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc3700d05c0 con 0x7fc3700ccd60 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc370161d70 con 0x7fc37006fab0 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.152+0000 7fc378685640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc3700d08a0 con 0x7fc37006f2b0 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41324/0 (socket says 172.21.15.81:41324) 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 -- 172.21.15.81:0/3930759521 learned_addr learned my addr 172.21.15.81:0/3930759521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376421640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc37006f2b0 0x7fc3701f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc375c20640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc37006fab0 0x7fc37015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 -- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc37006f2b0 msgr2=0x7fc3701f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc37006f2b0 0x7fc3701f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 -- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc37006fab0 msgr2=0x7fc37015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc37006fab0 0x7fc37015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 -- 172.21.15.81:0/3930759521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3700cdba0 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc376c22640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36800efc0 tx=0x7fc36800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368018020 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc368014480 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3700cbcc0 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc368009e60 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.153+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3700cc280 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.154+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc37004f5b0 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.155+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc368005d10 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.155+0000 7fc366ffd640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 0x7fc35406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.155+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fc36808b630 con 0x7fc3700ccd60 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.155+0000 7fc376421640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 0x7fc35406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.155+0000 7fc376421640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 0x7fc35406e0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc37006e370 tx=0x7fc36c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.159+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc368022030 con 0x7fc3700ccd60 2024-03-18T00:26:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.369+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc3700b1290 con 0x7fc3700ccd60 2024-03-18T00:26:01.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.370+0000 7fc366ffd640 1 -- 172.21.15.81:0/3930759521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7fc368010040 con 0x7fc3700ccd60 2024-03-18T00:26:01.370 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:01.371 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:26:01.371 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:26:01.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 msgr2=0x7fc35406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 0x7fc35406e0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc37006e370 tx=0x7fc36c009040 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 msgr2=0x7fc3700c9a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fc36800efc0 tx=0x7fc36800c490 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 shutdown_connections 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc35406bc00 0x7fc35406e0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc3700ccd60 0x7fc3700c9a70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc37006fab0 0x7fc37015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 --2- 172.21.15.81:0/3930759521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc37006f2b0 0x7fc3701f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 >> 172.21.15.81:0/3930759521 conn(0x7fc3700d1ee0 msgr2=0x7fc37015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 shutdown_connections 2024-03-18T00:26:01.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.372+0000 7fc378685640 1 -- 172.21.15.81:0/3930759521 wait complete. 2024-03-18T00:26:01.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:01.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 Processor -- start 2024-03-18T00:26:01.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 -- start start 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 0x7f1b340ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3415ee60 con 0x7f1b340d07f0 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b3415f140 con 0x7f1b340b3400 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.483+0000 7f1b38e7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3415f420 con 0x7f1b3415ad40 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b32d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1b340d07f0 0x7f1b340722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37692/0 (socket says 172.21.15.81:37692) 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b32d9d640 1 -- 172.21.15.81:0/3705680632 learned_addr learned my addr 172.21.15.81:0/3705680632 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b3259c640 1 --2- 172.21.15.81:0/3705680632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 0x7f1b340ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1624191167 0 0) 0x7f1b3415ee60 con 0x7f1b340d07f0 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b20003520 con 0x7f1b340d07f0 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269044704 0 0) 0x7f1b3415f140 con 0x7f1b340b3400 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b3415ee60 con 0x7f1b340b3400 2024-03-18T00:26:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b3259c640 1 -- 172.21.15.81:0/3705680632 >> v1:172.21.15.136:6789/0 conn(0x7f1b340b3400 legacy=0x7f1b340d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b3259c640 1 -- 172.21.15.81:0/3705680632 >> v1:172.21.15.81:6789/0 conn(0x7f1b340d07f0 legacy=0x7f1b340722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.484+0000 7f1b3259c640 1 -- 172.21.15.81:0/3705680632 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3415f700 con 0x7f1b3415ad40 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b3259c640 1 --2- 172.21.15.81:0/3705680632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 0x7f1b340ad800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097d0 tx=0x7f1b2402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bab1a9d261449b0a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24035020 con 0x7f1b3415ad40 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b24031800 con 0x7f1b3415ad40 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b31d9b640 1 -- 172.21.15.81:0/3705680632 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24031bb0 con 0x7f1b3415ad40 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3705680632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 msgr2=0x7f1b340ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.485+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3705680632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 0x7f1b340ad800 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1b240097d0 tx=0x7f1b2402b8a0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.486+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3705680632 shutdown_connections 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.486+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3705680632 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b3415ad40 0x7f1b340ad800 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.486+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3705680632 >> 172.21.15.81:0/3705680632 conn(0x7f1b3406b5e0 msgr2=0x7f1b3406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.486+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3705680632 shutdown_connections 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.486+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3705680632 wait complete. 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.487+0000 7f1b38e7e640 1 Processor -- start 2024-03-18T00:26:01.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.487+0000 7f1b38e7e640 1 -- start start 2024-03-18T00:26:01.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 0x7f1b341f3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3415ad40 0x7f1b341f3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3415ea10 con 0x7f1b340b3400 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1b3415b330 con 0x7f1b3415ad40 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1b3415eb90 con 0x7f1b340d07f0 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41336/0 (socket says 172.21.15.81:41336) 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 -- 172.21.15.81:0/3875282852 learned_addr learned my addr 172.21.15.81:0/3875282852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b32d9d640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3415ad40 0x7f1b341f3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 0x7f1b341f3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 -- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 msgr2=0x7f1b341f3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 0x7f1b341f3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 -- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3415ad40 msgr2=0x7f1b341f3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3415ad40 0x7f1b341f3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 -- 172.21.15.81:0/3875282852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b3409baa0 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 0x7f1b341f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b3259c640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1b240098f0 tx=0x7f1b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b24035040 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b2403ad00 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b340b2730 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b240466c0 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.488+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b3409c040 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.489+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b3404f5b0 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.490+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1b24038020 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.490+0000 7f1b2affd640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 0x7f1b1406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.490+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f1b240acb00 con 0x7f1b340b3400 2024-03-18T00:26:01.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.490+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 0x7f1b1406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.491+0000 7f1b2bfff640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 0x7f1b1406e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b34156a90 tx=0x7f1b1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.494+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1b2407b570 con 0x7f1b340b3400 2024-03-18T00:26:01.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.669+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b34071ad0 con 0x7f1b340b3400 2024-03-18T00:26:01.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.670+0000 7f1b2affd640 1 -- 172.21.15.81:0/3875282852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7f1b2407ae70 con 0x7f1b340b3400 2024-03-18T00:26:01.670 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:01.671 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:01.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 msgr2=0x7f1b1406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 0x7f1b1406e090 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1b34156a90 tx=0x7f1b1c009040 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 msgr2=0x7f1b34142640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1b240098f0 tx=0x7f1b240046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 shutdown_connections 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1b3415ad40 0x7f1b341f3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1b340d07f0 0x7f1b341f3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1b1406bbd0 0x7f1b1406e090 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 --2- 172.21.15.81:0/3875282852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b340b3400 0x7f1b34142640 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 >> 172.21.15.81:0/3875282852 conn(0x7f1b3406b5e0 msgr2=0x7f1b3415b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 shutdown_connections 2024-03-18T00:26:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.672+0000 7f1b38e7e640 1 -- 172.21.15.81:0/3875282852 wait complete. 2024-03-18T00:26:01.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:25:21.398701+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:25:21.828325+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:26:01.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:26:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.786+0000 7f5bb4777640 1 Processor -- start 2024-03-18T00:26:01.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.786+0000 7f5bb4777640 1 -- start start 2024-03-18T00:26:01.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb4777640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bac0afb00 0x7f5bac0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb4777640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bac06b340 con 0x7f5bac15c0f0 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb4777640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bac06c510 con 0x7f5bac0716a0 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb4777640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac0affb0 con 0x7f5bac0afb00 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb1d12640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bac0afb00 0x7f5bac0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb2513640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f5bac15c0f0 0x7f5bac06be00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37708/0 (socket says 172.21.15.81:37708) 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb2513640 1 -- 172.21.15.81:0/1335199086 learned_addr learned my addr 172.21.15.81:0/1335199086 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb1d12640 1 -- 172.21.15.81:0/1335199086 >> v1:172.21.15.136:6789/0 conn(0x7f5bac0716a0 legacy=0x7f5bac06d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb1d12640 1 -- 172.21.15.81:0/1335199086 >> v1:172.21.15.81:6789/0 conn(0x7f5bac15c0f0 legacy=0x7f5bac06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb1511640 1 -- 172.21.15.81:0/1335199086 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209948051 0 0) 0x7f5bac06b340 con 0x7f5bac15c0f0 2024-03-18T00:26:01.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.787+0000 7f5bb1d12640 1 -- 172.21.15.81:0/1335199086 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac0b56b0 con 0x7f5bac0afb00 2024-03-18T00:26:01.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb1d12640 1 --2- 172.21.15.81:0/1335199086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0afb00 0x7f5bac0b4f60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0097a0 tx=0x7f5b9c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bed31a4f326d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb1511640 1 -- 172.21.15.81:0/1335199086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c034070 con 0x7f5bac0afb00 2024-03-18T00:26:01.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb1511640 1 -- 172.21.15.81:0/1335199086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c030610 con 0x7f5bac0afb00 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb1511640 1 -- 172.21.15.81:0/1335199086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c0309e0 con 0x7f5bac0afb00 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb4777640 1 -- 172.21.15.81:0/1335199086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0afb00 msgr2=0x7f5bac0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb4777640 1 --2- 172.21.15.81:0/1335199086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0afb00 0x7f5bac0b4f60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c0097a0 tx=0x7f5b9c02b960 comp rx=0 tx=0).stop 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb4777640 1 -- 172.21.15.81:0/1335199086 shutdown_connections 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb4777640 1 --2- 172.21.15.81:0/1335199086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac0afb00 0x7f5bac0b4f60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.788+0000 7f5bb4777640 1 -- 172.21.15.81:0/1335199086 >> 172.21.15.81:0/1335199086 conn(0x7f5bac0cd040 msgr2=0x7f5bac0cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.789+0000 7f5bb4777640 1 -- 172.21.15.81:0/1335199086 shutdown_connections 2024-03-18T00:26:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.789+0000 7f5bb4777640 1 -- 172.21.15.81:0/1335199086 wait complete. 2024-03-18T00:26:01.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 Processor -- start 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 -- start start 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bac0716a0 0x7f5bac1f5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bac0afb00 0x7f5bac1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac15c4d0 con 0x7f5bac15c0f0 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac06b8e0 con 0x7f5bac0afb00 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb4777640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac15c650 con 0x7f5bac0716a0 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb2d14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb2d14640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41346/0 (socket says 172.21.15.81:41346) 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.790+0000 7f5bb2d14640 1 -- 172.21.15.81:0/2132600239 learned_addr learned my addr 172.21.15.81:0/2132600239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2513640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bac0716a0 0x7f5bac1f5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb1d12640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bac0afb00 0x7f5bac1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 -- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bac0716a0 msgr2=0x7f5bac1f5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bac0716a0 0x7f5bac1f5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 -- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bac0afb00 msgr2=0x7f5bac1431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bac0afb00 0x7f5bac1431e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 -- 172.21.15.81:0/2132600239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac1f6420 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb2d14640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c7a0 tx=0x7f5ba400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4003b70 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4003d30 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac157350 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba400aa30 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.791+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac157910 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.792+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac04f540 con 0x7f5bac15c0f0 2024-03-18T00:26:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.792+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5ba400abd0 con 0x7f5bac15c0f0 2024-03-18T00:26:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.793+0000 7f5ba2ffd640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 0x7f5b9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.793+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba408a730 con 0x7f5bac15c0f0 2024-03-18T00:26:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.793+0000 7f5bb2513640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 0x7f5b9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.793+0000 7f5bb2513640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 0x7f5b9006e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000f60 tx=0x7f5ba8007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:01.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.797+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5bac1f6420 con 0x7f5bac15c0f0 2024-03-18T00:26:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.967+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5bac067220 con 0x7f5bac15c0f0 2024-03-18T00:26:01.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.968+0000 7f5ba2ffd640 1 -- 172.21.15.81:0/2132600239 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f5ba4058c60 con 0x7f5bac15c0f0 2024-03-18T00:26:01.969 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 msgr2=0x7f5b9006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 0x7f5b9006e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8000f60 tx=0x7f5ba8007e40 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 msgr2=0x7f5bac143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5ba400c7a0 tx=0x7f5ba400cc60 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 shutdown_connections 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5b9006bbd0 0x7f5b9006e090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bac15c0f0 0x7f5bac143720 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bac0afb00 0x7f5bac1431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 --2- 172.21.15.81:0/2132600239 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bac0716a0 0x7f5bac1f5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 >> 172.21.15.81:0/2132600239 conn(0x7f5bac0cd040 msgr2=0x7f5bac071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 shutdown_connections 2024-03-18T00:26:01.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:01.970+0000 7f5bb4777640 1 -- 172.21.15.81:0/2132600239 wait complete. 2024-03-18T00:26:01.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T00:26:02.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 Processor -- start 2024-03-18T00:26:02.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 -- start start 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f068415e260 0x7f06840cf740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06840cd010 0x7f068406e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f068406d1c0 con 0x7f068406e4c0 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f068415e640 con 0x7f06840cd010 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.084+0000 7f068a012640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f068406d4a0 con 0x7f068415e260 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0683fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f06840cd010 0x7f068406e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0682ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f068406e4c0 0x7f06840cdc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37714/0 (socket says 172.21.15.81:37714) 2024-03-18T00:26:02.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0682ffd640 1 -- 172.21.15.81:0/3410168321 learned_addr learned my addr 172.21.15.81:0/3410168321 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f06837fe640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f068415e260 0x7f06840cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0683fff640 1 -- 172.21.15.81:0/3410168321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f068415e260 msgr2=0x7f06840cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0683fff640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f068415e260 0x7f06840cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0683fff640 1 -- 172.21.15.81:0/3410168321 >> v1:172.21.15.81:6789/0 conn(0x7f068406e4c0 legacy=0x7f06840cdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f0683fff640 1 -- 172.21.15.81:0/3410168321 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068406d780 con 0x7f06840cd010 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.085+0000 7f06827fc640 1 -- 172.21.15.81:0/3410168321 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192384702 0 0) 0x7f068406d1c0 con 0x7f068406e4c0 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f0683fff640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06840cd010 0x7f068406e940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a04f21f4d5fe15 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f06827fc640 1 -- 172.21.15.81:0/3410168321 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c039070 con 0x7f06840cd010 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f06827fc640 1 -- 172.21.15.81:0/3410168321 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c02cc50 con 0x7f06840cd010 2024-03-18T00:26:02.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f06827fc640 1 -- 172.21.15.81:0/3410168321 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c034440 con 0x7f06840cd010 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 -- 172.21.15.81:0/3410168321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06840cd010 msgr2=0x7f068406e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06840cd010 0x7f068406e940 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c02bea0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 -- 172.21.15.81:0/3410168321 shutdown_connections 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06840cd010 0x7f068406e940 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 --2- 172.21.15.81:0/3410168321 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f068415e260 0x7f06840cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 -- 172.21.15.81:0/3410168321 >> 172.21.15.81:0/3410168321 conn(0x7f06840b1bf0 msgr2=0x7f06840b1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 -- 172.21.15.81:0/3410168321 shutdown_connections 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.086+0000 7f068a012640 1 -- 172.21.15.81:0/3410168321 wait complete. 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.087+0000 7f068a012640 1 Processor -- start 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 -- start start 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f068406e4c0 0x7f0684152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06840cd010 0x7f06840719b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06840ca860 con 0x7f068415e260 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f068406dd40 con 0x7f068406e4c0 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f068a012640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f06840ca9e0 con 0x7f06840cd010 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f0683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f0683fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41364/0 (socket says 172.21.15.81:41364) 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.088+0000 7f0683fff640 1 -- 172.21.15.81:0/66409160 learned_addr learned my addr 172.21.15.81:0/66409160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f06837fe640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f068406e4c0 0x7f0684152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0682ffd640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06840cd010 0x7f06840719b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 -- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06840cd010 msgr2=0x7f06840719b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06840cd010 0x7f06840719b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 -- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f068406e4c0 msgr2=0x7f0684152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f068406e4c0 0x7f0684152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 -- 172.21.15.81:0/66409160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f068415b250 con 0x7f068415e260 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f0683fff640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c044020 con 0x7f068415e260 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f067c03a040 con 0x7f068415e260 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c039050 con 0x7f068415e260 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f068415b530 con 0x7f068415e260 2024-03-18T00:26:02.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.089+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f068415baf0 con 0x7f068415e260 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.090+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f068404f540 con 0x7f068415e260 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.090+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f067c003990 con 0x7f068415e260 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.091+0000 7f066bfff640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 0x7f067006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.091+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f067c0acca0 con 0x7f068415e260 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.091+0000 7f06837fe640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 0x7f067006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.091+0000 7f06837fe640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 0x7f067006e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0674009aa0 tx=0x7f0674009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.095+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f067c04e060 con 0x7f068415e260 2024-03-18T00:26:02.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.268+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f06840cf260 con 0x7f068415e260 2024-03-18T00:26:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.268+0000 7f066bfff640 1 -- 172.21.15.81:0/66409160 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) ==== 104+0+11 (secure 0 0 0) 0x7f067c07b1d0 con 0x7f068415e260 2024-03-18T00:26:02.269 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 msgr2=0x7f067006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 0x7f067006e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0674009aa0 tx=0x7f0674009190 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 msgr2=0x7f0684071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f067c009d90 tx=0x7f067c004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 shutdown_connections 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f067006bbd0 0x7f067006e090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f068415e260 0x7f0684071ef0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f06840cd010 0x7f06840719b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 --2- 172.21.15.81:0/66409160 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f068406e4c0 0x7f0684152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 >> 172.21.15.81:0/66409160 conn(0x7f06840b1bf0 msgr2=0x7f06840cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 shutdown_connections 2024-03-18T00:26:02.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.270+0000 7f068a012640 1 -- 172.21.15.81:0/66409160 wait complete. 2024-03-18T00:26:02.281 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T00:26:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.383+0000 7fb2dc2a1640 1 Processor -- start 2024-03-18T00:26:02.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.383+0000 7fb2dc2a1640 1 -- start start 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2dc2a1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb2d406b1c0 0x7fb2d406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2dc2a1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d406e080 0x7fb2d40cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2dc2a1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d40cd5f0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2dc2a1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d406bae0 con 0x7fb2d406e080 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2dc2a1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb2d40709f0 con 0x7fb2d406b1c0 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2da83e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb2d406e080 0x7fb2d40cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2d983c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb2d415e3f0 0x7fb2d40702e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37718/0 (socket says 172.21.15.81:37718) 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2d983c640 1 -- 172.21.15.81:0/2180905952 learned_addr learned my addr 172.21.15.81:0/2180905952 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.384+0000 7fb2da03d640 1 --2- 172.21.15.81:0/2180905952 >> v2:172.21.15.136:3300/0 conn(0x7fb2d406b1c0 0x7fb2d406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2da83e640 1 -- 172.21.15.81:0/2180905952 >> v2:172.21.15.136:3300/0 conn(0x7fb2d406b1c0 msgr2=0x7fb2d406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2da83e640 1 --2- 172.21.15.81:0/2180905952 >> v2:172.21.15.136:3300/0 conn(0x7fb2d406b1c0 0x7fb2d406b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2da83e640 1 -- 172.21.15.81:0/2180905952 >> v1:172.21.15.81:6789/0 conn(0x7fb2d415e3f0 legacy=0x7fb2d40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2da83e640 1 -- 172.21.15.81:0/2180905952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d40cb740 con 0x7fb2d406e080 2024-03-18T00:26:02.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2d903b640 1 -- 172.21.15.81:0/2180905952 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537474695 0 0) 0x7fb2d40cd5f0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2da83e640 1 --2- 172.21.15.81:0/2180905952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d406e080 0x7fb2d40cfdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4068a90 tx=0x7fb2cc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=140a83f6ac919ef6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.385+0000 7fb2d903b640 1 -- 172.21.15.81:0/2180905952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc034070 con 0x7fb2d406e080 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2d903b640 1 -- 172.21.15.81:0/2180905952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc030610 con 0x7fb2d406e080 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2d903b640 1 -- 172.21.15.81:0/2180905952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc0309e0 con 0x7fb2d406e080 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/2180905952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d406e080 msgr2=0x7fb2d40cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/2180905952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d406e080 0x7fb2d40cfdd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4068a90 tx=0x7fb2cc02b960 comp rx=0 tx=0).stop 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/2180905952 shutdown_connections 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/2180905952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d406e080 0x7fb2d40cfdd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/2180905952 >> v2:172.21.15.136:3300/0 conn(0x7fb2d406b1c0 0x7fb2d406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/2180905952 >> 172.21.15.81:0/2180905952 conn(0x7fb2d40b2b20 msgr2=0x7fb2d40b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/2180905952 shutdown_connections 2024-03-18T00:26:02.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.386+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/2180905952 wait complete. 2024-03-18T00:26:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.387+0000 7fb2dc2a1640 1 Processor -- start 2024-03-18T00:26:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.387+0000 7fb2dc2a1640 1 -- start start 2024-03-18T00:26:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2d406b1c0 0x7fb2d41f3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2d406e080 0x7fb2d4160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cf8b0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb2d40cf5d0 con 0x7fb2d406e080 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2dc2a1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb2d40cbd00 con 0x7fb2d406b1c0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41370/0 (socket says 172.21.15.81:41370) 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 -- 172.21.15.81:0/4256253437 learned_addr learned my addr 172.21.15.81:0/4256253437 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da03d640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2d406b1c0 0x7fb2d41f3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2d983c640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2d406e080 0x7fb2d4160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 -- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2d406b1c0 msgr2=0x7fb2d41f3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2d406b1c0 0x7fb2d41f3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 -- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2d406e080 msgr2=0x7fb2d4160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2d406e080 0x7fb2d4160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.388+0000 7fb2da83e640 1 -- 172.21.15.81:0/4256253437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d41f42b0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2da83e640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009890 tx=0x7fb2cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc034040 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2cc030410 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2cc039bd0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d41f4590 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.389+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2d41f4b50 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.390+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2d404f540 con 0x7fb2d415e3f0 2024-03-18T00:26:02.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.390+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb2cc037070 con 0x7fb2d415e3f0 2024-03-18T00:26:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.391+0000 7fb2caffd640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 0x7fb2b806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.391+0000 7fb2da03d640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 0x7fb2b806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.391+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb2cc0ac7f0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.391+0000 7fb2da03d640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 0x7fb2b806e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0011340 tx=0x7fb2d000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.395+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb2cc07ae40 con 0x7fb2d415e3f0 2024-03-18T00:26:02.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.569+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb2d4070690 con 0x7fb2d415e3f0 2024-03-18T00:26:02.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.569+0000 7fb2caffd640 1 -- 172.21.15.81:0/4256253437 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) ==== 100+0+11 (secure 0 0 0) 0x7fb2cc07eee0 con 0x7fb2d415e3f0 2024-03-18T00:26:02.570 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 msgr2=0x7fb2b806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 0x7fb2b806e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0011340 tx=0x7fb2d000b040 comp rx=0 tx=0).stop 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 msgr2=0x7fb2d415e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc009890 tx=0x7fb2cc0046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 shutdown_connections 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb2b806bbd0 0x7fb2b806e090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2d415e3f0 0x7fb2d415e7f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb2d406e080 0x7fb2d4160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 --2- 172.21.15.81:0/4256253437 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb2d406b1c0 0x7fb2d41f3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 >> 172.21.15.81:0/4256253437 conn(0x7fb2d40b2b20 msgr2=0x7fb2d40cfc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 shutdown_connections 2024-03-18T00:26:02.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.571+0000 7fb2dc2a1640 1 -- 172.21.15.81:0/4256253437 wait complete. 2024-03-18T00:26:02.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.683+0000 7f859109a640 1 Processor -- start 2024-03-18T00:26:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.683+0000 7f859109a640 1 -- start start 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.683+0000 7f859109a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f858c0b2280 0x7f858c06c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f859109a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0d0a20 0x7f858c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f859109a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f858c15ec80 con 0x7f858c0cfd70 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f859109a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f858c06db30 con 0x7f858c0b2280 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f859109a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f858c06cf20 con 0x7f858c0d0a20 2024-03-18T00:26:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f858c0b2280 0x7f858c06c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f858c0b2280 0x7f858c06c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41378/0 (socket says 172.21.15.81:41378) 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 -- 172.21.15.81:0/2028716378 learned_addr learned my addr 172.21.15.81:0/2028716378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858b59e640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0d0a20 0x7f858c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 -- 172.21.15.81:0/2028716378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0d0a20 msgr2=0x7f858c0b4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0d0a20 0x7f858c0b4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 -- 172.21.15.81:0/2028716378 >> v1:172.21.15.136:6789/0 conn(0x7f858c0cfd70 legacy=0x7f858c0d0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.684+0000 7f858ad9d640 1 -- 172.21.15.81:0/2028716378 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c06d200 con 0x7f858c0b2280 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f858ad9d640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0b2280 0x7f858c06c940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f858c06dcb0 tx=0x7f857c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b705c254da3ec44 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f8589d9b640 1 -- 172.21.15.81:0/2028716378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c0317c0 con 0x7f858c0b2280 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f8589d9b640 1 -- 172.21.15.81:0/2028716378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f857c037070 con 0x7f858c0b2280 2024-03-18T00:26:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f8589d9b640 1 -- 172.21.15.81:0/2028716378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f857c031b80 con 0x7f858c0b2280 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 -- 172.21.15.81:0/2028716378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0b2280 msgr2=0x7f858c06c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0b2280 0x7f858c06c940 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f858c06dcb0 tx=0x7f857c02b860 comp rx=0 tx=0).stop 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 -- 172.21.15.81:0/2028716378 shutdown_connections 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0d0a20 0x7f858c0b4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 --2- 172.21.15.81:0/2028716378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0b2280 0x7f858c06c940 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 -- 172.21.15.81:0/2028716378 >> 172.21.15.81:0/2028716378 conn(0x7f858c0d1e70 msgr2=0x7f858c0d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 -- 172.21.15.81:0/2028716378 shutdown_connections 2024-03-18T00:26:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.685+0000 7f859109a640 1 -- 172.21.15.81:0/2028716378 wait complete. 2024-03-18T00:26:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.687+0000 7f859109a640 1 Processor -- start 2024-03-18T00:26:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.687+0000 7f859109a640 1 -- start start 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0b2280 0x7f858c156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f858c0d0a20 0x7f858c0b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f858c0b2660 con 0x7f858c0cfd70 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f858c06d7c0 con 0x7f858c0d0a20 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f858c0b27e0 con 0x7f858c0b2280 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41390/0 (socket says 172.21.15.81:41390) 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 -- 172.21.15.81:0/4096107922 learned_addr learned my addr 172.21.15.81:0/4096107922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858b59e640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f858c0d0a20 0x7f858c0b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858ad9d640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0b2280 0x7f858c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 -- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0b2280 msgr2=0x7f858c156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0b2280 0x7f858c156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 -- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f858c0d0a20 msgr2=0x7f858c0b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f858c0d0a20 0x7f858c0b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 -- 172.21.15.81:0/4096107922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f858c0c9c30 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f858a59c640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f858000c400 tx=0x7f858000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85800052d0 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8580005490 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8580007260 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f858c0c9f10 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.688+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f858c0ca4d0 con 0x7f858c0cfd70 2024-03-18T00:26:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.689+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f858c04f5b0 con 0x7f858c0cfd70 2024-03-18T00:26:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.690+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8580007400 con 0x7f858c0cfd70 2024-03-18T00:26:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.690+0000 7f85737fe640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 0x7f857806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.690+0000 7f858ad9d640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 0x7f857806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.690+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f8580089e70 con 0x7f858c0cfd70 2024-03-18T00:26:02.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.691+0000 7f858ad9d640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 0x7f857806e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f857c036000 tx=0x7f857c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:02.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.695+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f85800583a0 con 0x7f858c0cfd70 2024-03-18T00:26:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.903+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f858c0b7df0 con 0x7f858c0cfd70 2024-03-18T00:26:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.904+0000 7f85737fe640 1 -- 172.21.15.81:0/4096107922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f858005c440 con 0x7f858c0cfd70 2024-03-18T00:26:02.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:02.905 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:26:02.905 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:26:02.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 msgr2=0x7f857806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 0x7f857806e090 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f857c036000 tx=0x7f857c03d040 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 msgr2=0x7f858c1570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f858000c400 tx=0x7f858000c8c0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 shutdown_connections 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f858c0d0a20 0x7f858c0b1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f857806bbd0 0x7f857806e090 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f858c0cfd70 0x7f858c1570e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 --2- 172.21.15.81:0/4096107922 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f858c0b2280 0x7f858c156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 >> 172.21.15.81:0/4096107922 conn(0x7f858c0d1e70 msgr2=0x7f858c0b3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 shutdown_connections 2024-03-18T00:26:02.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:02.906+0000 7f859109a640 1 -- 172.21.15.81:0/4096107922 wait complete. 2024-03-18T00:26:02.917 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.018+0000 7fb396fb2640 1 Processor -- start 2024-03-18T00:26:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.018+0000 7fb396fb2640 1 -- start start 2024-03-18T00:26:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb396fb2640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb3900cf110 0x7fb3900cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb396fb2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb39006bbd0 0x7fb39006c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb396fb2640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3900cdbd0 con 0x7fb39015bed0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb396fb2640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb39015c2b0 con 0x7fb39006bbd0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb396fb2640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb3900cd9a0 con 0x7fb3900cf110 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb39006bbd0 0x7fb39006c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb39006bbd0 0x7fb39006c060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41396/0 (socket says 172.21.15.81:41396) 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 -- 172.21.15.81:0/3524396467 learned_addr learned my addr 172.21.15.81:0/3524396467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb38ffff640 1 --2- 172.21.15.81:0/3524396467 >> v2:172.21.15.136:3300/0 conn(0x7fb3900cf110 0x7fb3900cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 -- 172.21.15.81:0/3524396467 >> v2:172.21.15.136:3300/0 conn(0x7fb3900cf110 msgr2=0x7fb3900cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 --2- 172.21.15.81:0/3524396467 >> v2:172.21.15.136:3300/0 conn(0x7fb3900cf110 0x7fb3900cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 -- 172.21.15.81:0/3524396467 >> v1:172.21.15.136:6789/0 conn(0x7fb39015bed0 legacy=0x7fb39015f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.019+0000 7fb39554f640 1 -- 172.21.15.81:0/3524396467 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900cdeb0 con 0x7fb39006bbd0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb39554f640 1 --2- 172.21.15.81:0/3524396467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb39006c060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb388009e50 tx=0x7fb38802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e270eb0940a1d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb38f7fe640 1 -- 172.21.15.81:0/3524396467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38802cb20 con 0x7fb39006bbd0 2024-03-18T00:26:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb38f7fe640 1 -- 172.21.15.81:0/3524396467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38802ccc0 con 0x7fb39006bbd0 2024-03-18T00:26:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb38f7fe640 1 -- 172.21.15.81:0/3524396467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388034610 con 0x7fb39006bbd0 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb396fb2640 1 -- 172.21.15.81:0/3524396467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 msgr2=0x7fb39006c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.020+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3524396467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb39006c060 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb388009e50 tx=0x7fb38802bf80 comp rx=0 tx=0).stop 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 -- 172.21.15.81:0/3524396467 shutdown_connections 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3524396467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb39006c060 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3524396467 >> v2:172.21.15.136:3300/0 conn(0x7fb3900cf110 0x7fb3900cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 -- 172.21.15.81:0/3524396467 >> 172.21.15.81:0/3524396467 conn(0x7fb3900b2ab0 msgr2=0x7fb3900b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 -- 172.21.15.81:0/3524396467 shutdown_connections 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.021+0000 7fb396fb2640 1 -- 172.21.15.81:0/3524396467 wait complete. 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.022+0000 7fb396fb2640 1 Processor -- start 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.022+0000 7fb396fb2640 1 -- start start 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3900cf110 0x7fb390156a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 0x7fb390156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb39015e9c0 con 0x7fb39006bbd0 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb3900cf570 con 0x7fb39015bed0 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb39015eca0 con 0x7fb3900cf110 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41410/0 (socket says 172.21.15.81:41410) 2024-03-18T00:26:03.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 -- 172.21.15.81:0/3305898095 learned_addr learned my addr 172.21.15.81:0/3305898095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb38ffff640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3900cf110 0x7fb390156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb39554f640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 0x7fb390156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 -- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3900cf110 msgr2=0x7fb390156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3900cf110 0x7fb390156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 -- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 msgr2=0x7fb390156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 0x7fb390156f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 -- 172.21.15.81:0/3305898095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3900b4ce0 con 0x7fb39006bbd0 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb39554f640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 0x7fb390156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb394d4e640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c3f0 tx=0x7fb38400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3840052d0 con 0x7fb39006bbd0 2024-03-18T00:26:03.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb384005490 con 0x7fb39006bbd0 2024-03-18T00:26:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb384007260 con 0x7fb39006bbd0 2024-03-18T00:26:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3900b4fc0 con 0x7fb39006bbd0 2024-03-18T00:26:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.023+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39015f3f0 con 0x7fb39006bbd0 2024-03-18T00:26:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.024+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3900b54e0 con 0x7fb39006bbd0 2024-03-18T00:26:03.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.025+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb384007400 con 0x7fb39006bbd0 2024-03-18T00:26:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.025+0000 7fb38d7fa640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 0x7fb37406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.025+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7fb384089dd0 con 0x7fb39006bbd0 2024-03-18T00:26:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.025+0000 7fb38ffff640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 0x7fb37406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.026+0000 7fb38ffff640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 0x7fb37406e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3900b5be0 tx=0x7fb37c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.029+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb3900b54e0 con 0x7fb39006bbd0 2024-03-18T00:26:03.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.204+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb39004f5b0 con 0x7fb39006bbd0 2024-03-18T00:26:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.205+0000 7fb38d7fa640 1 -- 172.21.15.81:0/3305898095 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16617 (secure 0 0 0) 0x7fb38408b090 con 0x7fb39006bbd0 2024-03-18T00:26:03.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:03.206 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:25:24.519678+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 msgr2=0x7fb37406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 0x7fb37406e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb3900b5be0 tx=0x7fb37c009190 comp rx=0 tx=0).stop 2024-03-18T00:26:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 msgr2=0x7fb3900b4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb38400c3f0 tx=0x7fb38400c8b0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 shutdown_connections 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb39015bed0 0x7fb390156f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb3900cf110 0x7fb390156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb37406bbd0 0x7fb37406e090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 --2- 172.21.15.81:0/3305898095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb39006bbd0 0x7fb3900b4590 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 >> 172.21.15.81:0/3305898095 conn(0x7fb3900b2ab0 msgr2=0x7fb3900b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 shutdown_connections 2024-03-18T00:26:03.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.207+0000 7fb396fb2640 1 -- 172.21.15.81:0/3305898095 wait complete. 2024-03-18T00:26:03.219 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T00:26:03.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.319+0000 7f79f55a9640 1 Processor -- start 2024-03-18T00:26:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.319+0000 7f79f55a9640 1 -- start start 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79f55a9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79f00ae8d0 0x7f79f006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79f55a9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f0071930 con 0x7f79f015e110 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79f55a9640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79f0071c10 con 0x7f79f015e4f0 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79f55a9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f79f0071ef0 con 0x7f79f00ae8d0 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79ef7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79f00ae8d0 0x7f79f006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79eeffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79f015e110 0x7f79f00cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37724/0 (socket says 172.21.15.81:37724) 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79eeffd640 1 -- 172.21.15.81:0/396177905 learned_addr learned my addr 172.21.15.81:0/396177905 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79ef7fe640 1 -- 172.21.15.81:0/396177905 >> v1:172.21.15.136:6789/0 conn(0x7f79f015e4f0 legacy=0x7f79f006e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79ef7fe640 1 -- 172.21.15.81:0/396177905 >> v1:172.21.15.81:6789/0 conn(0x7f79f015e110 legacy=0x7f79f00cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79ef7fe640 1 -- 172.21.15.81:0/396177905 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f00721d0 con 0x7f79f00ae8d0 2024-03-18T00:26:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.320+0000 7f79edffb640 1 -- 172.21.15.81:0/396177905 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077127440 0 0) 0x7f79f0071c10 con 0x7f79f015e4f0 2024-03-18T00:26:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.321+0000 7f79ef7fe640 1 --2- 172.21.15.81:0/396177905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ae8d0 0x7f79f006f0e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009d90 tx=0x7f79e802bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4ba0fa573f8538 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.321+0000 7f79edffb640 1 -- 172.21.15.81:0/396177905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e8039070 con 0x7f79f00ae8d0 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.321+0000 7f79edffb640 1 -- 172.21.15.81:0/396177905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e802ca20 con 0x7f79f00ae8d0 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.321+0000 7f79edffb640 1 -- 172.21.15.81:0/396177905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e802cdf0 con 0x7f79f00ae8d0 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 -- 172.21.15.81:0/396177905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ae8d0 msgr2=0x7f79f006f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 --2- 172.21.15.81:0/396177905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ae8d0 0x7f79f006f0e0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f79e8009d90 tx=0x7f79e802bcf0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 -- 172.21.15.81:0/396177905 shutdown_connections 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 --2- 172.21.15.81:0/396177905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f00ae8d0 0x7f79f006f0e0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 -- 172.21.15.81:0/396177905 >> 172.21.15.81:0/396177905 conn(0x7f79f00ccfb0 msgr2=0x7f79f00cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 -- 172.21.15.81:0/396177905 shutdown_connections 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.322+0000 7f79f55a9640 1 -- 172.21.15.81:0/396177905 wait complete. 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.323+0000 7f79f55a9640 1 Processor -- start 2024-03-18T00:26:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.323+0000 7f79f55a9640 1 -- start start 2024-03-18T00:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79f00ae8d0 0x7f79f015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79f015e4f0 0x7f79f0156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79f0168eb0 con 0x7f79f015e110 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79f00d0000 con 0x7f79f00ae8d0 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79f55a9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79f0169030 con 0x7f79f015e4f0 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41432/0 (socket says 172.21.15.81:41432) 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 -- 172.21.15.81:0/3814041888 learned_addr learned my addr 172.21.15.81:0/3814041888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79eeffd640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79f00ae8d0 0x7f79f015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ef7fe640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79f015e4f0 0x7f79f0156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 -- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79f015e4f0 msgr2=0x7f79f0156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79f015e4f0 0x7f79f0156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 -- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79f00ae8d0 msgr2=0x7f79f015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79f00ae8d0 0x7f79f015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 -- 172.21.15.81:0/3814041888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79f015cc40 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79ee7fc640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c550 tx=0x7f79e400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e4017070 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.324+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e40035f0 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.325+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79f015f7c0 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.325+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79e40039c0 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.325+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79f015bf00 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.325+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79f004f5b0 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.326+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f79e401a070 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.326+0000 7f79d77fe640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 0x7f79dc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.326+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f79e4089d90 con 0x7f79f015e110 2024-03-18T00:26:03.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.326+0000 7f79eeffd640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 0x7f79dc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.327+0000 7f79eeffd640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 0x7f79dc06e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79e0000f60 tx=0x7f79e0007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.331+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f79e40582c0 con 0x7f79f015e110 2024-03-18T00:26:03.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.544+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f79f00b57f0 con 0x7f79f015e110 2024-03-18T00:26:03.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.545+0000 7f79d77fe640 1 -- 172.21.15.81:0/3814041888 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f79e405c360 con 0x7f79f015e110 2024-03-18T00:26:03.546 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:03.546 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:26:03.546 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 msgr2=0x7f79dc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 0x7f79dc06e090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f79e0000f60 tx=0x7f79e0007e20 comp rx=0 tx=0).stop 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 msgr2=0x7f79f0151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c550 tx=0x7f79e400ca10 comp rx=0 tx=0).stop 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 shutdown_connections 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79f015e4f0 0x7f79f0156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79dc06bbd0 0x7f79dc06e090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79f015e110 0x7f79f0151e00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 --2- 172.21.15.81:0/3814041888 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79f00ae8d0 0x7f79f015c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 >> 172.21.15.81:0/3814041888 conn(0x7f79f00ccfb0 msgr2=0x7f79f00d04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 shutdown_connections 2024-03-18T00:26:03.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.547+0000 7f79f55a9640 1 -- 172.21.15.81:0/3814041888 wait complete. 2024-03-18T00:26:03.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 Processor -- start 2024-03-18T00:26:03.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 -- start start 2024-03-18T00:26:03.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0bb0162da0 0x7f0bb015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb00b3440 con 0x7f0bb00d10d0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bb00d20a0 con 0x7f0bb01622b0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.664+0000 7f0bb6559640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0bb00d16c0 con 0x7f0bb0162da0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0baf7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0bb00d10d0 0x7f0bb015ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37738/0 (socket says 172.21.15.81:37738) 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0baf7fe640 1 -- 172.21.15.81:0/3020398049 learned_addr learned my addr 172.21.15.81:0/3020398049 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0bb4af6640 1 --2- 172.21.15.81:0/3020398049 >> v2:172.21.15.81:3300/0 conn(0x7f0bb0162da0 0x7f0bb015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0baeffd640 1 -- 172.21.15.81:0/3020398049 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428785773 0 0) 0x7f0bb00b3440 con 0x7f0bb00d10d0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0baeffd640 1 -- 172.21.15.81:0/3020398049 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b98003520 con 0x7f0bb00d10d0 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0bb4af6640 1 -- 172.21.15.81:0/3020398049 >> v1:172.21.15.136:6789/0 conn(0x7f0bb01622b0 legacy=0x7f0bb0162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0bb4af6640 1 -- 172.21.15.81:0/3020398049 >> v1:172.21.15.81:6789/0 conn(0x7f0bb00d10d0 legacy=0x7f0bb015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.665+0000 7f0bb4af6640 1 -- 172.21.15.81:0/3020398049 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb00d2380 con 0x7f0bb0162da0 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb4af6640 1 --2- 172.21.15.81:0/3020398049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb015f1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009dc0 tx=0x7f0ba802be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87adcca127f5e041 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0baeffd640 1 -- 172.21.15.81:0/3020398049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8039070 con 0x7f0bb0162da0 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0baeffd640 1 -- 172.21.15.81:0/3020398049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba802cbb0 con 0x7f0bb0162da0 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0baeffd640 1 -- 172.21.15.81:0/3020398049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8034440 con 0x7f0bb0162da0 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 -- 172.21.15.81:0/3020398049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 msgr2=0x7f0bb015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 --2- 172.21.15.81:0/3020398049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb015f1a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009dc0 tx=0x7f0ba802be00 comp rx=0 tx=0).stop 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 -- 172.21.15.81:0/3020398049 shutdown_connections 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 --2- 172.21.15.81:0/3020398049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb015f1a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 -- 172.21.15.81:0/3020398049 >> 172.21.15.81:0/3020398049 conn(0x7f0bb00d4070 msgr2=0x7f0bb00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 -- 172.21.15.81:0/3020398049 shutdown_connections 2024-03-18T00:26:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.666+0000 7f0bb6559640 1 -- 172.21.15.81:0/3020398049 wait complete. 2024-03-18T00:26:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.667+0000 7f0bb6559640 1 Processor -- start 2024-03-18T00:26:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 -- start start 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 0x7f0bb00b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 0x7f0bb0161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb01631f0 con 0x7f0bb0162da0 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb00d2660 con 0x7f0bb00d10d0 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb6559640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb00cfc90 con 0x7f0bb01622b0 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb4af6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb4af6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41448/0 (socket says 172.21.15.81:41448) 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.668+0000 7f0bb4af6640 1 -- 172.21.15.81:0/1465995824 learned_addr learned my addr 172.21.15.81:0/1465995824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0baffff640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 0x7f0bb00b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0baf7fe640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 0x7f0bb0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 -- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 msgr2=0x7f0bb0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 0x7f0bb0161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 -- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 msgr2=0x7f0bb00b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 0x7f0bb00b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 -- 172.21.15.81:0/1465995824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb0159020 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0baffff640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 0x7f0bb00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0baf7fe640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 0x7f0bb0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb4af6640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009dc0 tx=0x7f0ba8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba8039050 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ba8045070 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb0158a60 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba803e850 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.669+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb0160c20 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.670+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb004f5b0 con 0x7f0bb0162da0 2024-03-18T00:26:03.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.670+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0ba803e9f0 con 0x7f0bb0162da0 2024-03-18T00:26:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.671+0000 7f0bacff9640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 0x7f0b9c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.671+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f0ba80adad0 con 0x7f0bb0162da0 2024-03-18T00:26:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.671+0000 7f0baffff640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 0x7f0b9c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.671+0000 7f0baffff640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 0x7f0b9c06e090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0001660 tx=0x7f0ba0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.675+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0ba8032e20 con 0x7f0bb0162da0 2024-03-18T00:26:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.888+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0bb00d18d0 con 0x7f0bb0162da0 2024-03-18T00:26:03.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.889+0000 7f0bacff9640 1 -- 172.21.15.81:0/1465995824 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5181 (secure 0 0 0) 0x7f0ba807c5d0 con 0x7f0bb0162da0 2024-03-18T00:26:03.890 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:03.890 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/4169597127","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":4169597127},{"type":"v1","addr":"172.21.15.136:6834","nonce":4169597127}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/2956219595","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":2956219595},{"type":"v1","addr":"172.21.15.81:6836","nonce":2956219595}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/2406267968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":2406267968},{"type":"v1","addr":"172.21.15.81:6837","nonce":2406267968}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:25:22.854572+0000","modified":"2024-03-18T00:25:25.278427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4278},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4278":{"gid":4278,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6835/2230258880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2230258880},{"type":"v1","addr":"172.21.15.136:6835","nonce":2230258880}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4278,"qdb_cluster":[4278]},"id":1}]} 2024-03-18T00:26:03.890 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-03-18T00:26:03.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 msgr2=0x7f0b9c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 0x7f0b9c06e090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0001660 tx=0x7f0ba0009040 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 msgr2=0x7f0bb00b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8009dc0 tx=0x7f0ba8004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 shutdown_connections 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b9c06bbd0 0x7f0b9c06e090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bb0162da0 0x7f0bb00b19f0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0bb01622b0 0x7f0bb0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 --2- 172.21.15.81:0/1465995824 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0bb00d10d0 0x7f0bb00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 >> 172.21.15.81:0/1465995824 conn(0x7f0bb00d4070 msgr2=0x7f0bb00d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 shutdown_connections 2024-03-18T00:26:03.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:03.891+0000 7f0bb6559640 1 -- 172.21.15.81:0/1465995824 wait complete. 2024-03-18T00:26:03.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:04.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.001+0000 7fb0475e6640 1 Processor -- start 2024-03-18T00:26:04.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.001+0000 7fb0475e6640 1 -- start start 2024-03-18T00:26:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.002+0000 7fb0475e6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 0x7fb040162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.002+0000 7fb0475e6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 0x7fb04015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.002+0000 7fb0475e6640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0400b3440 con 0x7fb0401622b0 2024-03-18T00:26:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.002+0000 7fb0475e6640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb0400d16c0 con 0x7fb04015ea90 2024-03-18T00:26:04.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.002+0000 7fb0475e6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb0400d2660 con 0x7fb0400d10d0 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb045b83640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 0x7fb04015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb044b81640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 0x7fb040162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb045382640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb0401622b0 0x7fb040162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:54408/0 (socket says 172.21.15.81:54408) 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb045382640 1 -- 172.21.15.81:0/3086852036 learned_addr learned my addr 172.21.15.81:0/3086852036 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb044b81640 1 -- 172.21.15.81:0/3086852036 >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 msgr2=0x7fb04015ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb044b81640 1 --2- 172.21.15.81:0/3086852036 >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 0x7fb04015ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb044b81640 1 -- 172.21.15.81:0/3086852036 >> v1:172.21.15.136:6789/0 conn(0x7fb0401622b0 legacy=0x7fb040162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb044b81640 1 -- 172.21.15.81:0/3086852036 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0400d20a0 con 0x7fb0400d10d0 2024-03-18T00:26:04.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.003+0000 7fb045b83640 1 --2- 172.21.15.81:0/3086852036 >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 0x7fb04015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb044b81640 1 --2- 172.21.15.81:0/3086852036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 0x7fb040162da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0300097a0 tx=0x7fb03002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51b80c9b4da891df server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb037fff640 1 -- 172.21.15.81:0/3086852036 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030038070 con 0x7fb0400d10d0 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb037fff640 1 -- 172.21.15.81:0/3086852036 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb030031700 con 0x7fb0400d10d0 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb037fff640 1 -- 172.21.15.81:0/3086852036 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb030031ad0 con 0x7fb0400d10d0 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 -- 172.21.15.81:0/3086852036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 msgr2=0x7fb040162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 --2- 172.21.15.81:0/3086852036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 0x7fb040162da0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb0300097a0 tx=0x7fb03002b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 -- 172.21.15.81:0/3086852036 shutdown_connections 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 --2- 172.21.15.81:0/3086852036 >> v2:172.21.15.136:3300/0 conn(0x7fb04015ea90 0x7fb04015ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 --2- 172.21.15.81:0/3086852036 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0400d10d0 0x7fb040162da0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 -- 172.21.15.81:0/3086852036 >> 172.21.15.81:0/3086852036 conn(0x7fb0400d4070 msgr2=0x7fb0400d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 -- 172.21.15.81:0/3086852036 shutdown_connections 2024-03-18T00:26:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.004+0000 7fb0475e6640 1 -- 172.21.15.81:0/3086852036 wait complete. 2024-03-18T00:26:04.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 Processor -- start 2024-03-18T00:26:04.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 -- start start 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 0x7fb040160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0401622b0 0x7fb0401613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400cfc90 con 0x7fb0400d10d0 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb0400d2ab0 con 0x7fb04015ea90 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb0475e6640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb0400cfe10 con 0x7fb0401622b0 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb045382640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb045382640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41454/0 (socket says 172.21.15.81:41454) 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb045382640 1 -- 172.21.15.81:0/1972497590 learned_addr learned my addr 172.21.15.81:0/1972497590 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb044b81640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 0x7fb040160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.006+0000 7fb045b83640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0401622b0 0x7fb0401613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 -- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0401622b0 msgr2=0x7fb0401613d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0401622b0 0x7fb0401613d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 -- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 msgr2=0x7fb040160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 0x7fb040160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 -- 172.21.15.81:0/1972497590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0400cb140 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb044b81640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 0x7fb040160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb045382640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ca70 tx=0x7fb03c00ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c017070 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb03c00ab10 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0400cb420 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c012400 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.007+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0400cb9e0 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.008+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb04004f5b0 con 0x7fb0400d10d0 2024-03-18T00:26:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.009+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb03c01a070 con 0x7fb0400d10d0 2024-03-18T00:26:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.009+0000 7fb035ffb640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 0x7fb02406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.009+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7fb03c08a6b0 con 0x7fb0400d10d0 2024-03-18T00:26:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.009+0000 7fb044b81640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 0x7fb02406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.009+0000 7fb044b81640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 0x7fb02406e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb030035000 tx=0x7fb030008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.013+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb03c058ad0 con 0x7fb0400d10d0 2024-03-18T00:26:04.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.190+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0400d18d0 con 0x7fb0400d10d0 2024-03-18T00:26:04.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.191+0000 7fb035ffb640 1 -- 172.21.15.81:0/1972497590 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16865 (secure 0 0 0) 0x7fb03c05cb70 con 0x7fb0400d10d0 2024-03-18T00:26:04.191 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:04.191 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:03.632382+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:25:21.398701+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T00:25:21.828325+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":5,"to":1}]},{"pgid":"3.8","mappings":[{"from":3,"to":2}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.39","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 msgr2=0x7fb02406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 0x7fb02406e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb030035000 tx=0x7fb030008030 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 msgr2=0x7fb0400b6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00ca70 tx=0x7fb03c00ce70 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 shutdown_connections 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb0401622b0 0x7fb0401613d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb04015ea90 0x7fb040160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb02406bbd0 0x7fb02406e090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 --2- 172.21.15.81:0/1972497590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0400d10d0 0x7fb0400b6180 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 >> 172.21.15.81:0/1972497590 conn(0x7fb0400d4070 msgr2=0x7fb04006c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 shutdown_connections 2024-03-18T00:26:04.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.193+0000 7fb0475e6640 1 -- 172.21.15.81:0/1972497590 wait complete. 2024-03-18T00:26:04.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T00:26:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 Processor -- start 2024-03-18T00:26:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 -- start start 2024-03-18T00:26:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573406b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f573406ef60 con 0x7f57340afbe0 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57340b0080 con 0x7f573415bf30 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.308+0000 7f573a310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f573406bb50 con 0x7f573406b1c0 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f57340afbe0 0x7f573406e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37742/0 (socket says 172.21.15.81:37742) 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57337fe640 1 -- 172.21.15.81:0/1836936120 learned_addr learned my addr 172.21.15.81:0/1836936120 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57388ad640 1 --2- 172.21.15.81:0/1836936120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573406b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3718169906 0 0) 0x7f573406ef60 con 0x7f57340afbe0 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f571c003520 con 0x7f57340afbe0 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358870926 0 0) 0x7f57340b0080 con 0x7f573415bf30 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f573406ef60 con 0x7f573415bf30 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57388ad640 1 -- 172.21.15.81:0/1836936120 >> v1:172.21.15.136:6789/0 conn(0x7f573415bf30 legacy=0x7f573415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57388ad640 1 -- 172.21.15.81:0/1836936120 >> v1:172.21.15.81:6789/0 conn(0x7f57340afbe0 legacy=0x7f573406e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.309+0000 7f57388ad640 1 -- 172.21.15.81:0/1836936120 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57340b0360 con 0x7f573406b1c0 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.310+0000 7f57388ad640 1 --2- 172.21.15.81:0/1836936120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573406b610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f572c009dc0 tx=0x7f572c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9d544f9f9f53dc9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.310+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c039070 con 0x7f573406b1c0 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.310+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c02ccd0 con 0x7f573406b1c0 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.310+0000 7f5732ffd640 1 -- 172.21.15.81:0/1836936120 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c034660 con 0x7f573406b1c0 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 -- 172.21.15.81:0/1836936120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 msgr2=0x7f573406b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 --2- 172.21.15.81:0/1836936120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573406b610 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f572c009dc0 tx=0x7f572c02bf20 comp rx=0 tx=0).stop 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 -- 172.21.15.81:0/1836936120 shutdown_connections 2024-03-18T00:26:04.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 --2- 172.21.15.81:0/1836936120 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573406b610 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 -- 172.21.15.81:0/1836936120 >> 172.21.15.81:0/1836936120 conn(0x7f57340d0d30 msgr2=0x7f57340d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 -- 172.21.15.81:0/1836936120 shutdown_connections 2024-03-18T00:26:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.311+0000 7f573a310640 1 -- 172.21.15.81:0/1836936120 wait complete. 2024-03-18T00:26:04.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.312+0000 7f573a310640 1 Processor -- start 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.312+0000 7f573a310640 1 -- start start 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57340afbe0 0x7f573415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f573406e3c0 con 0x7f573415bf30 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5734070850 con 0x7f57340afbe0 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f573a310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f57340ad8c0 con 0x7f573406b1c0 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41460/0 (socket says 172.21.15.81:41460) 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 -- 172.21.15.81:0/3301709413 learned_addr learned my addr 172.21.15.81:0/3301709413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57337fe640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57340afbe0 0x7f573415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f5733fff640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 -- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 msgr2=0x7f573414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 -- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57340afbe0 msgr2=0x7f573415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57340afbe0 0x7f573415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.313+0000 7f57388ad640 1 -- 172.21.15.81:0/3301709413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5734159430 con 0x7f573415bf30 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f57388ad640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f572c02c530 tx=0x7f572c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c039050 con 0x7f573415bf30 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f572c045070 con 0x7f573415bf30 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5734159710 con 0x7f573415bf30 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572c009450 con 0x7f573415bf30 2024-03-18T00:26:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.314+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5734159cd0 con 0x7f573415bf30 2024-03-18T00:26:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.315+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f573404f5b0 con 0x7f573415bf30 2024-03-18T00:26:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.316+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f572c03e850 con 0x7f573415bf30 2024-03-18T00:26:04.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.316+0000 7f5730ff9640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 0x7f572006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.316+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5825+0+0 (secure 0 0 0) 0x7f572c0ad750 con 0x7f573415bf30 2024-03-18T00:26:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.316+0000 7f5733fff640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 0x7f572006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.316+0000 7f5733fff640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 0x7f572006e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5728007fd0 tx=0x7f5728009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.321+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f572c07bde0 con 0x7f573415bf30 2024-03-18T00:26:04.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.532+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f5734070630 con 0x7f573415bf30 2024-03-18T00:26:04.533 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-03-18T00:26:04.532+0000 7fb7ce611640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-18T00:26:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.536+0000 7f5730ff9640 1 -- 172.21.15.81:0/3301709413 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f572c07fe80 con 0x7f573415bf30 2024-03-18T00:26:04.536 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.538+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 msgr2=0x7f572006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.538+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 0x7f572006e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5728007fd0 tx=0x7f5728009040 comp rx=0 tx=0).stop 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.538+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 msgr2=0x7f573415b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.538+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f572c02c530 tx=0x7f572c004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 shutdown_connections 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f572006bbd0 0x7f572006e090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573415bf30 0x7f573415b1f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f57340afbe0 0x7f573415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 --2- 172.21.15.81:0/3301709413 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f573406b1c0 0x7f573414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 >> 172.21.15.81:0/3301709413 conn(0x7f57340d0d30 msgr2=0x7f57341538a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 shutdown_connections 2024-03-18T00:26:04.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.539+0000 7f573a310640 1 -- 172.21.15.81:0/3301709413 wait complete. 2024-03-18T00:26:04.543 INFO:tasks.ceph.mds.b.smithi136.stderr: -7386> 2024-03-18T00:25:27.997+0000 7f838a209640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T00:26:04.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T00:26:04.574 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-03-18T00:26:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 Processor -- start 2024-03-18T00:26:04.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 -- start start 2024-03-18T00:26:04.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcedc161890 0x7fcedc0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcedc0cffe0 con 0x7fcedc0d0960 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fcedc0cfa20 con 0x7fcedc161890 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.654+0000 7fcee1675640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcedc0cfd00 con 0x7fcedc0b4ec0 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcedc161890 0x7fcedc0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fcedc161890 0x7fcedc0d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41464/0 (socket says 172.21.15.81:41464) 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 -- 172.21.15.81:0/4153130462 learned_addr learned my addr 172.21.15.81:0/4153130462 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fceda7fc640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 -- 172.21.15.81:0/4153130462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 msgr2=0x7fcedc0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 -- 172.21.15.81:0/4153130462 >> v1:172.21.15.136:6789/0 conn(0x7fcedc0d0960 legacy=0x7fcedc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.655+0000 7fcedaffd640 1 -- 172.21.15.81:0/4153130462 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc0cf710 con 0x7fcedc161890 2024-03-18T00:26:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcedaffd640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc161890 0x7fcedc0d4bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009e50 tx=0x7fcecc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a60459b4374c949 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fced9ffb640 1 -- 172.21.15.81:0/4153130462 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc02cb00 con 0x7fcedc161890 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fced9ffb640 1 -- 172.21.15.81:0/4153130462 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcecc02cca0 con 0x7fcedc161890 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fced9ffb640 1 -- 172.21.15.81:0/4153130462 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc034610 con 0x7fcedc161890 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 -- 172.21.15.81:0/4153130462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc161890 msgr2=0x7fcedc0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc161890 0x7fcedc0d4bb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009e50 tx=0x7fcecc02bf60 comp rx=0 tx=0).stop 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 -- 172.21.15.81:0/4153130462 shutdown_connections 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 --2- 172.21.15.81:0/4153130462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc161890 0x7fcedc0d4bb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 -- 172.21.15.81:0/4153130462 >> 172.21.15.81:0/4153130462 conn(0x7fcedc0d4090 msgr2=0x7fcedc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 -- 172.21.15.81:0/4153130462 shutdown_connections 2024-03-18T00:26:04.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.656+0000 7fcee1675640 1 -- 172.21.15.81:0/4153130462 wait complete. 2024-03-18T00:26:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 Processor -- start 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 -- start start 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcedc161890 0x7fcedc1f3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc0d0df0 con 0x7fcedc0d0960 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcedc0b5580 con 0x7fcedc161890 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcee1675640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcedc0d0f70 con 0x7fcedc0b4ec0 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fceda7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fceda7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41476/0 (socket says 172.21.15.81:41476) 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fceda7fc640 1 -- 172.21.15.81:0/3844539763 learned_addr learned my addr 172.21.15.81:0/3844539763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcedaffd640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.658+0000 7fcedb7fe640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcedc161890 0x7fcedc1f3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 -- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 msgr2=0x7fcedc0d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 -- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcedc161890 msgr2=0x7fcedc1f3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcedc161890 0x7fcedc1f3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 -- 172.21.15.81:0/3844539763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcedc15d0a0 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fceda7fc640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fced000e9b0 tx=0x7fced000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced0017070 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fced000c9a0 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcedc15d380 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fced000cd90 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.659+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcedc15d940 con 0x7fcedc0d0960 2024-03-18T00:26:04.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.660+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcedc04f540 con 0x7fcedc0d0960 2024-03-18T00:26:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.661+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fced001a070 con 0x7fcedc0d0960 2024-03-18T00:26:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.661+0000 7fcec37fe640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 0x7fcec806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.661+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5911+0+0 (secure 0 0 0) 0x7fced008ad90 con 0x7fcedc0d0960 2024-03-18T00:26:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.661+0000 7fcedaffd640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 0x7fcec806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:04.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.662+0000 7fcedaffd640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 0x7fcec806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcecc035000 tx=0x7fcecc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:04.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.665+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fced00591f0 con 0x7fcedc0d0960 2024-03-18T00:26:04.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:04.877+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcedc08d7e0 con 0x7fcedc0d0960 2024-03-18T00:26:05.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.537+0000 7fcec37fe640 1 -- 172.21.15.81:0/3844539763 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fced005f070 con 0x7fcedc0d0960 2024-03-18T00:26:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 msgr2=0x7fcec806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 0x7fcec806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcecc035000 tx=0x7fcecc030000 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 msgr2=0x7fcedc0c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fced000e9b0 tx=0x7fced000ee70 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 shutdown_connections 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcedc161890 0x7fcedc1f3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcec806bbd0 0x7fcec806e090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcedc0d0960 0x7fcedc0c7020 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 --2- 172.21.15.81:0/3844539763 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcedc0b4ec0 0x7fcedc0d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 >> 172.21.15.81:0/3844539763 conn(0x7fcedc0d4090 msgr2=0x7fcedc0d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 shutdown_connections 2024-03-18T00:26:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.540+0000 7fcee1675640 1 -- 172.21.15.81:0/3844539763 wait complete. 2024-03-18T00:26:05.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T00:26:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.659+0000 7f1129332640 1 Processor -- start 2024-03-18T00:26:05.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.659+0000 7f1129332640 1 -- start start 2024-03-18T00:26:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.660+0000 7f1129332640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1124161700 0x7f11240d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.660+0000 7f1129332640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f11240d4ad0 0x7f11240d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.660+0000 7f1129332640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11240d4fd0 con 0x7f11240d1350 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.660+0000 7f1129332640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f11240cf8e0 con 0x7f11240d4ad0 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.660+0000 7f1129332640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11240d3050 con 0x7f1124161700 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f11240d4ad0 0x7f11240d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f1122ffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1124161700 0x7f11240d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11237fe640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f11240d1350 0x7f1124161f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:34844/0 (socket says 172.21.15.81:34844) 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11237fe640 1 -- 172.21.15.81:0/70761080 learned_addr learned my addr 172.21.15.81:0/70761080 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f11240d4ad0 0x7f11240d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37520/0 (socket says 172.21.15.81:37520) 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 -- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1124161700 msgr2=0x7f11240d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 --2- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1124161700 0x7f11240d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 -- 172.21.15.81:0/70761080 >> v1:172.21.15.136:6789/0 conn(0x7f11240d1350 legacy=0x7f1124161f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f11227fc640 1 -- 172.21.15.81:0/70761080 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240cfb80 con 0x7f11240d4ad0 2024-03-18T00:26:05.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.661+0000 7f1121ffb640 1 -- 172.21.15.81:0/70761080 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278413430 0 0) 0x7f11240d4fd0 con 0x7f11240d1350 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f11227fc640 1 --2- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11240d4ad0 0x7f11240d0e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11180097a0 tx=0x7f111802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c86e01b23aae74e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f1121ffb640 1 -- 172.21.15.81:0/70761080 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11180315a0 con 0x7f11240d4ad0 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f1121ffb640 1 -- 172.21.15.81:0/70761080 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1118037070 con 0x7f11240d4ad0 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f1121ffb640 1 -- 172.21.15.81:0/70761080 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118031960 con 0x7f11240d4ad0 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f1129332640 1 -- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11240d4ad0 msgr2=0x7f11240d0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.662+0000 7f1129332640 1 --2- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11240d4ad0 0x7f11240d0e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f11180097a0 tx=0x7f111802b840 comp rx=0 tx=0).stop 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 -- 172.21.15.81:0/70761080 shutdown_connections 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 --2- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11240d4ad0 0x7f11240d0e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 --2- 172.21.15.81:0/70761080 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1124161700 0x7f11240d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 -- 172.21.15.81:0/70761080 >> 172.21.15.81:0/70761080 conn(0x7f112409d3e0 msgr2=0x7f11240d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:05.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 -- 172.21.15.81:0/70761080 shutdown_connections 2024-03-18T00:26:05.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.663+0000 7f1129332640 1 -- 172.21.15.81:0/70761080 wait complete. 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.664+0000 7f1129332640 1 Processor -- start 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.664+0000 7f1129332640 1 -- start start 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11240d1350 0x7f1124158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124161700 0x7f11240b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11240b4fd0 con 0x7f11240d4ad0 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11240b3770 con 0x7f1124161700 2024-03-18T00:26:05.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11240b5150 con 0x7f11240d1350 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52110/0 (socket says 172.21.15.81:52110) 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 -- 172.21.15.81:0/206620785 learned_addr learned my addr 172.21.15.81:0/206620785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11237fe640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124161700 0x7f11240b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1122ffd640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11240d1350 0x7f1124158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 -- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11240d1350 msgr2=0x7f1124158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11240d1350 0x7f1124158990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 -- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124161700 msgr2=0x7f11240b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124161700 0x7f11240b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 -- 172.21.15.81:0/206620785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11240b7130 con 0x7f11240d4ad0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f11227fc640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11180097a0 tx=0x7f11180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118004230 con 0x7f11240d4ad0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11180043f0 con 0x7f11240d4ad0 2024-03-18T00:26:05.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11240cb290 con 0x7f11240d4ad0 2024-03-18T00:26:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118003850 con 0x7f11240d4ad0 2024-03-18T00:26:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.665+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11240cb850 con 0x7f11240d4ad0 2024-03-18T00:26:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.666+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f112404f540 con 0x7f11240d4ad0 2024-03-18T00:26:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.667+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f11180039f0 con 0x7f11240d4ad0 2024-03-18T00:26:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.667+0000 7f110b7fe640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 0x7f111006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.667+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5911+0+0 (secure 0 0 0) 0x7f111802f030 con 0x7f11240d4ad0 2024-03-18T00:26:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.667+0000 7f1122ffd640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 0x7f111006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:05.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.668+0000 7f1122ffd640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 0x7f111006e090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11140113e0 tx=0x7f111400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.672+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f11240b7130 con 0x7f11240d4ad0 2024-03-18T00:26:05.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:05.845+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f112408c100 con 0x7f11240d4ad0 2024-03-18T00:26:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.645+0000 7f110b7fe640 1 -- 172.21.15.81:0/206620785 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) ==== 181+0+0 (secure 0 0 0) 0x7f1118041070 con 0x7f11240d4ad0 2024-03-18T00:26:06.645 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-03-18T00:26:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 msgr2=0x7f111006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 0x7f111006e090 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11140113e0 tx=0x7f111400b040 comp rx=0 tx=0).stop 2024-03-18T00:26:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 msgr2=0x7f11240c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11180097a0 tx=0x7f11180046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 shutdown_connections 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1124161700 0x7f11240b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f111006bbd0 0x7f111006e090 secure :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f11140113e0 tx=0x7f111400b040 comp rx=0 tx=0).stop 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11240d4ad0 0x7f11240c9720 secure :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f11180097a0 tx=0x7f11180046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 --2- 172.21.15.81:0/206620785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11240d1350 0x7f1124158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.648+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 >> 172.21.15.81:0/206620785 conn(0x7f112409d3e0 msgr2=0x7f112406bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.649+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 shutdown_connections 2024-03-18T00:26:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.649+0000 7f1129332640 1 -- 172.21.15.81:0/206620785 wait complete. 2024-03-18T00:26:06.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T00:26:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.767+0000 7f2903285640 1 Processor -- start 2024-03-18T00:26:06.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.767+0000 7f2903285640 1 -- start start 2024-03-18T00:26:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2903285640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28fc0b0340 0x7f28fc06f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2903285640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f28fc0727a0 0x7f28fc0d0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2903285640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28fc06fc00 con 0x7f28fc06b1c0 2024-03-18T00:26:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2903285640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc15e750 con 0x7f28fc0b0340 2024-03-18T00:26:06.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2903285640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f28fc0b5bd0 con 0x7f28fc0727a0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2901021640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f28fc0b0340 0x7f28fc06f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2901822640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f28fc06b1c0 0x7f28fc15ec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52756/0 (socket says 172.21.15.81:52756) 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.768+0000 7f2901822640 1 -- 172.21.15.81:0/3678740019 learned_addr learned my addr 172.21.15.81:0/3678740019 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2900820640 1 --2- 172.21.15.81:0/3678740019 >> v2:172.21.15.136:3300/0 conn(0x7f28fc0727a0 0x7f28fc0d0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f28f3fff640 1 -- 172.21.15.81:0/3678740019 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243053726 0 0) 0x7f28fc06fc00 con 0x7f28fc06b1c0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f28f3fff640 1 -- 172.21.15.81:0/3678740019 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28e8003520 con 0x7f28fc06b1c0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2901021640 1 -- 172.21.15.81:0/3678740019 >> v2:172.21.15.136:3300/0 conn(0x7f28fc0727a0 msgr2=0x7f28fc0d0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2901021640 1 --2- 172.21.15.81:0/3678740019 >> v2:172.21.15.136:3300/0 conn(0x7f28fc0727a0 0x7f28fc0d0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2901021640 1 -- 172.21.15.81:0/3678740019 >> v1:172.21.15.81:6789/0 conn(0x7f28fc06b1c0 legacy=0x7f28fc15ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2901021640 1 -- 172.21.15.81:0/3678740019 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc0b5eb0 con 0x7f28fc0b0340 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.769+0000 7f2901021640 1 --2- 172.21.15.81:0/3678740019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0b0340 0x7f28fc06f600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f28fc073330 tx=0x7f28f802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=279d0d3fd12dfec9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f28f3fff640 1 -- 172.21.15.81:0/3678740019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8039070 con 0x7f28fc0b0340 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f28f3fff640 1 -- 172.21.15.81:0/3678740019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28f802cc80 con 0x7f28fc0b0340 2024-03-18T00:26:06.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f28f3fff640 1 -- 172.21.15.81:0/3678740019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28f8034660 con 0x7f28fc0b0340 2024-03-18T00:26:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 -- 172.21.15.81:0/3678740019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0b0340 msgr2=0x7f28fc06f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 --2- 172.21.15.81:0/3678740019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0b0340 0x7f28fc06f600 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f28fc073330 tx=0x7f28f802bed0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 -- 172.21.15.81:0/3678740019 shutdown_connections 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 --2- 172.21.15.81:0/3678740019 >> v2:172.21.15.136:3300/0 conn(0x7f28fc0727a0 0x7f28fc0d0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 --2- 172.21.15.81:0/3678740019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0b0340 0x7f28fc06f600 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 -- 172.21.15.81:0/3678740019 >> 172.21.15.81:0/3678740019 conn(0x7f28fc06c2d0 msgr2=0x7f28fc06c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 -- 172.21.15.81:0/3678740019 shutdown_connections 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.770+0000 7f2903285640 1 -- 172.21.15.81:0/3678740019 wait complete. 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.771+0000 7f2903285640 1 Processor -- start 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.771+0000 7f2903285640 1 -- start start 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 0x7f28fc1f73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 0x7f28fc160680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0b5810 con 0x7f28fc0727a0 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f28fc0b0720 con 0x7f28fc0b0340 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2903285640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f28fc0b5990 con 0x7f28fc06b1c0 2024-03-18T00:26:06.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2900820640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2900820640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52130/0 (socket says 172.21.15.81:52130) 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.772+0000 7f2900820640 1 -- 172.21.15.81:0/560479900 learned_addr learned my addr 172.21.15.81:0/560479900 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 -- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 msgr2=0x7f28fc1f73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2901822640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 0x7f28fc160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2901021640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 0x7f28fc1f73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 0x7f28fc1f73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 -- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 msgr2=0x7f28fc160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 0x7f28fc160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 -- 172.21.15.81:0/560479900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28fc14fcc0 con 0x7f28fc0727a0 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2901021640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 0x7f28fc1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2901822640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 0x7f28fc160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2900820640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d800 tx=0x7f28ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:06.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00b6c0 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f28ec019070 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28fc1f7a70 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28ec00ba80 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.773+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28fc1f8030 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.774+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28fc04f540 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.774+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f28ec00bc20 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.775+0000 7f28f1ffb640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 0x7f28e006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.775+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5473+0+0 (secure 0 0 0) 0x7f28ec08adf0 con 0x7f28fc0727a0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.775+0000 7f2901021640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 0x7f28e006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:06.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.775+0000 7f2901021640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 0x7f28e006e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f28f8036000 tx=0x7f28f8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:06.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.779+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f28ec059a50 con 0x7f28fc0727a0 2024-03-18T00:26:06.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:06.953+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f28fc1612e0 con 0x7f28fc0727a0 2024-03-18T00:26:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.649+0000 7f28f1ffb640 1 -- 172.21.15.81:0/560479900 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) ==== 169+0+0 (secure 0 0 0) 0x7f28ec059350 con 0x7f28fc0727a0 2024-03-18T00:26:07.650 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-03-18T00:26:07.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 msgr2=0x7f28e006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 0x7f28e006e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f28f8036000 tx=0x7f28f8030000 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 msgr2=0x7f28fc14f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f28ec00d800 tx=0x7f28ec00dcc0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 shutdown_connections 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f28fc0b0340 0x7f28fc160680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f28e006bbd0 0x7f28e006e090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28fc0727a0 0x7f28fc14f780 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 --2- 172.21.15.81:0/560479900 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f28fc06b1c0 0x7f28fc1f73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 >> 172.21.15.81:0/560479900 conn(0x7f28fc06c2d0 msgr2=0x7f28fc06eac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 shutdown_connections 2024-03-18T00:26:07.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.653+0000 7f2903285640 1 -- 172.21.15.81:0/560479900 wait complete. 2024-03-18T00:26:07.668 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T00:26:07.668 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-18T00:26:07.668 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T00:26:07.668 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:26:07.668 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T00:26:07.668 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-18T00:26:07.669 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T00:26:07.669 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:26:07.669 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T00:26:07.669 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-18T00:26:07.669 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T00:26:07.669 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:26:07.669 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-18T00:26:07.669 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-18T00:26:07.670 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-18T00:26:07.670 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T00:26:07.678 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T00:26:07.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T00:26:07.679 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T00:26:07.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T00:26:07.682 INFO:tasks.ceph.mds.d:Stopped 2024-03-18T00:26:07.682 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-18T00:26:07.683 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T00:26:07.683 DEBUG:teuthology.orchestra.run.smithi136:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T00:26:07.721 INFO:tasks.ceph.mds.a:Started 2024-03-18T00:26:07.722 DEBUG:teuthology.parallel:result is None 2024-03-18T00:26:07.722 INFO:tasks.ceph.mds.c:Started 2024-03-18T00:26:07.722 DEBUG:teuthology.parallel:result is None 2024-03-18T00:26:07.724 INFO:tasks.ceph.mds.d:Started 2024-03-18T00:26:07.725 DEBUG:teuthology.parallel:result is None 2024-03-18T00:26:07.725 INFO:tasks.ceph.mds.b:Started 2024-03-18T00:26:07.725 DEBUG:teuthology.parallel:result is None 2024-03-18T00:26:07.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-18T00:26:07.802 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-03-18T00:26:07.803 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-03-18T00:26:07.807 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-03-18T00:26:07.807 INFO:tasks.ceph.mds.b.smithi136.stdout:starting mds.b at 2024-03-18T00:26:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.833+0000 7f848c752640 1 Processor -- start 2024-03-18T00:26:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.833+0000 7f848c752640 1 -- start start 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848c752640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8484162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848c752640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84840b3440 con 0x7f848415ea90 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848c752640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84840d20a0 con 0x7f84841622b0 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848c752640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f84840d16c0 con 0x7f84840d10d0 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848acef640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f848415ea90 0x7f848415ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52768/0 (socket says 172.21.15.81:52768) 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.834+0000 7f848acef640 1 -- 172.21.15.81:0/2584598147 learned_addr learned my addr 172.21.15.81:0/2584598147 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f8489ced640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8484162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2514722880 0 0) 0x7f84840b3440 con 0x7f848415ea90 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8470003520 con 0x7f848415ea90 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2752207560 0 0) 0x7f84840d20a0 con 0x7f84841622b0 2024-03-18T00:26:07.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84840b3440 con 0x7f84841622b0 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3359981731 0 0) 0x7f8470003520 con 0x7f848415ea90 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 msgr2=0x7f8484162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8484162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 >> v1:172.21.15.136:6789/0 conn(0x7f84841622b0 legacy=0x7f8484162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84840d2380 con 0x7f848415ea90 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f847c001970 con 0x7f848415ea90 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 >> v1:172.21.15.81:6789/0 conn(0x7f848415ea90 legacy=0x7f848415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470003be0 0x7f8470003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8470004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8470004d90 0x7f84700051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84840d16c0 con 0x7f8470003be0 2024-03-18T00:26:07.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f847000bc50 con 0x7f8470004d90 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f847000be50 con 0x7f84840d10d0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470003be0 0x7f8470003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f848acef640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8470004d90 0x7f84700051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.835+0000 7f8489ced640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8470004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 -- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 msgr2=0x7f8470004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f84840d10d0 0x7f8470004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 -- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8470004d90 msgr2=0x7f84700051f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8470004d90 0x7f84700051f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 -- 172.21.15.81:0/2584598147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8470003520 con 0x7f8470003be0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848acef640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8470004d90 0x7f84700051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470003be0 0x7f8470003fe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f84800018d0 tx=0x7f8470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615006dc14a63ba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480037070 con 0x7f8470003be0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84800052d0 con 0x7f8470003be0 2024-03-18T00:26:07.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.836+0000 7f84894ec640 1 -- 172.21.15.81:0/2584598147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800014f0 con 0x7f8470003be0 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 -- 172.21.15.81:0/2584598147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470003be0 msgr2=0x7f8470003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 --2- 172.21.15.81:0/2584598147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8470003be0 0x7f8470003fe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f84800018d0 tx=0x7f8470005830 comp rx=0 tx=0).stop 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848acef640 1 -- 172.21.15.81:0/2584598147 reap_dead start 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 -- 172.21.15.81:0/2584598147 shutdown_connections 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 -- 172.21.15.81:0/2584598147 >> 172.21.15.81:0/2584598147 conn(0x7f84840d4070 msgr2=0x7f84840d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 -- 172.21.15.81:0/2584598147 shutdown_connections 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.837+0000 7f848c752640 1 -- 172.21.15.81:0/2584598147 wait complete. 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.838+0000 7f848c752640 1 Processor -- start 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.838+0000 7f848c752640 1 -- start start 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 0x7f84840b9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 0x7f848415c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f84840cfc90 con 0x7f848415c850 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f84840d2660 con 0x7f84840b7070 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848c752640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f84840cfe10 con 0x7f8470003be0 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52186/0 (socket says 172.21.15.81:52186) 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 -- 172.21.15.81:0/2212222432 learned_addr learned my addr 172.21.15.81:0/2212222432 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 0x7f84840b9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f8489ced640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 0x7f848415c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 -- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 msgr2=0x7f84840b9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 0x7f84840b9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 -- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 msgr2=0x7f848415c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 0x7f848415c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:07.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 -- 172.21.15.81:0/2212222432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848415d240 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 0x7f84840b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f8489ced640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 0x7f848415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.839+0000 7f848acef640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f848408c7b0 tx=0x7f847c00aec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.840+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c017020 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.840+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f847c007920 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.840+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f847c00a2f0 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.840+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f848415aea0 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.840+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f848415abc0 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.841+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f848404f5b0 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.841+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f847c01a020 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.842+0000 7f847affd640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 0x7f846806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.842+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4943+0+0 (secure 0 0 0) 0x7f847c08ae60 con 0x7f848415c850 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.842+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 0x7f846806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:07.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.842+0000 7f848a4ee640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 0x7f846806e0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8480034000 tx=0x7f8480031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:07.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:07.846+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f847c021020 con 0x7f848415c850 2024-03-18T00:26:08.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.032+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f84840d18d0 con 0x7f848415c850 2024-03-18T00:26:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.661+0000 7f847affd640 1 -- 172.21.15.81:0/2212222432 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v26) ==== 97+0+0 (secure 0 0 0) 0x7f848415d240 con 0x7f848415c850 2024-03-18T00:26:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 msgr2=0x7f846806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 0x7f846806e0c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8480034000 tx=0x7f8480031000 comp rx=0 tx=0).stop 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 msgr2=0x7f848415cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f848408c7b0 tx=0x7f847c00aec0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 shutdown_connections 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f846806bc00 0x7f846806e0c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f848415c850 0x7f848415cd00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f84840b7070 0x7f848415c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.663+0000 7f848c752640 1 --2- 172.21.15.81:0/2212222432 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8470003be0 0x7f84840b9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.664+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 >> 172.21.15.81:0/2212222432 conn(0x7f84840d4070 msgr2=0x7f848415ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.664+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 shutdown_connections 2024-03-18T00:26:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.664+0000 7f848c752640 1 -- 172.21.15.81:0/2212222432 wait complete. 2024-03-18T00:26:08.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-18T00:26:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.780+0000 7f8ce7187640 1 Processor -- start 2024-03-18T00:26:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.780+0000 7f8ce7187640 1 -- start start 2024-03-18T00:26:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce7187640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce00d07f0 0x7f8ce00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce7187640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ce0159cc0 0x7f8ce00ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce7187640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ce015fc70 con 0x7f8ce01598e0 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce7187640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce00b3c80 con 0x7f8ce0159cc0 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce7187640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce015ff50 con 0x7f8ce00d07f0 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce5724640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f8ce0159cc0 0x7f8ce00ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce4f23640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f8ce01598e0 0x7f8ce00d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52778/0 (socket says 172.21.15.81:52778) 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce4f23640 1 -- 172.21.15.81:0/4233736230 learned_addr learned my addr 172.21.15.81:0/4233736230 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8cdffff640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce00d07f0 0x7f8ce00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce5724640 1 -- 172.21.15.81:0/4233736230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce00d07f0 msgr2=0x7f8ce00b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce5724640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce00d07f0 0x7f8ce00b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce5724640 1 -- 172.21.15.81:0/4233736230 >> v1:172.21.15.81:6789/0 conn(0x7f8ce01598e0 legacy=0x7f8ce00d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.781+0000 7f8ce5724640 1 -- 172.21.15.81:0/4233736230 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce0160230 con 0x7f8ce0159cc0 2024-03-18T00:26:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.782+0000 7f8ce5724640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce0159cc0 0x7f8ce00ae850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009d90 tx=0x7f8cd802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad29ab1e60c2765 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.782+0000 7f8cdf7fe640 1 -- 172.21.15.81:0/4233736230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8039070 con 0x7f8ce0159cc0 2024-03-18T00:26:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.782+0000 7f8cdf7fe640 1 -- 172.21.15.81:0/4233736230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd802cc50 con 0x7f8ce0159cc0 2024-03-18T00:26:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.782+0000 7f8cdf7fe640 1 -- 172.21.15.81:0/4233736230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8034440 con 0x7f8ce0159cc0 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 -- 172.21.15.81:0/4233736230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce0159cc0 msgr2=0x7f8ce00ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce0159cc0 0x7f8ce00ae850 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009d90 tx=0x7f8cd802bea0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 -- 172.21.15.81:0/4233736230 shutdown_connections 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce0159cc0 0x7f8ce00ae850 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 --2- 172.21.15.81:0/4233736230 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce00d07f0 0x7f8ce00b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 -- 172.21.15.81:0/4233736230 >> 172.21.15.81:0/4233736230 conn(0x7f8ce006b5e0 msgr2=0x7f8ce006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 -- 172.21.15.81:0/4233736230 shutdown_connections 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.783+0000 7f8ce7187640 1 -- 172.21.15.81:0/4233736230 wait complete. 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.784+0000 7f8ce7187640 1 Processor -- start 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.784+0000 7f8ce7187640 1 -- start start 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 0x7f8ce00afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 0x7f8ce00b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce006cc70 con 0x7f8ce00d07f0 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce01607f0 con 0x7f8ce01598e0 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce7187640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce006cdf0 con 0x7f8ce0159cc0 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52198/0 (socket says 172.21.15.81:52198) 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 -- 172.21.15.81:0/2852873324 learned_addr learned my addr 172.21.15.81:0/2852873324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce5724640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 0x7f8ce00b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8cdffff640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 0x7f8ce00afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 -- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 msgr2=0x7f8ce00b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 0x7f8ce00b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 -- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 msgr2=0x7f8ce00afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 0x7f8ce00afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 -- 172.21.15.81:0/2852873324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce015e130 con 0x7f8ce00d07f0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8cdffff640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 0x7f8ce00afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce5724640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 0x7f8ce00b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8ce4f23640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c400 tx=0x7f8cd400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.785+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd4017070 con 0x7f8ce00d07f0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.786+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cd4005ce0 con 0x7f8ce00d07f0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.786+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd40072f0 con 0x7f8ce00d07f0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.786+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce015c6b0 con 0x7f8ce00d07f0 2024-03-18T00:26:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.786+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce015cc70 con 0x7f8ce00d07f0 2024-03-18T00:26:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.787+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce004f590 con 0x7f8ce00d07f0 2024-03-18T00:26:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.787+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8cd401a070 con 0x7f8ce00d07f0 2024-03-18T00:26:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.787+0000 7f8cdd7fa640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 0x7f8cc406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.787+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8cd4089b20 con 0x7f8ce00d07f0 2024-03-18T00:26:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.787+0000 7f8cdffff640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 0x7f8cc406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:08.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.788+0000 7f8cdffff640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 0x7f8cc406e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006fd0 tx=0x7f8ccc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:08.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:08.791+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8cd4058960 con 0x7f8ce00d07f0 2024-03-18T00:26:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.027+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f8ce00b15c0 con 0x7f8ce00d07f0 2024-03-18T00:26:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.028+0000 7f8cdd7fa640 1 -- 172.21.15.81:0/2852873324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7f8cd4058260 con 0x7f8ce00d07f0 2024-03-18T00:26:09.028 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdloynRDRAAqLxRAXBUMAW5TjYGgkjcfA==", 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlzmczGhAA+7JkoCDchSUXpZ8zf+//pA==", 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdl1i4vFRAAzSWGBfKLCnaSK89+vzSXRw==", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-03-18T00:26:09.031 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdl5YOYIRAATnNgmO1K3Vxvoc2XaUJ+XA==", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC9ifdloKAoBhAAyOja6ZL9gq0z8wSAiEY+qw==", 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.032 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDAifdljE4pBRAA2v+olmiayJCNMruzkzHghg==", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDDifdlxpSMBBAAqIhs7b+IaXfPLvy5guC+jw==", 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.034 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDGifdlJje6AxAASJU2GEWEbdzEFQHjo0mPEQ==", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDMifdlvNjwDhAALXfqsCAu9Q2wscXRxZ3mkA==", 2024-03-18T00:26:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDPifdl5XmBDRAA+OqH1WgZtKNl02zoYTRVeA==", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.036 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDSifdlCfDxCxAArTjbWef5RMeUlq7wAqqWXA==", 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.037 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDVifdlF3jvCRAAL/Eh84IA8W/88yx8+wGCFA==", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlMETNJRAA/du1tDc2rDvVDvLyJhOxSg==", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.038 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlbpT4LhAAeAgZ6k9UW+JEHmBzG03Rzg==", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-03-18T00:26:09.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlUXeUKxAAh1o1XgyoxUmv09aXdrjISw==", 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlx6S/NBAAxQog1h4YvdSn0X1qDuVvjw==", 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.041 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw==", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdlFfZWChAA7PuGlWGKH/tI7CShlJ2ldA==", 2024-03-18T00:26:09.042 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdljP5WChAAewXe5zEDb+hI5Q9aQqhJdQ==", 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-03-18T00:26:09.043 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdlZgVXChAAwIXxBY4QOlmW22lwNQ4tNA==", 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdl/gtXChAAFieMipOcxpFq2mfY5nkjpw==", 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.044 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdl2BJXChAAWDjpAguq6Y2cpovd9T/Y1A==", 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQDbifdl6hlXChAA6xF6as30qUwF9CCofPERJw==", 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-18T00:26:09.045 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlP7xsChAAMWYH5I4EWAloZJsh53nnhA==", 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:09.046 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQC5ifdlGafgBRAAhpYkpiwVcfe1oBvHW1uc9Q==", 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-03-18T00:26:09.047 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T00:26:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.029+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 msgr2=0x7f8cc406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.029+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 0x7f8cc406e090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc006fd0 tx=0x7f8ccc008040 comp rx=0 tx=0).stop 2024-03-18T00:26:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.029+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 msgr2=0x7f8ce0146ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.029+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f8cd400c400 tx=0x7f8cd400c8c0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 shutdown_connections 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8ce0159cc0 0x7f8ce00b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8ce01598e0 0x7f8ce00afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8cc406bbd0 0x7f8cc406e090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 --2- 172.21.15.81:0/2852873324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce00d07f0 0x7f8ce0146ac0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 >> 172.21.15.81:0/2852873324 conn(0x7f8ce006b5e0 msgr2=0x7f8ce00ad070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 shutdown_connections 2024-03-18T00:26:09.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.030+0000 7f8ce7187640 1 -- 172.21.15.81:0/2852873324 wait complete. 2024-03-18T00:26:09.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-18T00:26:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.151+0000 7efd89085640 1 Processor -- start 2024-03-18T00:26:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.151+0000 7efd89085640 1 -- start start 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd89085640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8415e550 0x7efd8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd89085640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd8406d870 0x7efd840cd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd89085640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd840cc4b0 con 0x7efd840cf310 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd89085640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efd840ccda0 con 0x7efd8406d870 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd89085640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd8406dcf0 con 0x7efd8415e550 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8359e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd8406d870 0x7efd840cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7efd840cf310 0x7efd840ce6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52780/0 (socket says 172.21.15.81:52780) 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8259c640 1 -- 172.21.15.81:0/220412573 learned_addr learned my addr 172.21.15.81:0/220412573 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd82d9d640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8415e550 0x7efd8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8359e640 1 -- 172.21.15.81:0/220412573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8415e550 msgr2=0x7efd8406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8359e640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8415e550 0x7efd8406d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.152+0000 7efd8359e640 1 -- 172.21.15.81:0/220412573 >> v1:172.21.15.81:6789/0 conn(0x7efd840cf310 legacy=0x7efd840ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd8359e640 1 -- 172.21.15.81:0/220412573 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd840cc750 con 0x7efd8406d870 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd81d9b640 1 -- 172.21.15.81:0/220412573 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2375450748 0 0) 0x7efd840cc4b0 con 0x7efd840cf310 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd8359e640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8406d870 0x7efd840cd230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0097a0 tx=0x7efd7c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f1c02fcf3d9727 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd81d9b640 1 -- 172.21.15.81:0/220412573 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c034070 con 0x7efd8406d870 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd81d9b640 1 -- 172.21.15.81:0/220412573 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c030610 con 0x7efd8406d870 2024-03-18T00:26:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.153+0000 7efd81d9b640 1 -- 172.21.15.81:0/220412573 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c0309e0 con 0x7efd8406d870 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 -- 172.21.15.81:0/220412573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8406d870 msgr2=0x7efd840cd230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8406d870 0x7efd840cd230 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efd7c0097a0 tx=0x7efd7c02b960 comp rx=0 tx=0).stop 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 -- 172.21.15.81:0/220412573 shutdown_connections 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd8406d870 0x7efd840cd230 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 --2- 172.21.15.81:0/220412573 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8415e550 0x7efd8406d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 -- 172.21.15.81:0/220412573 >> 172.21.15.81:0/220412573 conn(0x7efd840d1e60 msgr2=0x7efd840d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 -- 172.21.15.81:0/220412573 shutdown_connections 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.154+0000 7efd89085640 1 -- 172.21.15.81:0/220412573 wait complete. 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.155+0000 7efd89085640 1 Processor -- start 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.155+0000 7efd89085640 1 -- start start 2024-03-18T00:26:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 0x7efd84157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 0x7efd841606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd840cedf0 con 0x7efd840cf310 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efd840aebb0 con 0x7efd8415e550 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd89085640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd840cef70 con 0x7efd8406d870 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52216/0 (socket says 172.21.15.81:52216) 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 -- 172.21.15.81:0/1463398566 learned_addr learned my addr 172.21.15.81:0/1463398566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd82d9d640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 0x7efd84157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8359e640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 0x7efd841606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 -- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 msgr2=0x7efd84157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 0x7efd84157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 -- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 msgr2=0x7efd841606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 0x7efd841606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8259c640 1 -- 172.21.15.81:0/1463398566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd841f8370 con 0x7efd840cf310 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd82d9d640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 0x7efd84157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.156+0000 7efd8359e640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 0x7efd841606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd8259c640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c4d0 tx=0x7efd7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78018070 con 0x7efd840cf310 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd780074e0 con 0x7efd840cf310 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78004a20 con 0x7efd840cf310 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd840c9060 con 0x7efd840cf310 2024-03-18T00:26:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.157+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd840c9620 con 0x7efd840cf310 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.158+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd8404f5b0 con 0x7efd840cf310 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.158+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7efd7801b070 con 0x7efd840cf310 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.158+0000 7efd6b7fe640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 0x7efd7006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.159+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7efd78089990 con 0x7efd840cf310 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.159+0000 7efd82d9d640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 0x7efd7006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.159+0000 7efd82d9d640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 0x7efd7006e0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd841f8820 tx=0x7efd7400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.163+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7efd78058860 con 0x7efd840cf310 2024-03-18T00:26:09.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.406+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7efd840cdf00 con 0x7efd840cf310 2024-03-18T00:26:09.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.408+0000 7efd6b7fe640 1 -- 172.21.15.81:0/1463398566 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7efd78058160 con 0x7efd840cf310 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 msgr2=0x7efd7006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 0x7efd7006e0c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efd841f8820 tx=0x7efd7400b040 comp rx=0 tx=0).stop 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 msgr2=0x7efd841601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efd7800c4d0 tx=0x7efd7800c990 comp rx=0 tx=0).stop 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 shutdown_connections 2024-03-18T00:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd8415e550 0x7efd841606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd7006bc00 0x7efd7006e0c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd840cf310 0x7efd841601a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 --2- 172.21.15.81:0/1463398566 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd8406d870 0x7efd84157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 >> 172.21.15.81:0/1463398566 conn(0x7efd840d1e60 msgr2=0x7efd840d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 shutdown_connections 2024-03-18T00:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.410+0000 7efd89085640 1 -- 172.21.15.81:0/1463398566 wait complete. 2024-03-18T00:26:09.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-18T00:26:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.522+0000 7f4535227640 1 Processor -- start 2024-03-18T00:26:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.522+0000 7f4535227640 1 -- start start 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.522+0000 7f4535227640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45300d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.522+0000 7f4535227640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f453015c780 0x7f45300ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f4535227640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45300cd510 con 0x7f45300cedb0 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f4535227640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f45300cd7f0 con 0x7f453015c780 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f4535227640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f45300cdad0 con 0x7f453015c3a0 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452f59e640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45300cedb0 0x7f45300cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52794/0 (socket says 172.21.15.81:52794) 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452f59e640 1 -- 172.21.15.81:0/3139732503 learned_addr learned my addr 172.21.15.81:0/3139732503 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120006776 0 0) 0x7f45300cd510 con 0x7f45300cedb0 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4518003520 con 0x7f45300cedb0 2024-03-18T00:26:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> v2:172.21.15.136:3300/0 conn(0x7f453015c780 0x7f45300ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452ed9d640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45300d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3405537612 0 0) 0x7f4518003520 con 0x7f45300cedb0 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 msgr2=0x7f45300d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45300d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 >> v2:172.21.15.136:3300/0 conn(0x7f453015c780 msgr2=0x7f45300ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 --2- 172.21.15.81:0/3139732503 >> v2:172.21.15.136:3300/0 conn(0x7f453015c780 0x7f45300ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45300cddb0 con 0x7f45300cedb0 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f45280019f0 con 0x7f45300cedb0 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> v2:172.21.15.136:3300/0 conn(0x7f453015c780 0x7f45300ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 >> v1:172.21.15.81:6789/0 conn(0x7f45300cedb0 legacy=0x7f45300cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4518003a20 0x7f4518003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518004800 0x7f4518004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45300cd7f0 con 0x7f4518004800 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45300cdad0 con 0x7f4518003a20 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f451800ba40 con 0x7f453015c3a0 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518004800 0x7f4518004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.523+0000 7f452ed9d640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4518003a20 0x7f4518003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452f59e640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 -- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 msgr2=0x7f45180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f453015c3a0 0x7f45180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 -- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4518003a20 msgr2=0x7f4518003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4518003a20 0x7f4518003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 -- 172.21.15.81:0/3139732503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4518003520 con 0x7f4518004800 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452e59c640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518004800 0x7f4518004c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45240098a0 tx=0x7f4518005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6874ce34774a2c11 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452400f040 con 0x7f4518004800 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524004230 con 0x7f4518004800 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.524+0000 7f452dd9b640 1 -- 172.21.15.81:0/3139732503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524003610 con 0x7f4518004800 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 -- 172.21.15.81:0/3139732503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518004800 msgr2=0x7f4518004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 --2- 172.21.15.81:0/3139732503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4518004800 0x7f4518004c80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f45240098a0 tx=0x7f4518005830 comp rx=0 tx=0).stop 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f452f59e640 1 -- 172.21.15.81:0/3139732503 reap_dead start 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 -- 172.21.15.81:0/3139732503 shutdown_connections 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 -- 172.21.15.81:0/3139732503 >> 172.21.15.81:0/3139732503 conn(0x7f45300d1e60 msgr2=0x7f45300d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 -- 172.21.15.81:0/3139732503 shutdown_connections 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.525+0000 7f4535227640 1 -- 172.21.15.81:0/3139732503 wait complete. 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.526+0000 7f4535227640 1 Processor -- start 2024-03-18T00:26:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 -- start start 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4518004800 0x7f453015f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 0x7f45300d02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45300b0190 con 0x7f453006c2d0 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45300b0010 con 0x7f45301515a0 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f4535227640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f45300b0310 con 0x7f4518004800 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f452e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f452e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52238/0 (socket says 172.21.15.81:52238) 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f452e59c640 1 -- 172.21.15.81:0/2055267740 learned_addr learned my addr 172.21.15.81:0/2055267740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f452ed9d640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4518004800 0x7f453015f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.527+0000 7f452f59e640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 0x7f45300d02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 -- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4518004800 msgr2=0x7f453015f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4518004800 0x7f453015f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 -- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 msgr2=0x7f45300d02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 0x7f45300d02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 -- 172.21.15.81:0/2055267740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453015d9f0 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452f59e640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 0x7f45300d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f452e59c640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45240099c0 tx=0x7f4524004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524047070 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524042400 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453015dcd0 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45240427d0 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.528+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453015e290 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.529+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453004f5b0 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.529+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f452404a070 con 0x7f453006c2d0 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.530+0000 7f45177fe640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 0x7f451c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.530+0000 7f452ed9d640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 0x7f451c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.530+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f45240ac160 con 0x7f453006c2d0 2024-03-18T00:26:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.530+0000 7f452ed9d640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 0x7f451c06e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4520009ae0 tx=0x7f4520009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.534+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4524033070 con 0x7f453006c2d0 2024-03-18T00:26:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.775+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f45300ce370 con 0x7f453006c2d0 2024-03-18T00:26:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.777+0000 7f45177fe640 1 -- 172.21.15.81:0/2055267740 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f452407afa0 con 0x7f453006c2d0 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 msgr2=0x7f451c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 0x7f451c06e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4520009ae0 tx=0x7f4520009190 comp rx=0 tx=0).stop 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 msgr2=0x7f45300cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f45240099c0 tx=0x7f4524004730 comp rx=0 tx=0).stop 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 shutdown_connections 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45301515a0 0x7f45300d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f451c06bbd0 0x7f451c06e090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f453006c2d0 0x7f45300cfd60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 --2- 172.21.15.81:0/2055267740 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4518004800 0x7f453015f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 >> 172.21.15.81:0/2055267740 conn(0x7f45300d1e60 msgr2=0x7f45300c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 shutdown_connections 2024-03-18T00:26:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.779+0000 7f4535227640 1 -- 172.21.15.81:0/2055267740 wait complete. 2024-03-18T00:26:09.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-18T00:26:09.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.892+0000 7f8a841e1640 1 Processor -- start 2024-03-18T00:26:09.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 -- start start 2024-03-18T00:26:09.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a7c15e550 0x7f8a7c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c0cc4b0 con 0x7f8a7c06d870 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c0ccda0 con 0x7f8a7c15e550 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.893+0000 7f8a841e1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0ce240 con 0x7f8a7c0cf310 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a81f7d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a7c15e550 0x7f8a7c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47500/0 (socket says 172.21.15.81:47500) 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 -- 172.21.15.81:0/2300828924 learned_addr learned my addr 172.21.15.81:0/2300828924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 -- 172.21.15.81:0/2300828924 >> v2:172.21.15.136:3300/0 conn(0x7f8a7c15e550 msgr2=0x7f8a7c06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 --2- 172.21.15.81:0/2300828924 >> v2:172.21.15.136:3300/0 conn(0x7f8a7c15e550 0x7f8a7c06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 -- 172.21.15.81:0/2300828924 >> v1:172.21.15.136:6789/0 conn(0x7f8a7c06d870 legacy=0x7f8a7c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.894+0000 7f8a8177c640 1 -- 172.21.15.81:0/2300828924 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c06dcf0 con 0x7f8a7c0cf310 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a8177c640 1 --2- 172.21.15.81:0/2300828924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1838d2141420586 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a80f7b640 1 -- 172.21.15.81:0/2300828924 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7002f840 con 0x7f8a7c0cf310 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a80f7b640 1 -- 172.21.15.81:0/2300828924 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a7002f9e0 con 0x7f8a7c0cf310 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a80f7b640 1 -- 172.21.15.81:0/2300828924 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a7002fdb0 con 0x7f8a7c0cf310 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 -- 172.21.15.81:0/2300828924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 msgr2=0x7f8a7c0ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 --2- 172.21.15.81:0/2300828924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002ba20 comp rx=0 tx=0).stop 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 -- 172.21.15.81:0/2300828924 shutdown_connections 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 --2- 172.21.15.81:0/2300828924 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c0ce6e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 --2- 172.21.15.81:0/2300828924 >> v2:172.21.15.136:3300/0 conn(0x7f8a7c15e550 0x7f8a7c06d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.895+0000 7f8a841e1640 1 -- 172.21.15.81:0/2300828924 >> 172.21.15.81:0/2300828924 conn(0x7f8a7c0d1e60 msgr2=0x7f8a7c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.896+0000 7f8a841e1640 1 -- 172.21.15.81:0/2300828924 shutdown_connections 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.896+0000 7f8a841e1640 1 -- 172.21.15.81:0/2300828924 wait complete. 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 Processor -- start 2024-03-18T00:26:09.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 -- start start 2024-03-18T00:26:09.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a7c06d870 0x7f8a7c1f8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c09e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0aebb0 con 0x7f8a7c15e550 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0cca30 con 0x7f8a7c06d870 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.897+0000 7f8a841e1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c15e930 con 0x7f8a7c0cf310 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52244/0 (socket says 172.21.15.81:52244) 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 -- 172.21.15.81:0/264168579 learned_addr learned my addr 172.21.15.81:0/264168579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a81f7d640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a7c06d870 0x7f8a7c1f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8177c640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c09e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 -- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 msgr2=0x7f8a7c09e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c09e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 -- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a7c06d870 msgr2=0x7f8a7c1f8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a7c06d870 0x7f8a7c1f8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:09.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 -- 172.21.15.81:0/264168579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c09e880 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a8277e640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c400 tx=0x7f8a7400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74017070 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a740052d0 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c09eb40 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a74003810 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.898+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c09f100 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.899+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c04f5b0 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.900+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8a7401a070 con 0x7f8a7c15e550 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.900+0000 7f8a7a7fc640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 0x7f8a6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.900+0000 7f8a81f7d640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 0x7f8a6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:09.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.900+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f8a74089a20 con 0x7f8a7c15e550 2024-03-18T00:26:09.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.901+0000 7f8a81f7d640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 0x7f8a6806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0073f0 tx=0x7f8a6c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:09.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:09.905+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8a740588f0 con 0x7f8a7c15e550 2024-03-18T00:26:10.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.143+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f8a7c06cff0 con 0x7f8a7c15e550 2024-03-18T00:26:10.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.145+0000 7f8a7a7fc640 1 -- 172.21.15.81:0/264168579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f8a740581f0 con 0x7f8a7c15e550 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 msgr2=0x7f8a6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 0x7f8a6806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0073f0 tx=0x7f8a6c00b040 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 msgr2=0x7f8a7c1f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400c400 tx=0x7f8a7400c8c0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 shutdown_connections 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a6806bbd0 0x7f8a6806e090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a7c15e550 0x7f8a7c1f37b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a7c0cf310 0x7f8a7c09e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 --2- 172.21.15.81:0/264168579 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a7c06d870 0x7f8a7c1f8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 >> 172.21.15.81:0/264168579 conn(0x7f8a7c0d1e60 msgr2=0x7f8a7c0aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 shutdown_connections 2024-03-18T00:26:10.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.147+0000 7f8a841e1640 1 -- 172.21.15.81:0/264168579 wait complete. 2024-03-18T00:26:10.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-18T00:26:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.258+0000 7f229273b640 1 Processor -- start 2024-03-18T00:26:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f229273b640 1 -- start start 2024-03-18T00:26:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f229273b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f229273b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0b3440 con 0x7f228c15ea90 2024-03-18T00:26:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f229273b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228c0d20a0 con 0x7f228c1622b0 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f229273b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0d16c0 con 0x7f228c0d10d0 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f2290cd8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f228c15ea90 0x7f228c15ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52802/0 (socket says 172.21.15.81:52802) 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.259+0000 7f2290cd8640 1 -- 172.21.15.81:0/1435250386 learned_addr learned my addr 172.21.15.81:0/1435250386 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228b7fe640 1 --2- 172.21.15.81:0/1435250386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075706548 0 0) 0x7f228c0b3440 con 0x7f228c15ea90 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2274003520 con 0x7f228c15ea90 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981258103 0 0) 0x7f228c0d20a0 con 0x7f228c1622b0 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f228c0b3440 con 0x7f228c1622b0 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228b7fe640 1 -- 172.21.15.81:0/1435250386 >> v1:172.21.15.136:6789/0 conn(0x7f228c1622b0 legacy=0x7f228c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1225363576 0 0) 0x7f2274003520 con 0x7f228c15ea90 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228b7fe640 1 -- 172.21.15.81:0/1435250386 >> v1:172.21.15.81:6789/0 conn(0x7f228c15ea90 legacy=0x7f228c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.260+0000 7f228b7fe640 1 -- 172.21.15.81:0/1435250386 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c0d2380 con 0x7f228c0d10d0 2024-03-18T00:26:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f228b7fe640 1 --2- 172.21.15.81:0/1435250386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c162da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22800097d0 tx=0x7f228002b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3f40590c36542a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2280037070 con 0x7f228c0d10d0 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2280030510 con 0x7f228c0d10d0 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f228affd640 1 -- 172.21.15.81:0/1435250386 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22840019f0 con 0x7f228c0d10d0 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 -- 172.21.15.81:0/1435250386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 msgr2=0x7f228c162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 --2- 172.21.15.81:0/1435250386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c162da0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22800097d0 tx=0x7f228002b6e0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 -- 172.21.15.81:0/1435250386 shutdown_connections 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 --2- 172.21.15.81:0/1435250386 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c162da0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 -- 172.21.15.81:0/1435250386 >> 172.21.15.81:0/1435250386 conn(0x7f228c0d4070 msgr2=0x7f228c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 -- 172.21.15.81:0/1435250386 shutdown_connections 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.261+0000 7f229273b640 1 -- 172.21.15.81:0/1435250386 wait complete. 2024-03-18T00:26:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 Processor -- start 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 -- start start 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c156630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c15ea90 0x7f228c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0cfc90 con 0x7f228c1622b0 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0d2660 con 0x7f228c15ea90 2024-03-18T00:26:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.263+0000 7f229273b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0cfe10 con 0x7f228c0d10d0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52256/0 (socket says 172.21.15.81:52256) 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 -- 172.21.15.81:0/117764906 learned_addr learned my addr 172.21.15.81:0/117764906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f228bfff640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c156630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f228b7fe640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c15ea90 0x7f228c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 -- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 msgr2=0x7f228c156630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c156630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 -- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c15ea90 msgr2=0x7f228c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c15ea90 0x7f228c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 -- 172.21.15.81:0/117764906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c156b70 con 0x7f228c1622b0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2290cd8640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2284002230 tx=0x7f228400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284017070 con 0x7f228c1622b0 2024-03-18T00:26:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228400ce50 con 0x7f228c1622b0 2024-03-18T00:26:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284012600 con 0x7f228c1622b0 2024-03-18T00:26:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c0b75b0 con 0x7f228c1622b0 2024-03-18T00:26:10.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.264+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c0b7b70 con 0x7f228c1622b0 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.265+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c04f5b0 con 0x7f228c1622b0 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.266+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f228401a070 con 0x7f228c1622b0 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.266+0000 7f2288ff9640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 0x7f227806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.266+0000 7f228bfff640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 0x7f227806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.266+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f228408a4c0 con 0x7f228c1622b0 2024-03-18T00:26:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.267+0000 7f228bfff640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 0x7f227806e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f227c0011e0 tx=0x7f227c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.271+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f228c156b70 con 0x7f228c1622b0 2024-03-18T00:26:10.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.509+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f228c0d18d0 con 0x7f228c1622b0 2024-03-18T00:26:10.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.511+0000 7f2288ff9640 1 -- 172.21.15.81:0/117764906 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7f2284058d40 con 0x7f228c1622b0 2024-03-18T00:26:10.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 msgr2=0x7f227806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 0x7f227806e090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f227c0011e0 tx=0x7f227c009040 comp rx=0 tx=0).stop 2024-03-18T00:26:10.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 msgr2=0x7f228c0b8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2284002230 tx=0x7f228400a430 comp rx=0 tx=0).stop 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 shutdown_connections 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f227806bbd0 0x7f227806e090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c1622b0 0x7f228c0b8fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f228c15ea90 0x7f228c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 --2- 172.21.15.81:0/117764906 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f228c0d10d0 0x7f228c156630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 >> 172.21.15.81:0/117764906 conn(0x7f228c0d4070 msgr2=0x7f228c15eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 shutdown_connections 2024-03-18T00:26:10.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.513+0000 7f229273b640 1 -- 172.21.15.81:0/117764906 wait complete. 2024-03-18T00:26:10.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-18T00:26:10.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.624+0000 7f074dd37640 1 Processor -- start 2024-03-18T00:26:10.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.624+0000 7f074dd37640 1 -- start start 2024-03-18T00:26:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f074dd37640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f074806cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f074dd37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f074806e6f0 con 0x7f074806d1b0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f074dd37640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f074806d650 con 0x7f074815e880 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f074dd37640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f074806d930 con 0x7f0748154a90 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f0746ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f074806d1b0 0x7f074815e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52812/0 (socket says 172.21.15.81:52812) 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f0746ffd640 1 -- 172.21.15.81:0/113164236 learned_addr learned my addr 172.21.15.81:0/113164236 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f074806cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192457515 0 0) 0x7f074806e6f0 con 0x7f074806d1b0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.625+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0730003520 con 0x7f074806d1b0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1817023756 0 0) 0x7f0730003520 con 0x7f074806d1b0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 msgr2=0x7f074806cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f074806cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 >> v1:172.21.15.136:6789/0 conn(0x7f074815e880 legacy=0x7f0748071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f074806dc10 con 0x7f074806d1b0 2024-03-18T00:26:10.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f073c001670 con 0x7f074806d1b0 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f074806cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 >> v1:172.21.15.81:6789/0 conn(0x7f074806d1b0 legacy=0x7f074815e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f0730003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f0730004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730004d40 0x7f07300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f074806d930 con 0x7f0730003a50 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f073000baa0 con 0x7f0730004d40 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f073000bca0 con 0x7f0748154a90 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f0730003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f0746ffd640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f0730004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f0747fff640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730004d40 0x7f07300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 -- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 msgr2=0x7f0730004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:10.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0748154a90 0x7f0730004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 -- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730004d40 msgr2=0x7f07300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0730004d40 0x7f07300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.626+0000 7f07477fe640 1 -- 172.21.15.81:0/113164236 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0730003520 con 0x7f0730003a50 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.627+0000 7f07477fe640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f0730003e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c90 tx=0x7f0730005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715c190b6571dc59 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.627+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738039070 con 0x7f0730003a50 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.627+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073802c8f0 con 0x7f0730003a50 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.627+0000 7f07467fc640 1 -- 172.21.15.81:0/113164236 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738009860 con 0x7f0730003a50 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 -- 172.21.15.81:0/113164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 msgr2=0x7f0730003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 --2- 172.21.15.81:0/113164236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f0730003e30 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c90 tx=0x7f0730005830 comp rx=0 tx=0).stop 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f0747fff640 1 -- 172.21.15.81:0/113164236 reap_dead start 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 -- 172.21.15.81:0/113164236 shutdown_connections 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 -- 172.21.15.81:0/113164236 >> 172.21.15.81:0/113164236 conn(0x7f074806b5e0 msgr2=0x7f074806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 -- 172.21.15.81:0/113164236 shutdown_connections 2024-03-18T00:26:10.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.628+0000 7f074dd37640 1 -- 172.21.15.81:0/113164236 wait complete. 2024-03-18T00:26:10.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.629+0000 7f074dd37640 1 Processor -- start 2024-03-18T00:26:10.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.629+0000 7f074dd37640 1 -- start start 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07481574a0 0x7f0748157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0748155170 0x7f07481555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0748154e70 con 0x7f0730003a50 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f074806e1d0 con 0x7f0748155170 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0748154ff0 con 0x7f07481574a0 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52276/0 (socket says 172.21.15.81:52276) 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 -- 172.21.15.81:0/991288466 learned_addr learned my addr 172.21.15.81:0/991288466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 -- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07481574a0 msgr2=0x7f0748157920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07481574a0 0x7f0748157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 -- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0748155170 msgr2=0x7f07481555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f0747fff640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0748155170 0x7f07481555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0748155170 0x7f07481555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 -- 172.21.15.81:0/991288466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0748155e10 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f07477fe640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c90 tx=0x7f0738004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738039050 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0738045070 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481560f0 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738009860 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.630+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07481566b0 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.631+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f074815c120 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.632+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f073804a460 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.632+0000 7f072ffff640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 0x7f073406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.632+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f07380ac720 con 0x7f0730003a50 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.632+0000 7f0746ffd640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 0x7f073406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.633+0000 7f0746ffd640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 0x7f073406e0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f073c001cf0 tx=0x7f073c001b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.637+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f074815c120 con 0x7f0730003a50 2024-03-18T00:26:10.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.877+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f0748067a40 con 0x7f0730003a50 2024-03-18T00:26:10.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.879+0000 7f072ffff640 1 -- 172.21.15.81:0/991288466 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f0748067a40 con 0x7f0730003a50 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 msgr2=0x7f073406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 0x7f073406e0c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f073c001cf0 tx=0x7f073c001b80 comp rx=0 tx=0).stop 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 msgr2=0x7f07481495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0738009c90 tx=0x7f0738004730 comp rx=0 tx=0).stop 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 shutdown_connections 2024-03-18T00:26:10.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0748155170 0x7f07481555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f07481574a0 0x7f0748157920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f073406bc00 0x7f073406e0c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 --2- 172.21.15.81:0/991288466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0730003a50 0x7f07481495b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.881+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 >> 172.21.15.81:0/991288466 conn(0x7f074806b5e0 msgr2=0x7f074815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.882+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 shutdown_connections 2024-03-18T00:26:10.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.882+0000 7f074dd37640 1 -- 172.21.15.81:0/991288466 wait complete. 2024-03-18T00:26:10.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-18T00:26:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.993+0000 7f538dbda640 1 Processor -- start 2024-03-18T00:26:10.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.993+0000 7f538dbda640 1 -- start start 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f538dbda640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f538815ad40 0x7f53880ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f538dbda640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f53880d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f538dbda640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f538815ee60 con 0x7f53880b3860 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f538dbda640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f538815f140 con 0x7f538815ad40 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f538dbda640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f538815f420 con 0x7f53880b3400 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53877fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f538815ad40 0x7f53880ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f5387fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f53880b3860 0x7f538806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52824/0 (socket says 172.21.15.81:52824) 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f5387fff640 1 -- 172.21.15.81:0/1128058442 learned_addr learned my addr 172.21.15.81:0/1128058442 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f5386ffd640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f53880d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53877fe640 1 -- 172.21.15.81:0/1128058442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 msgr2=0x7f53880d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53877fe640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f53880d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:10.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53877fe640 1 -- 172.21.15.81:0/1128058442 >> v1:172.21.15.81:6789/0 conn(0x7f53880b3860 legacy=0x7f538806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53877fe640 1 -- 172.21.15.81:0/1128058442 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f538815f700 con 0x7f538815ad40 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.994+0000 7f53867fc640 1 -- 172.21.15.81:0/1128058442 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352315275 0 0) 0x7f538815ee60 con 0x7f53880b3860 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.995+0000 7f53877fe640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538815ad40 0x7f53880ad800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f53780097a0 tx=0x7f537802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5070865ad548c06a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.995+0000 7f53867fc640 1 -- 172.21.15.81:0/1128058442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53780315a0 con 0x7f538815ad40 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.995+0000 7f53867fc640 1 -- 172.21.15.81:0/1128058442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5378037070 con 0x7f538815ad40 2024-03-18T00:26:10.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.995+0000 7f53867fc640 1 -- 172.21.15.81:0/1128058442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5378031960 con 0x7f538815ad40 2024-03-18T00:26:10.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 -- 172.21.15.81:0/1128058442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538815ad40 msgr2=0x7f53880ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538815ad40 0x7f53880ad800 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f53780097a0 tx=0x7f537802b840 comp rx=0 tx=0).stop 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 -- 172.21.15.81:0/1128058442 shutdown_connections 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f53880d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 --2- 172.21.15.81:0/1128058442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f538815ad40 0x7f53880ad800 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 -- 172.21.15.81:0/1128058442 >> 172.21.15.81:0/1128058442 conn(0x7f538806b5e0 msgr2=0x7f538806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 -- 172.21.15.81:0/1128058442 shutdown_connections 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.996+0000 7f538dbda640 1 -- 172.21.15.81:0/1128058442 wait complete. 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.997+0000 7f538dbda640 1 Processor -- start 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.997+0000 7f538dbda640 1 -- start start 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f5388147e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f538815ad40 0x7f53880ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f538815ea10 con 0x7f53880b3860 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f538815b330 con 0x7f538815ad40 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f538dbda640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f538815eb90 con 0x7f53880b3400 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52282/0 (socket says 172.21.15.81:52282) 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 -- 172.21.15.81:0/4174198601 learned_addr learned my addr 172.21.15.81:0/4174198601 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f53877fe640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f5388147e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5387fff640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f538815ad40 0x7f53880ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 -- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 msgr2=0x7f5388147e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f5388147e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 -- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f538815ad40 msgr2=0x7f53880ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f538815ad40 0x7f53880ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 -- 172.21.15.81:0/4174198601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53881483b0 con 0x7f53880b3860 2024-03-18T00:26:11.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f53877fe640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f5388147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.998+0000 7f5386ffd640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f537c00d5f0 tx=0x7f537c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.999+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0125f0 con 0x7f53880b3860 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.999+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f537c019070 con 0x7f53880b3860 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.999+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f537c0129d0 con 0x7f53880b3860 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.999+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f538809b8e0 con 0x7f53880b3860 2024-03-18T00:26:11.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:10.999+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f538814c0e0 con 0x7f53880b3860 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.000+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f538804f5b0 con 0x7f53880b3860 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.000+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f537c012b70 con 0x7f53880b3860 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.001+0000 7f536ffff640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 0x7f537406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.001+0000 7f53877fe640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 0x7f537406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.001+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f537c08aac0 con 0x7f53880b3860 2024-03-18T00:26:11.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.001+0000 7f53877fe640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 0x7f537406e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5378036000 tx=0x7f5378008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.005+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f537c059990 con 0x7f53880b3860 2024-03-18T00:26:11.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.249+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f5388071ad0 con 0x7f53880b3860 2024-03-18T00:26:11.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.251+0000 7f536ffff640 1 -- 172.21.15.81:0/4174198601 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f537c059290 con 0x7f53880b3860 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 msgr2=0x7f537406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 0x7f537406e090 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5378036000 tx=0x7f5378008030 comp rx=0 tx=0).stop 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 msgr2=0x7f53880cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f537c00d5f0 tx=0x7f537c00dab0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 shutdown_connections 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f538815ad40 0x7f53880ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f537406bbd0 0x7f537406e090 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53880b3860 0x7f53880cd460 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 --2- 172.21.15.81:0/4174198601 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f53880b3400 0x7f5388147e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 >> 172.21.15.81:0/4174198601 conn(0x7f538806b5e0 msgr2=0x7f538814d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 shutdown_connections 2024-03-18T00:26:11.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.253+0000 7f538dbda640 1 -- 172.21.15.81:0/4174198601 wait complete. 2024-03-18T00:26:11.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.364+0000 7f11e26f1640 1 Processor -- start 2024-03-18T00:26:11.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.364+0000 7f11e26f1640 1 -- start start 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e26f1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e26f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11dc0d0620 0x7f11dc0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e26f1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11dc15ee60 con 0x7f11dc15ad40 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e26f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f11dc0b3b10 con 0x7f11dc0d0620 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e26f1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc15f140 con 0x7f11dc0ad800 2024-03-18T00:26:11.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11dc0d0620 0x7f11dc0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11dbfff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f11dc15ad40 0x7f11dc0b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52830/0 (socket says 172.21.15.81:52830) 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f11dc0d0620 0x7f11dc0722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52296/0 (socket says 172.21.15.81:52296) 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11dbfff640 1 -- 172.21.15.81:0/510200349 learned_addr learned my addr 172.21.15.81:0/510200349 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11db7fe640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 -- 172.21.15.81:0/510200349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 msgr2=0x7f11dc0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 -- 172.21.15.81:0/510200349 >> v1:172.21.15.81:6789/0 conn(0x7f11dc15ad40 legacy=0x7f11dc0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11e0c8e640 1 -- 172.21.15.81:0/510200349 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc15f420 con 0x7f11dc0d0620 2024-03-18T00:26:11.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.365+0000 7f11daffd640 1 -- 172.21.15.81:0/510200349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474803798 0 0) 0x7f11dc15ee60 con 0x7f11dc15ad40 2024-03-18T00:26:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.366+0000 7f11e0c8e640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0722c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11d400bfa0 tx=0x7f11d402e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24fc7b63e44904a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.366+0000 7f11daffd640 1 -- 172.21.15.81:0/510200349 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d402e9b0 con 0x7f11dc0d0620 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.366+0000 7f11daffd640 1 -- 172.21.15.81:0/510200349 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d402eb50 con 0x7f11dc0d0620 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.366+0000 7f11daffd640 1 -- 172.21.15.81:0/510200349 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d4009540 con 0x7f11dc0d0620 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 -- 172.21.15.81:0/510200349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 msgr2=0x7f11dc0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0722c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f11d400bfa0 tx=0x7f11d402e010 comp rx=0 tx=0).stop 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 -- 172.21.15.81:0/510200349 shutdown_connections 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0722c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 --2- 172.21.15.81:0/510200349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 -- 172.21.15.81:0/510200349 >> 172.21.15.81:0/510200349 conn(0x7f11dc06b5e0 msgr2=0x7f11dc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 -- 172.21.15.81:0/510200349 shutdown_connections 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.367+0000 7f11e26f1640 1 -- 172.21.15.81:0/510200349 wait complete. 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.368+0000 7f11e26f1640 1 Processor -- start 2024-03-18T00:26:11.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.368+0000 7f11e26f1640 1 -- start start 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc09d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11dc15ad40 0x7f11dc06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc15b2a0 con 0x7f11dc0d0620 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11dc15b120 con 0x7f11dc15ad40 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11e26f1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11dc15ea10 con 0x7f11dc0ad800 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52310/0 (socket says 172.21.15.81:52310) 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 -- 172.21.15.81:0/854526956 learned_addr learned my addr 172.21.15.81:0/854526956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 -- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 msgr2=0x7f11dc09d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc09d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 -- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11dc15ad40 msgr2=0x7f11dc06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11dc15ad40 0x7f11dc06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.369+0000 7f11db7fe640 1 -- 172.21.15.81:0/854526956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11dc09c8c0 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11db7fe640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11d000d5f0 tx=0x7f11d000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00125f0 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11d0019070 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11dc1450d0 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11d00129d0 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.370+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11dc09ce20 con 0x7f11dc0d0620 2024-03-18T00:26:11.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.371+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11dc04f5b0 con 0x7f11dc0d0620 2024-03-18T00:26:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.371+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f11d0012b70 con 0x7f11dc0d0620 2024-03-18T00:26:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.371+0000 7f11d8ff9640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 0x7f11c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.372+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f11d008ab50 con 0x7f11dc0d0620 2024-03-18T00:26:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.372+0000 7f11dbfff640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 0x7f11c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.372+0000 7f11dbfff640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 0x7f11c806e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11cc007fd0 tx=0x7f11cc007920 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.376+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f11dc09c8c0 con 0x7f11dc0d0620 2024-03-18T00:26:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.550+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f11dc071ad0 con 0x7f11dc0d0620 2024-03-18T00:26:11.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.551+0000 7f11d8ff9640 1 -- 172.21.15.81:0/854526956 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+12903 (secure 0 0 0) 0x7f11d0059990 con 0x7f11dc0d0620 2024-03-18T00:26:11.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:11.552 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":28,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:08.675556+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 msgr2=0x7f11c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 0x7f11c806e090 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f11cc007fd0 tx=0x7f11cc007920 comp rx=0 tx=0).stop 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 msgr2=0x7f11dc0ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f11d000d5f0 tx=0x7f11d000dab0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 shutdown_connections 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f11dc15ad40 0x7f11dc06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f11c806bbd0 0x7f11c806e090 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11dc0d0620 0x7f11dc0ced00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 --2- 172.21.15.81:0/854526956 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11dc0ad800 0x7f11dc09d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 >> 172.21.15.81:0/854526956 conn(0x7f11dc06b5e0 msgr2=0x7f11dc15b940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 shutdown_connections 2024-03-18T00:26:11.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.553+0000 7f11e26f1640 1 -- 172.21.15.81:0/854526956 wait complete. 2024-03-18T00:26:11.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T00:26:11.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T00:26:11.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.668+0000 7fcca611b640 1 Processor -- start 2024-03-18T00:26:11.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.668+0000 7fcca611b640 1 -- start start 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcca611b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcca00d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcca611b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca00d2e10 con 0x7fcca00b4d80 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcca611b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcca00d02f0 con 0x7fcca015eaa0 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcca611b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00d4c10 con 0x7fcca015e6c0 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcc9ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcca00b4d80 0x7fcca00d2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52842/0 (socket says 172.21.15.81:52842) 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcc9ffff640 1 -- 172.21.15.81:0/3354390631 learned_addr learned my addr 172.21.15.81:0/3354390631 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:11.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195831349 0 0) 0x7fcca00d2e10 con 0x7fcca00b4d80 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcca00d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.669+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc88003520 con 0x7fcca00b4d80 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3405166239 0 0) 0x7fcc88003520 con 0x7fcca00b4d80 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 msgr2=0x7fcca00d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcca00d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 >> v1:172.21.15.136:6789/0 conn(0x7fcca015eaa0 legacy=0x7fcca00d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca00d4ef0 con 0x7fcca00b4d80 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7fcc980019f0 con 0x7fcca00b4d80 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 >> v1:172.21.15.81:6789/0 conn(0x7fcca00b4d80 legacy=0x7fcca00d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc880039e0 0x7fcc88003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcc88004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc88004d40 0x7fcc880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00d4c10 con 0x7fcc880039e0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcc8800bba0 con 0x7fcc88004d40 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcc8800bda0 con 0x7fcca015e6c0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc880039e0 0x7fcc88003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9effd640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcc88004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9ffff640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc88004d40 0x7fcc880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 -- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 msgr2=0x7fcc88004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcca015e6c0 0x7fcc88004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 -- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc88004d40 msgr2=0x7fcc880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc88004d40 0x7fcc880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9f7fe640 1 -- 172.21.15.81:0/3354390631 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc88003520 con 0x7fcc880039e0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.670+0000 7fcc9ffff640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcc88004d40 0x7fcc880051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc880039e0 0x7fcc88003e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000ba30 tx=0x7fcc88005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1300d6486be55f9a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc90036020 con 0x7fcc880039e0 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc90032640 con 0x7fcc880039e0 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcc9e7fc640 1 -- 172.21.15.81:0/3354390631 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9000b600 con 0x7fcc880039e0 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcca611b640 1 -- 172.21.15.81:0/3354390631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc880039e0 msgr2=0x7fcc88003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcca611b640 1 --2- 172.21.15.81:0/3354390631 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc880039e0 0x7fcc88003e00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000ba30 tx=0x7fcc88005830 comp rx=0 tx=0).stop 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcc9ffff640 1 -- 172.21.15.81:0/3354390631 reap_dead start 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcca611b640 1 -- 172.21.15.81:0/3354390631 shutdown_connections 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcca611b640 1 -- 172.21.15.81:0/3354390631 >> 172.21.15.81:0/3354390631 conn(0x7fcca00d40f0 msgr2=0x7fcca00d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.671+0000 7fcca611b640 1 -- 172.21.15.81:0/3354390631 shutdown_connections 2024-03-18T00:26:11.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.672+0000 7fcca611b640 1 -- 172.21.15.81:0/3354390631 wait complete. 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.673+0000 7fcca611b640 1 Processor -- start 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.673+0000 7fcca611b640 1 -- start start 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.673+0000 7fcca611b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc880039e0 0x7fcca015a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.673+0000 7fcca611b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca00b8c30 0x7fcca01e7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00c8c50 con 0x7fcca00cb1c0 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fcca00cfdd0 con 0x7fcca00b8c30 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fcca00cf7c0 con 0x7fcc880039e0 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52332/0 (socket says 172.21.15.81:52332) 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 -- 172.21.15.81:0/3624146148 learned_addr learned my addr 172.21.15.81:0/3624146148 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc880039e0 0x7fcca015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9ffff640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca00b8c30 0x7fcca01e7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 -- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc880039e0 msgr2=0x7fcca015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc880039e0 0x7fcca015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 -- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca00b8c30 msgr2=0x7fcca01e7f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca00b8c30 0x7fcca01e7f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 -- 172.21.15.81:0/3624146148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcca01e60a0 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc9effd640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400f850 tx=0x7fcc9400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400fe40 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc94018070 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcca01e6380 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc9400d730 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.674+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcca01e6940 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.675+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcca004f540 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.676+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fcc9400d8d0 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.676+0000 7fcc87fff640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 0x7fcc8c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.676+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7fcc9408a3a0 con 0x7fcca00cb1c0 2024-03-18T00:26:11.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.676+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 0x7fcc8c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.677+0000 7fcc9f7fe640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 0x7fcc8c06e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000ba00 tx=0x7fcc9003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.680+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fcc94058c20 con 0x7fcca00cb1c0 2024-03-18T00:26:11.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.854+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcca00c9910 con 0x7fcca00cb1c0 2024-03-18T00:26:11.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.854+0000 7fcc87fff640 1 -- 172.21.15.81:0/3624146148 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7fcc9405ccc0 con 0x7fcca00cb1c0 2024-03-18T00:26:11.855 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 msgr2=0x7fcc8c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 0x7fcc8c06e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcc9000ba00 tx=0x7fcc9003d040 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 msgr2=0x7fcca00b86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fcc9400f850 tx=0x7fcc9400fd10 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 shutdown_connections 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fcca00b8c30 0x7fcca01e7f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fcc8c06bbd0 0x7fcc8c06e090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcca00cb1c0 0x7fcca00b86f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 --2- 172.21.15.81:0/3624146148 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fcc880039e0 0x7fcca015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 >> 172.21.15.81:0/3624146148 conn(0x7fcca00d40f0 msgr2=0x7fcca015c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 shutdown_connections 2024-03-18T00:26:11.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.856+0000 7fcca611b640 1 -- 172.21.15.81:0/3624146148 wait complete. 2024-03-18T00:26:11.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T00:26:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.967+0000 7f601144b640 1 Processor -- start 2024-03-18T00:26:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.967+0000 7f601144b640 1 -- start start 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f601144b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f600c1622b0 0x7f600c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f601144b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f600c162690 0x7f600c162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f601144b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600c0b3440 con 0x7f600c0cec80 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f601144b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f600c0d16c0 con 0x7f600c162690 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f601144b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f600c0d2660 con 0x7f600c1622b0 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f600c162690 0x7f600c162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f600c0cec80 0x7f600c0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52854/0 (socket says 172.21.15.81:52854) 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f600c162690 0x7f600c162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52344/0 (socket says 172.21.15.81:52344) 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600b7fe640 1 -- 172.21.15.81:0/1298866843 learned_addr learned my addr 172.21.15.81:0/1298866843 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600affd640 1 --2- 172.21.15.81:0/1298866843 >> v2:172.21.15.136:3300/0 conn(0x7f600c1622b0 0x7f600c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 -- 172.21.15.81:0/1298866843 >> v2:172.21.15.136:3300/0 conn(0x7f600c1622b0 msgr2=0x7f600c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 --2- 172.21.15.81:0/1298866843 >> v2:172.21.15.136:3300/0 conn(0x7f600c1622b0 0x7f600c0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 -- 172.21.15.81:0/1298866843 >> v1:172.21.15.81:6789/0 conn(0x7f600c0cec80 legacy=0x7f600c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f600a7fc640 1 -- 172.21.15.81:0/1298866843 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c0d20a0 con 0x7f600c162690 2024-03-18T00:26:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.968+0000 7f6009ffb640 1 -- 172.21.15.81:0/1298866843 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685559608 0 0) 0x7f600c0b3440 con 0x7f600c0cec80 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.969+0000 7f600a7fc640 1 --2- 172.21.15.81:0/1298866843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c162690 0x7f600c162b20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f60000097a0 tx=0x7f600002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75614040b23a4ff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.969+0000 7f6009ffb640 1 -- 172.21.15.81:0/1298866843 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000038070 con 0x7f600c162690 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.969+0000 7f6009ffb640 1 -- 172.21.15.81:0/1298866843 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000031700 con 0x7f600c162690 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.969+0000 7f6009ffb640 1 -- 172.21.15.81:0/1298866843 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000031ad0 con 0x7f600c162690 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 -- 172.21.15.81:0/1298866843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c162690 msgr2=0x7f600c162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 --2- 172.21.15.81:0/1298866843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c162690 0x7f600c162b20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f60000097a0 tx=0x7f600002b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 -- 172.21.15.81:0/1298866843 shutdown_connections 2024-03-18T00:26:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 --2- 172.21.15.81:0/1298866843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c162690 0x7f600c162b20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 --2- 172.21.15.81:0/1298866843 >> v2:172.21.15.136:3300/0 conn(0x7f600c1622b0 0x7f600c0d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 -- 172.21.15.81:0/1298866843 >> 172.21.15.81:0/1298866843 conn(0x7f600c0d4070 msgr2=0x7f600c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 -- 172.21.15.81:0/1298866843 shutdown_connections 2024-03-18T00:26:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.970+0000 7f601144b640 1 -- 172.21.15.81:0/1298866843 wait complete. 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.971+0000 7f601144b640 1 Processor -- start 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.971+0000 7f601144b640 1 -- start start 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f600c0cec80 0x7f600c0b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c162690 0x7f600c14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600c15faa0 con 0x7f600c1622b0 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f600c0d2ab0 con 0x7f600c162690 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f600c15fc20 con 0x7f600c0cec80 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52358/0 (socket says 172.21.15.81:52358) 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 -- 172.21.15.81:0/127519322 learned_addr learned my addr 172.21.15.81:0/127519322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600b7fe640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c162690 0x7f600c14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600affd640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f600c0cec80 0x7f600c0b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 -- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f600c0cec80 msgr2=0x7f600c0b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f600c0cec80 0x7f600c0b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 -- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c162690 msgr2=0x7f600c14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c162690 0x7f600c14ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 -- 172.21.15.81:0/127519322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c160520 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f600a7fc640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60000098c0 tx=0x7f60000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000038040 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6000043070 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6000031ed0 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.972+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c160800 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.973+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c14c400 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.974+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f600c04f5b0 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.974+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f600003b070 con 0x7f600c1622b0 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.974+0000 7f5ff37fe640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 0x7f5ff806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.975+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f60000abd20 con 0x7f600c1622b0 2024-03-18T00:26:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.975+0000 7f600affd640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 0x7f5ff806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.975+0000 7f600affd640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 0x7f5ff806e090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc006fd0 tx=0x7f5ffc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:11.979+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6000030070 con 0x7f600c1622b0 2024-03-18T00:26:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.152+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f600c0d18d0 con 0x7f600c1622b0 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.152+0000 7f5ff37fe640 1 -- 172.21.15.81:0/127519322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) ==== 84+0+65 (secure 0 0 0) 0x7f600007aad0 con 0x7f600c1622b0 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-03-18T00:26:12.153 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-03-18T00:26:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 msgr2=0x7f5ff806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 0x7f5ff806e090 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc006fd0 tx=0x7f5ffc008040 comp rx=0 tx=0).stop 2024-03-18T00:26:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 msgr2=0x7f600c0b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f60000098c0 tx=0x7f60000046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 shutdown_connections 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f600c162690 0x7f600c14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ff806bbd0 0x7f5ff806e090 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f600c1622b0 0x7f600c0b9940 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 --2- 172.21.15.81:0/127519322 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f600c0cec80 0x7f600c0b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 >> 172.21.15.81:0/127519322 conn(0x7f600c0d4070 msgr2=0x7f600c0b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.154+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 shutdown_connections 2024-03-18T00:26:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.155+0000 7f601144b640 1 -- 172.21.15.81:0/127519322 wait complete. 2024-03-18T00:26:12.166 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T00:26:12.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T00:26:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.269+0000 7f27fe49a640 1 Processor -- start 2024-03-18T00:26:12.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.269+0000 7f27fe49a640 1 -- start start 2024-03-18T00:26:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27fe49a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27f80cedf0 0x7f27f80d0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27fe49a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f80d06d0 0x7f27f80d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27fe49a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27f806c510 con 0x7f27f8161810 2024-03-18T00:26:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27fe49a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f27f80b13b0 con 0x7f27f80cedf0 2024-03-18T00:26:12.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27fe49a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80cc6c0 con 0x7f27f80d06d0 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27f77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27f80cedf0 0x7f27f80d0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27f77fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f27f80cedf0 0x7f27f80d0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52370/0 (socket says 172.21.15.81:52370) 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.270+0000 7f27f77fe640 1 -- 172.21.15.81:0/2687234284 learned_addr learned my addr 172.21.15.81:0/2687234284 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27fca37640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f80d06d0 0x7f27f80d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27f77fe640 1 -- 172.21.15.81:0/2687234284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f80d06d0 msgr2=0x7f27f80d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27f77fe640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f80d06d0 0x7f27f80d0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27f77fe640 1 -- 172.21.15.81:0/2687234284 >> v1:172.21.15.136:6789/0 conn(0x7f27f8161810 legacy=0x7f27f80ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27f77fe640 1 -- 172.21.15.81:0/2687234284 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f80cc9a0 con 0x7f27f80cedf0 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.271+0000 7f27f77fe640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80d0190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009870 tx=0x7f27ec02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7456295eb815520a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27f6ffd640 1 -- 172.21.15.81:0/2687234284 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec034070 con 0x7f27f80cedf0 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27f6ffd640 1 -- 172.21.15.81:0/2687234284 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27ec030840 con 0x7f27f80cedf0 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27f6ffd640 1 -- 172.21.15.81:0/2687234284 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27ec030c10 con 0x7f27f80cedf0 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 -- 172.21.15.81:0/2687234284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 msgr2=0x7f27f80d0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80d0190 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f27ec009870 tx=0x7f27ec02b980 comp rx=0 tx=0).stop 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 -- 172.21.15.81:0/2687234284 shutdown_connections 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f80d06d0 0x7f27f80d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 --2- 172.21.15.81:0/2687234284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80d0190 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 -- 172.21.15.81:0/2687234284 >> 172.21.15.81:0/2687234284 conn(0x7f27f80d1e60 msgr2=0x7f27f80d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 -- 172.21.15.81:0/2687234284 shutdown_connections 2024-03-18T00:26:12.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.272+0000 7f27fe49a640 1 -- 172.21.15.81:0/2687234284 wait complete. 2024-03-18T00:26:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.273+0000 7f27fe49a640 1 Processor -- start 2024-03-18T00:26:12.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 -- start start 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27f80d06d0 0x7f27f815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f8161810 0x7f27f815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27f80ce1b0 con 0x7f27f80cedf0 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f27f8161bf0 con 0x7f27f80d06d0 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27fe49a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f27f80ce330 con 0x7f27f8161810 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52382/0 (socket says 172.21.15.81:52382) 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.274+0000 7f27f7fff640 1 -- 172.21.15.81:0/1944565679 learned_addr learned my addr 172.21.15.81:0/1944565679 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f77fe640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27f80d06d0 0x7f27f815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27fca37640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f8161810 0x7f27f815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 -- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f8161810 msgr2=0x7f27f815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f8161810 0x7f27f815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 -- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27f80d06d0 msgr2=0x7f27f815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27f80d06d0 0x7f27f815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 -- 172.21.15.81:0/1944565679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27f80b5a10 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f7fff640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c340 tx=0x7f27e800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8017070 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27e80052d0 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27f80b5cf0 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27e8003850 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.275+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27f809fa20 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.276+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27f804f540 con 0x7f27f80cedf0 2024-03-18T00:26:12.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.276+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f27e801a070 con 0x7f27f80cedf0 2024-03-18T00:26:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.277+0000 7f27f4ff9640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 0x7f27e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.277+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 4857+0+0 (secure 0 0 0) 0x7f27e8089a00 con 0x7f27f80cedf0 2024-03-18T00:26:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.277+0000 7f27f77fe640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 0x7f27e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:12.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.277+0000 7f27f77fe640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 0x7f27e406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27ec036000 tx=0x7f27ec03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:12.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.281+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f27e8058840 con 0x7f27f80cedf0 2024-03-18T00:26:12.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:12.455+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f27f806fcc0 con 0x7f27f80cedf0 2024-03-18T00:26:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.254+0000 7f27f4ff9640 1 -- 172.21.15.81:0/1944565679 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) ==== 138+0+0 (secure 0 0 0) 0x7f27e805e030 con 0x7f27f80cedf0 2024-03-18T00:26:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 msgr2=0x7f27e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 0x7f27e406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f27ec036000 tx=0x7f27ec03b040 comp rx=0 tx=0).stop 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 msgr2=0x7f27f80afe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f27e800c340 tx=0x7f27e800c800 comp rx=0 tx=0).stop 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 shutdown_connections 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f27f8161810 0x7f27f815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f27f80d06d0 0x7f27f815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f27e406bbd0 0x7f27e406e090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 --2- 172.21.15.81:0/1944565679 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27f80cedf0 0x7f27f80afe50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.257+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 >> 172.21.15.81:0/1944565679 conn(0x7f27f80d1e60 msgr2=0x7f27f80b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.258+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 shutdown_connections 2024-03-18T00:26:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.258+0000 7f27fe49a640 1 -- 172.21.15.81:0/1944565679 wait complete. 2024-03-18T00:26:13.273 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T00:26:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.381+0000 7f61df33b640 1 Processor -- start 2024-03-18T00:26:13.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.381+0000 7f61df33b640 1 -- start start 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61df33b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61d815b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61df33b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d806d3c0 con 0x7f61d80c4a90 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61df33b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80c50c0 con 0x7f61d806ee70 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61df33b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f61d8158d80 con 0x7f61d81589a0 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61dc8d6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f61d80c4a90 0x7f61d806e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52860/0 (socket says 172.21.15.81:52860) 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61dc8d6640 1 -- 172.21.15.81:0/2975101092 learned_addr learned my addr 172.21.15.81:0/2975101092 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1249064132 0 0) 0x7f61d806d3c0 con 0x7f61d80c4a90 2024-03-18T00:26:13.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c4003520 con 0x7f61d80c4a90 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61d815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1540000058 0 0) 0x7f61c4003520 con 0x7f61d80c4a90 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 msgr2=0x7f61d815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61d815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 >> v1:172.21.15.136:6789/0 conn(0x7f61d806ee70 legacy=0x7f61d80cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80c53a0 con 0x7f61d80c4a90 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f61c8001670 con 0x7f61d80c4a90 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 >> v1:172.21.15.81:6789/0 conn(0x7f61d80c4a90 legacy=0x7f61d806e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c40039e0 0x7f61c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.382+0000 7f61cffff640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4004800 0x7f61c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61cffff640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61c4005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d8158d80 con 0x7f61c40039e0 2024-03-18T00:26:13.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61c400baf0 con 0x7f61c4004800 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f61c400bcf0 con 0x7f61d81589a0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c40039e0 0x7f61c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dc8d6640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4004800 0x7f61c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd8d8640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61c4005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 -- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 msgr2=0x7f61c4005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d81589a0 0x7f61c4005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 -- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4004800 msgr2=0x7f61c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4004800 0x7f61c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dd0d7640 1 -- 172.21.15.81:0/2975101092 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c4003520 con 0x7f61c40039e0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.383+0000 7f61dc8d6640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c4004800 0x7f61c4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c40039e0 0x7f61c4003e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f61d400ba30 tx=0x7f61c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44b5216d0c77bd95 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d4036020 con 0x7f61c40039e0 2024-03-18T00:26:13.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61d4032640 con 0x7f61c40039e0 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61cffff640 1 -- 172.21.15.81:0/2975101092 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d400b600 con 0x7f61c40039e0 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 -- 172.21.15.81:0/2975101092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c40039e0 msgr2=0x7f61c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 --2- 172.21.15.81:0/2975101092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61c40039e0 0x7f61c4003e00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f61d400ba30 tx=0x7f61c4005830 comp rx=0 tx=0).stop 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61dd8d8640 1 -- 172.21.15.81:0/2975101092 reap_dead start 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 -- 172.21.15.81:0/2975101092 shutdown_connections 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 -- 172.21.15.81:0/2975101092 >> 172.21.15.81:0/2975101092 conn(0x7f61d80cfbf0 msgr2=0x7f61d80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 -- 172.21.15.81:0/2975101092 shutdown_connections 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.384+0000 7f61df33b640 1 -- 172.21.15.81:0/2975101092 wait complete. 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 Processor -- start 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 -- start start 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c40039e0 0x7f61d8145420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d8150100 0x7f61d8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80c5960 con 0x7f61d80c84c0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f61d80c4e70 con 0x7f61c40039e0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61df33b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f61d80c5c40 con 0x7f61d8150100 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61dc8d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61dc8d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52400/0 (socket says 172.21.15.81:52400) 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.386+0000 7f61dc8d6640 1 -- 172.21.15.81:0/2445151983 learned_addr learned my addr 172.21.15.81:0/2445151983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dd8d8640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d8150100 0x7f61d8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c40039e0 0x7f61d8145420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 -- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d8150100 msgr2=0x7f61d8150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d8150100 0x7f61d8150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 -- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c40039e0 msgr2=0x7f61d8145420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c40039e0 0x7f61d8145420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 -- 172.21.15.81:0/2445151983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d8150ac0 con 0x7f61d80c84c0 2024-03-18T00:26:13.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61dc8d6640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f61c80109e0 tx=0x7f61c8010ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c800edd0 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c8012450 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d8070e20 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61c8012800 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.387+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d80713e0 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.388+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d804f540 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.389+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f61c80129a0 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.389+0000 7f61cdffb640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 0x7f61bc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.389+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 0x7f61bc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.389+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 5227+0+0 (secure 0 0 0) 0x7f61c808cd00 con 0x7f61d80c84c0 2024-03-18T00:26:13.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.390+0000 7f61dd0d7640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 0x7f61bc06e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61d400ba00 tx=0x7f61d403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:13.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.394+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f61c8016030 con 0x7f61d80c84c0 2024-03-18T00:26:13.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:13.567+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f61d80c67a0 con 0x7f61d80c84c0 2024-03-18T00:26:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.259+0000 7f61cdffb640 1 -- 172.21.15.81:0/2445151983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) ==== 170+0+0 (secure 0 0 0) 0x7f61c805b9d0 con 0x7f61d80c84c0 2024-03-18T00:26:14.260 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 msgr2=0x7f61bc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 0x7f61bc06e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f61d400ba00 tx=0x7f61d403d040 comp rx=0 tx=0).stop 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 msgr2=0x7f61d80c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f61c80109e0 tx=0x7f61c8010ea0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 shutdown_connections 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f61d8150100 0x7f61d8150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f61bc06bbd0 0x7f61bc06e090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61d80c84c0 0x7f61d80c8940 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 --2- 172.21.15.81:0/2445151983 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f61c40039e0 0x7f61d8145420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.261+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 >> 172.21.15.81:0/2445151983 conn(0x7f61d80cfbf0 msgr2=0x7f61d80af690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.262+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 shutdown_connections 2024-03-18T00:26:14.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.262+0000 7f61df33b640 1 -- 172.21.15.81:0/2445151983 wait complete. 2024-03-18T00:26:14.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T00:26:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.389+0000 7f87ffadc640 1 Processor -- start 2024-03-18T00:26:14.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.389+0000 7f87ffadc640 1 -- start start 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87ffadc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87ffadc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87ffadc640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f80cda10 con 0x7f87f815ffa0 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87ffadc640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f87f8160410 con 0x7f87f8072d40 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87ffadc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f87f80cd7c0 con 0x7f87f8145700 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd878640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd077640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd077640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:37812/0 (socket says 172.21.15.81:37812) 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd878640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:47672/0 (socket says 172.21.15.81:47672) 2024-03-18T00:26:14.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fe079640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f87f815ffa0 0x7f87f80ce7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:34910/0 (socket says 172.21.15.81:34910) 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd077640 1 -- 172.21.15.81:0/2898445392 learned_addr learned my addr 172.21.15.81:0/2898445392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd878640 1 -- 172.21.15.81:0/2898445392 >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 msgr2=0x7f87f815fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd878640 1 --2- 172.21.15.81:0/2898445392 >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.390+0000 7f87fd878640 1 -- 172.21.15.81:0/2898445392 >> v1:172.21.15.136:6789/0 conn(0x7f87f815ffa0 legacy=0x7f87f80ce7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.391+0000 7f87fd878640 1 -- 172.21.15.81:0/2898445392 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80cdcf0 con 0x7f87f8145700 2024-03-18T00:26:14.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.391+0000 7f87fd077640 1 --2- 172.21.15.81:0/2898445392 >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.391+0000 7f87fd878640 1 --2- 172.21.15.81:0/2898445392 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87f40097a0 tx=0x7f87f402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2bdcec7abb196e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.391+0000 7f87fc876640 1 -- 172.21.15.81:0/2898445392 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4038070 con 0x7f87f8145700 2024-03-18T00:26:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87fc876640 1 -- 172.21.15.81:0/2898445392 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87f4031700 con 0x7f87f8145700 2024-03-18T00:26:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87fc876640 1 -- 172.21.15.81:0/2898445392 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4031ad0 con 0x7f87f8145700 2024-03-18T00:26:14.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 -- 172.21.15.81:0/2898445392 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 msgr2=0x7f87f806cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 --2- 172.21.15.81:0/2898445392 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f87f40097a0 tx=0x7f87f402b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 -- 172.21.15.81:0/2898445392 shutdown_connections 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 --2- 172.21.15.81:0/2898445392 >> v2:172.21.15.136:3300/0 conn(0x7f87f8072d40 0x7f87f815fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 --2- 172.21.15.81:0/2898445392 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f8145700 0x7f87f806cdc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 -- 172.21.15.81:0/2898445392 >> 172.21.15.81:0/2898445392 conn(0x7f87f80cfbf0 msgr2=0x7f87f80cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 -- 172.21.15.81:0/2898445392 shutdown_connections 2024-03-18T00:26:14.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.392+0000 7f87ffadc640 1 -- 172.21.15.81:0/2898445392 wait complete. 2024-03-18T00:26:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.393+0000 7f87ffadc640 1 Processor -- start 2024-03-18T00:26:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.393+0000 7f87ffadc640 1 -- start start 2024-03-18T00:26:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f8072d40 0x7f87f8152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f815ffa0 0x7f87f806e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f87f8145ae0 con 0x7f87f8145700 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80ce340 con 0x7f87f8072d40 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87ffadc640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f87f8145c60 con 0x7f87f815ffa0 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87fd077640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87fd077640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52416/0 (socket says 172.21.15.81:52416) 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87fd077640 1 -- 172.21.15.81:0/519748620 learned_addr learned my addr 172.21.15.81:0/519748620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87fd878640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f8072d40 0x7f87f8152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.394+0000 7f87fe079640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f815ffa0 0x7f87f806e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 -- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f815ffa0 msgr2=0x7f87f806e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f815ffa0 0x7f87f806e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 -- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f8072d40 msgr2=0x7f87f8152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:14.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f8072d40 0x7f87f8152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 -- 172.21.15.81:0/519748620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f80c8ac0 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87fd077640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87e800e900 tx=0x7f87e800edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8017070 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87e800ca00 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e800cdf0 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f80c8da0 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.395+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f80c9360 con 0x7f87f8145700 2024-03-18T00:26:14.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.396+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f804f540 con 0x7f87f8145700 2024-03-18T00:26:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.396+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f87e801a070 con 0x7f87f8145700 2024-03-18T00:26:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.397+0000 7f87ee7fc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 0x7f87dc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.397+0000 7f87fd878640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 0x7f87dc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.397+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5609+0+0 (secure 0 0 0) 0x7f87e808ac70 con 0x7f87f8145700 2024-03-18T00:26:14.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.397+0000 7f87fd878640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 0x7f87dc06e090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87f4035000 tx=0x7f87f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:14.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.401+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f87e80590e0 con 0x7f87f8145700 2024-03-18T00:26:14.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:14.609+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f87f80cab30 con 0x7f87f8145700 2024-03-18T00:26:15.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.272+0000 7f87ee7fc640 1 -- 172.21.15.81:0/519748620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f87e805d180 con 0x7f87f8145700 2024-03-18T00:26:15.273 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 4 and data pool 5 2024-03-18T00:26:15.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.277+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 msgr2=0x7f87dc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.277+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 0x7f87dc06e090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f87f4035000 tx=0x7f87f4008030 comp rx=0 tx=0).stop 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.277+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 msgr2=0x7f87f80c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.277+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f87e800e900 tx=0x7f87e800edc0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 shutdown_connections 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f87f815ffa0 0x7f87f806e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f87dc06bbd0 0x7f87dc06e090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f87f8145700 0x7f87f80c80e0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 --2- 172.21.15.81:0/519748620 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f87f8072d40 0x7f87f8152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 >> 172.21.15.81:0/519748620 conn(0x7f87f80cfbf0 msgr2=0x7f87f80b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:15.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.278+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 shutdown_connections 2024-03-18T00:26:15.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.279+0000 7f87ffadc640 1 -- 172.21.15.81:0/519748620 wait complete. 2024-03-18T00:26:15.303 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:15.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.407+0000 7f790c80b640 1 Processor -- start 2024-03-18T00:26:15.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.407+0000 7f790c80b640 1 -- start start 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790c80b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790815c3a0 0x7f79080d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790c80b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f79080ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790c80b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79080cd510 con 0x7f79080cedb0 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790c80b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f79080cd7f0 con 0x7f790815c3a0 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790c80b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79080cdad0 con 0x7f790815c780 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790815c3a0 0x7f79080d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f790815c3a0 0x7f79080d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52422/0 (socket says 172.21.15.81:52422) 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f7906d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f79080cedb0 0x7f79080cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52868/0 (socket says 172.21.15.81:52868) 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.408+0000 7f790659c640 1 -- 172.21.15.81:0/196114661 learned_addr learned my addr 172.21.15.81:0/196114661 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:15.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790659c640 1 -- 172.21.15.81:0/196114661 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 msgr2=0x7f79080ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f7905d9b640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f79080ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790559a640 1 -- 172.21.15.81:0/196114661 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876076792 0 0) 0x7f79080cd510 con 0x7f79080cedb0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790659c640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f79080ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790659c640 1 -- 172.21.15.81:0/196114661 >> v1:172.21.15.81:6789/0 conn(0x7f79080cedb0 legacy=0x7f79080cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790659c640 1 -- 172.21.15.81:0/196114661 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79080cddb0 con 0x7f790815c3a0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f7905d9b640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f79080ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.409+0000 7f790659c640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790815c3a0 0x7f79080d2980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009e50 tx=0x7f78f802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa20e0ad20874c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790559a640 1 -- 172.21.15.81:0/196114661 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f802cb00 con 0x7f790815c3a0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790559a640 1 -- 172.21.15.81:0/196114661 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f802cca0 con 0x7f790815c3a0 2024-03-18T00:26:15.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790559a640 1 -- 172.21.15.81:0/196114661 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8034610 con 0x7f790815c3a0 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 -- 172.21.15.81:0/196114661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790815c3a0 msgr2=0x7f79080d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790815c3a0 0x7f79080d2980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f78f8009e50 tx=0x7f78f802bf60 comp rx=0 tx=0).stop 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 -- 172.21.15.81:0/196114661 shutdown_connections 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f79080ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 --2- 172.21.15.81:0/196114661 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f790815c3a0 0x7f79080d2980 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 -- 172.21.15.81:0/196114661 >> 172.21.15.81:0/196114661 conn(0x7f79080d1e60 msgr2=0x7f79080d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 -- 172.21.15.81:0/196114661 shutdown_connections 2024-03-18T00:26:15.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.410+0000 7f790c80b640 1 -- 172.21.15.81:0/196114661 wait complete. 2024-03-18T00:26:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.411+0000 7f790c80b640 1 Processor -- start 2024-03-18T00:26:15.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 -- start start 2024-03-18T00:26:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 0x7f790815ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f790815efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79080b0190 con 0x7f79080cedb0 2024-03-18T00:26:15.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79080b0010 con 0x7f790815c3a0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790c80b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79080b0310 con 0x7f790815c780 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52426/0 (socket says 172.21.15.81:52426) 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f790659c640 1 -- 172.21.15.81:0/3890438981 learned_addr learned my addr 172.21.15.81:0/3890438981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.412+0000 7f7906d9d640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f790815efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f7905d9b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 0x7f790815ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 -- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 msgr2=0x7f790815efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f790815efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 -- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 msgr2=0x7f790815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 0x7f790815ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 -- 172.21.15.81:0/3890438981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790815cfc0 con 0x7f79080cedb0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f7905d9b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 0x7f790815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f7906d9d640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f790815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790659c640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f78f8036040 tx=0x7f78f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8043020 con 0x7f79080cedb0 2024-03-18T00:26:15.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f802ce50 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790815cce0 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8009510 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.413+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790815f880 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.414+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790804f5b0 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.415+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f78f8046020 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.415+0000 7f78f6ffd640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 0x7f78e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.415+0000 7f7905d9b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 0x7f78e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.415+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f78f80ad240 con 0x7f79080cedb0 2024-03-18T00:26:15.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.415+0000 7f7905d9b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 0x7f78e806e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79080b3690 tx=0x7f78fc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.420+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f78f804d030 con 0x7f79080cedb0 2024-03-18T00:26:15.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.594+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79080ce370 con 0x7f79080cedb0 2024-03-18T00:26:15.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.595+0000 7f78f6ffd640 1 -- 172.21.15.81:0/3890438981 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7f78f807bdc0 con 0x7f79080cedb0 2024-03-18T00:26:15.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:15.595 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:14.610879+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:15.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 msgr2=0x7f78e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 0x7f78e806e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f79080b3690 tx=0x7f78fc008040 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 msgr2=0x7f790815e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f78f8036040 tx=0x7f78f8004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 shutdown_connections 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f790815c780 0x7f790815efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f790815c3a0 0x7f790815ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f78e806bbd0 0x7f78e806e090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 --2- 172.21.15.81:0/3890438981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79080cedb0 0x7f790815e530 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 >> 172.21.15.81:0/3890438981 conn(0x7f79080d1e60 msgr2=0x7f79080c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 shutdown_connections 2024-03-18T00:26:15.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.597+0000 7f790c80b640 1 -- 172.21.15.81:0/3890438981 wait complete. 2024-03-18T00:26:15.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 Processor -- start 2024-03-18T00:26:15.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 -- start start 2024-03-18T00:26:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efd180b3ba0 0x7efd1806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd1806ed40 0x7efd180ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd180ced90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efd1806f1c0 con 0x7efd1806ed40 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efd1806f4a0 con 0x7efd180b3ba0 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.708+0000 7efd1efb3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd1806f780 con 0x7efd180ce920 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd1806ed40 0x7efd180ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd1806ed40 0x7efd180ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43280/0 (socket says 172.21.15.81:43280) 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 -- 172.21.15.81:0/3764268952 learned_addr learned my addr 172.21.15.81:0/3764268952 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd1cd4f640 1 --2- 172.21.15.81:0/3764268952 >> v2:172.21.15.136:3300/0 conn(0x7efd180b3ba0 0x7efd1806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd1d550640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd180ced90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 -- 172.21.15.81:0/3764268952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 msgr2=0x7efd180ced90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd180ced90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 -- 172.21.15.81:0/3764268952 >> v2:172.21.15.136:3300/0 conn(0x7efd180b3ba0 msgr2=0x7efd1806e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:15.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 --2- 172.21.15.81:0/3764268952 >> v2:172.21.15.136:3300/0 conn(0x7efd180b3ba0 0x7efd1806e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd17fff640 1 -- 172.21.15.81:0/3764268952 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1806fa60 con 0x7efd1806ed40 2024-03-18T00:26:15.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.709+0000 7efd1d550640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd180ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd17fff640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd1806ed40 0x7efd180ce3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd1804fec0 tx=0x7efd0c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e93d2a6fb87c0e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd177fe640 1 -- 172.21.15.81:0/3764268952 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c035020 con 0x7efd1806ed40 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd177fe640 1 -- 172.21.15.81:0/3764268952 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c031870 con 0x7efd1806ed40 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd177fe640 1 -- 172.21.15.81:0/3764268952 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c031c40 con 0x7efd1806ed40 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 -- 172.21.15.81:0/3764268952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd1806ed40 msgr2=0x7efd180ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd1806ed40 0x7efd180ce3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efd1804fec0 tx=0x7efd0c02b910 comp rx=0 tx=0).stop 2024-03-18T00:26:15.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 -- 172.21.15.81:0/3764268952 shutdown_connections 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd180ced90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3764268952 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd1806ed40 0x7efd180ce3e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3764268952 >> v2:172.21.15.136:3300/0 conn(0x7efd180b3ba0 0x7efd1806e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 -- 172.21.15.81:0/3764268952 >> 172.21.15.81:0/3764268952 conn(0x7efd180d0d30 msgr2=0x7efd180d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 -- 172.21.15.81:0/3764268952 shutdown_connections 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.710+0000 7efd1efb3640 1 -- 172.21.15.81:0/3764268952 wait complete. 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.711+0000 7efd1efb3640 1 Processor -- start 2024-03-18T00:26:15.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 -- start start 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 0x7efd18134920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd18155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd18144c80 con 0x7efd180b3ba0 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efd18144b00 con 0x7efd1806ed40 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd1efb3640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd180b5830 con 0x7efd180ce920 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd17fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43288/0 (socket says 172.21.15.81:43288) 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.712+0000 7efd17fff640 1 -- 172.21.15.81:0/3707084108 learned_addr learned my addr 172.21.15.81:0/3707084108 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd1d550640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd18155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 -- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 msgr2=0x7efd18155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd18155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 -- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 msgr2=0x7efd18134920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd1cd4f640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 0x7efd18134920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 0x7efd18134920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 -- 172.21.15.81:0/3707084108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd18138e40 con 0x7efd180b3ba0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd1cd4f640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 0x7efd18134920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd17fff640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000c00 tx=0x7efd0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c035040 con 0x7efd180b3ba0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd0c030d00 con 0x7efd180b3ba0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd18157e40 con 0x7efd180b3ba0 2024-03-18T00:26:15.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c0456a0 con 0x7efd180b3ba0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.713+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd18158400 con 0x7efd180b3ba0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.714+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd1804f5b0 con 0x7efd180b3ba0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.715+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7efd0c038020 con 0x7efd180b3ba0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.715+0000 7efd157fa640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 0x7efd0406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.715+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7efd0c0ace30 con 0x7efd180b3ba0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.715+0000 7efd1cd4f640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 0x7efd0406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.715+0000 7efd1cd4f640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 0x7efd0406e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd10007520 tx=0x7efd1000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:15.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.719+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7efd0c02f320 con 0x7efd180b3ba0 2024-03-18T00:26:15.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.895+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd180b4690 con 0x7efd180b3ba0 2024-03-18T00:26:15.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.896+0000 7efd157fa640 1 -- 172.21.15.81:0/3707084108 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+16694 (secure 0 0 0) 0x7efd0c07b920 con 0x7efd180b3ba0 2024-03-18T00:26:15.897 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:15.897 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:14.610879+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 msgr2=0x7efd0406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 0x7efd0406e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efd10007520 tx=0x7efd1000b040 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 msgr2=0x7efd18154af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000c00 tx=0x7efd0c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 shutdown_connections 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd180ce920 0x7efd18155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd0406bbd0 0x7efd0406e090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd180b3ba0 0x7efd18154af0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 --2- 172.21.15.81:0/3707084108 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd1806ed40 0x7efd18134920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 >> 172.21.15.81:0/3707084108 conn(0x7efd180d0d30 msgr2=0x7efd1806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 shutdown_connections 2024-03-18T00:26:15.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:15.898+0000 7efd1efb3640 1 -- 172.21.15.81:0/3707084108 wait complete. 2024-03-18T00:26:15.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T00:26:16.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.011+0000 7f2363fcd640 1 Processor -- start 2024-03-18T00:26:16.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.011+0000 7f2363fcd640 1 -- start start 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2363fcd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f235c160170 0x7f235c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2363fcd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f235c0cda10 con 0x7f235c145700 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2363fcd640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f235c0cdcf0 con 0x7f235c072d40 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2363fcd640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f235c0cd7c0 con 0x7f235c160170 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361568640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f235c160170 0x7f235c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361d69640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f235c145700 0x7f235c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38140/0 (socket says 172.21.15.81:38140) 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361568640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f235c160170 0x7f235c06cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43304/0 (socket says 172.21.15.81:43304) 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361d69640 1 -- 172.21.15.81:0/2058195112 learned_addr learned my addr 172.21.15.81:0/2058195112 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361568640 1 -- 172.21.15.81:0/2058195112 >> v1:172.21.15.136:6789/0 conn(0x7f235c072d40 legacy=0x7f235c0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361568640 1 -- 172.21.15.81:0/2058195112 >> v1:172.21.15.81:6789/0 conn(0x7f235c145700 legacy=0x7f235c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.012+0000 7f2361568640 1 -- 172.21.15.81:0/2058195112 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c0cdfd0 con 0x7f235c160170 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.013+0000 7f2361568640 1 --2- 172.21.15.81:0/2058195112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c160170 0x7f235c06cdc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cd940 tx=0x7f234c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dd863391b54e474 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.013+0000 7f2360d67640 1 -- 172.21.15.81:0/2058195112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c038070 con 0x7f235c160170 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.013+0000 7f2360d67640 1 -- 172.21.15.81:0/2058195112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c031700 con 0x7f235c160170 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.013+0000 7f2360d67640 1 -- 172.21.15.81:0/2058195112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c031ad0 con 0x7f235c160170 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 -- 172.21.15.81:0/2058195112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c160170 msgr2=0x7f235c06cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 --2- 172.21.15.81:0/2058195112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c160170 0x7f235c06cdc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f235c0cd940 tx=0x7f234c02b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 -- 172.21.15.81:0/2058195112 shutdown_connections 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 --2- 172.21.15.81:0/2058195112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c160170 0x7f235c06cdc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 -- 172.21.15.81:0/2058195112 >> 172.21.15.81:0/2058195112 conn(0x7f235c0cfbf0 msgr2=0x7f235c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:16.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 -- 172.21.15.81:0/2058195112 shutdown_connections 2024-03-18T00:26:16.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.014+0000 7f2363fcd640 1 -- 172.21.15.81:0/2058195112 wait complete. 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.015+0000 7f2363fcd640 1 Processor -- start 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.015+0000 7f2363fcd640 1 -- start start 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f235c072d40 0x7f235c13fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f235c160170 0x7f235c0b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f235c0ce7d0 con 0x7f235c145700 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f235c0ce340 con 0x7f235c072d40 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2363fcd640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f235c0ce950 con 0x7f235c160170 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43312/0 (socket says 172.21.15.81:43312) 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 -- 172.21.15.81:0/4045776859 learned_addr learned my addr 172.21.15.81:0/4045776859 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 -- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f235c160170 msgr2=0x7f235c0b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f235c160170 0x7f235c0b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 -- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f235c072d40 msgr2=0x7f235c13fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361d69640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f235c072d40 0x7f235c13fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f235c072d40 0x7f235c13fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 -- 172.21.15.81:0/4045776859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c0ad8c0 con 0x7f235c145700 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.016+0000 7f2361568640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f234c000c00 tx=0x7f234c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.017+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c042070 con 0x7f235c145700 2024-03-18T00:26:16.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.017+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f234c033a30 con 0x7f235c145700 2024-03-18T00:26:16.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.017+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c0adba0 con 0x7f235c145700 2024-03-18T00:26:16.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.017+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c038040 con 0x7f235c145700 2024-03-18T00:26:16.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.017+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c0ae440 con 0x7f235c145700 2024-03-18T00:26:16.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.018+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f235c04f540 con 0x7f235c145700 2024-03-18T00:26:16.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.018+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f234c045070 con 0x7f235c145700 2024-03-18T00:26:16.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.018+0000 7f23527fc640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 0x7f234006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.018+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5709+0+0 (secure 0 0 0) 0x7f234c0ac710 con 0x7f235c145700 2024-03-18T00:26:16.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.019+0000 7f2361d69640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 0x7f234006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.019+0000 7f2361d69640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 0x7f234006e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2358000f60 tx=0x7f2358009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.023+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f234c030070 con 0x7f235c145700 2024-03-18T00:26:16.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.232+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f235c142fe0 con 0x7f235c145700 2024-03-18T00:26:16.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.280+0000 7f23527fc640 1 -- 172.21.15.81:0/4045776859 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f234c07b200 con 0x7f235c145700 2024-03-18T00:26:16.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 msgr2=0x7f234006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 0x7f234006e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2358000f60 tx=0x7f2358009040 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 msgr2=0x7f235c0aec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f234c000c00 tx=0x7f234c0046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 shutdown_connections 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f235c160170 0x7f235c0b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f234006bbd0 0x7f234006e090 secure :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2358000f60 tx=0x7f2358009040 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f235c145700 0x7f235c0aec40 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.282+0000 7f2363fcd640 1 --2- 172.21.15.81:0/4045776859 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f235c072d40 0x7f235c13fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.283+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 >> 172.21.15.81:0/4045776859 conn(0x7f235c0cfbf0 msgr2=0x7f235c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.283+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 shutdown_connections 2024-03-18T00:26:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.283+0000 7f2363fcd640 1 -- 172.21.15.81:0/4045776859 wait complete. 2024-03-18T00:26:16.294 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-18T00:26:16.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T00:26:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.396+0000 7fad474a1640 1 Processor -- start 2024-03-18T00:26:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.397+0000 7fad474a1640 1 -- start start 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.397+0000 7fad474a1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceae0 0x7fad400d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad474a1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cf480 0x7fad4015f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad474a1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad400b31d0 con 0x7fad400ceec0 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad474a1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fad400cd560 con 0x7fad400cf480 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad474a1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fad400cd840 con 0x7fad400ceae0 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cf480 0x7fad4015f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad400cf480 0x7fad4015f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43328/0 (socket says 172.21.15.81:43328) 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 -- 172.21.15.81:0/3028833799 learned_addr learned my addr 172.21.15.81:0/3028833799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad4523d640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceae0 0x7fad400d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 -- 172.21.15.81:0/3028833799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceae0 msgr2=0x7fad400d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceae0 0x7fad400d29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 -- 172.21.15.81:0/3028833799 >> v1:172.21.15.81:6789/0 conn(0x7fad400ceec0 legacy=0x7fad400cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad44a3c640 1 -- 172.21.15.81:0/3028833799 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad400b2e60 con 0x7fad400cf480 2024-03-18T00:26:16.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.398+0000 7fad37fff640 1 -- 172.21.15.81:0/3028833799 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061156404 0 0) 0x7fad400b31d0 con 0x7fad400ceec0 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad44a3c640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4015f330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009870 tx=0x7fad3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8946a850d6c4817 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad37fff640 1 -- 172.21.15.81:0/3028833799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c035020 con 0x7fad400cf480 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad37fff640 1 -- 172.21.15.81:0/3028833799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad3c031640 con 0x7fad400cf480 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad37fff640 1 -- 172.21.15.81:0/3028833799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad3c02d040 con 0x7fad400cf480 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 -- 172.21.15.81:0/3028833799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 msgr2=0x7fad4015f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4015f330 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fad3c009870 tx=0x7fad3c02b8f0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 -- 172.21.15.81:0/3028833799 shutdown_connections 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4015f330 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 --2- 172.21.15.81:0/3028833799 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceae0 0x7fad400d29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.399+0000 7fad474a1640 1 -- 172.21.15.81:0/3028833799 >> 172.21.15.81:0/3028833799 conn(0x7fad400d1ea0 msgr2=0x7fad400d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.400+0000 7fad474a1640 1 -- 172.21.15.81:0/3028833799 shutdown_connections 2024-03-18T00:26:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.400+0000 7fad474a1640 1 -- 172.21.15.81:0/3028833799 wait complete. 2024-03-18T00:26:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 Processor -- start 2024-03-18T00:26:16.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 -- start start 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad400ceae0 0x7fad400cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceec0 0x7fad4006cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad400c6c10 con 0x7fad400cf480 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fad400c6a90 con 0x7fad400ceae0 2024-03-18T00:26:16.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad474a1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fad400c6d90 con 0x7fad400ceec0 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.401+0000 7fad45a3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43344/0 (socket says 172.21.15.81:43344) 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 -- 172.21.15.81:0/75096602 learned_addr learned my addr 172.21.15.81:0/75096602 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad44a3c640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceec0 0x7fad4006cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad4523d640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad400ceae0 0x7fad400cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 -- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceec0 msgr2=0x7fad4006cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceec0 0x7fad4006cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 -- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad400ceae0 msgr2=0x7fad400cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad400ceae0 0x7fad400cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 -- 172.21.15.81:0/75096602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad400caaf0 con 0x7fad400cf480 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad45a3e640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad3800c780 tx=0x7fad3800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38003b70 con 0x7fad400cf480 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad38003d10 con 0x7fad400cf480 2024-03-18T00:26:16.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad38005270 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad400cadb0 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.402+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad4006c730 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.403+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad4004f540 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.403+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fad38005410 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.404+0000 7fad35ffb640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 0x7fad2406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.404+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fad3808a890 con 0x7fad400cf480 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.404+0000 7fad4523d640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 0x7fad2406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:16.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.404+0000 7fad4523d640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 0x7fad2406e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad30009aa0 tx=0x7fad30009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:16.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.408+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fad38058c90 con 0x7fad400cf480 2024-03-18T00:26:16.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:16.616+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fad40067c40 con 0x7fad400cf480 2024-03-18T00:26:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.281+0000 7fad35ffb640 1 -- 172.21.15.81:0/75096602 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7fad3805cd30 con 0x7fad400cf480 2024-03-18T00:26:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 msgr2=0x7fad2406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 0x7fad2406e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fad30009aa0 tx=0x7fad30009190 comp rx=0 tx=0).stop 2024-03-18T00:26:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 msgr2=0x7fad4006dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fad3800c780 tx=0x7fad3800cb80 comp rx=0 tx=0).stop 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 shutdown_connections 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad2406bbd0 0x7fad2406e090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad400cf480 0x7fad4006dee0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad400ceec0 0x7fad4006cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 --2- 172.21.15.81:0/75096602 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad400ceae0 0x7fad400cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 >> 172.21.15.81:0/75096602 conn(0x7fad400d1ea0 msgr2=0x7fad4015d150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 shutdown_connections 2024-03-18T00:26:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.285+0000 7fad474a1640 1 -- 172.21.15.81:0/75096602 wait complete. 2024-03-18T00:26:17.297 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T00:26:17.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.399+0000 7f83f11f4640 1 Processor -- start 2024-03-18T00:26:17.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.399+0000 7f83f11f4640 1 -- start start 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83f11f4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83f11f4640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 0x7f83ec162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83f11f4640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83ec0b3440 con 0x7f83ec0cec80 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83f11f4640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f83ec0d16c0 con 0x7f83ec162690 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83f11f4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f83ec0d2660 con 0x7f83ec1622b0 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83e3fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 0x7f83ec162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83ead9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:48074/0 (socket says 172.21.15.81:48074) 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.400+0000 7f83ead9d640 1 -- 172.21.15.81:0/4161305891 learned_addr learned my addr 172.21.15.81:0/4161305891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83ead9d640 1 -- 172.21.15.81:0/4161305891 >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 msgr2=0x7f83ec162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83ead9d640 1 --2- 172.21.15.81:0/4161305891 >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 0x7f83ec162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83ead9d640 1 -- 172.21.15.81:0/4161305891 >> v1:172.21.15.136:6789/0 conn(0x7f83ec0cec80 legacy=0x7f83ec0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83ead9d640 1 -- 172.21.15.81:0/4161305891 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec0d20a0 con 0x7f83ec1622b0 2024-03-18T00:26:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83e3fff640 1 --2- 172.21.15.81:0/4161305891 >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 0x7f83ec162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.401+0000 7f83ead9d640 1 --2- 172.21.15.81:0/4161305891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009870 tx=0x7f83dc02b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1459d447db7c72 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83ea59c640 1 -- 172.21.15.81:0/4161305891 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc0317c0 con 0x7f83ec1622b0 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83ea59c640 1 -- 172.21.15.81:0/4161305891 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83dc037070 con 0x7f83ec1622b0 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83ea59c640 1 -- 172.21.15.81:0/4161305891 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83dc031b80 con 0x7f83ec1622b0 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 -- 172.21.15.81:0/4161305891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 msgr2=0x7f83ec0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 --2- 172.21.15.81:0/4161305891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f83dc009870 tx=0x7f83dc02b860 comp rx=0 tx=0).stop 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 -- 172.21.15.81:0/4161305891 shutdown_connections 2024-03-18T00:26:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 --2- 172.21.15.81:0/4161305891 >> v2:172.21.15.136:3300/0 conn(0x7f83ec162690 0x7f83ec162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 --2- 172.21.15.81:0/4161305891 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec1622b0 0x7f83ec0d10d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 -- 172.21.15.81:0/4161305891 >> 172.21.15.81:0/4161305891 conn(0x7f83ec0d4070 msgr2=0x7f83ec0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 -- 172.21.15.81:0/4161305891 shutdown_connections 2024-03-18T00:26:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.402+0000 7f83f11f4640 1 -- 172.21.15.81:0/4161305891 wait complete. 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 Processor -- start 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 -- start start 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec0cec80 0x7f83ec155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83ec162690 0x7f83ec160ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec15faa0 con 0x7f83ec1622b0 2024-03-18T00:26:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f83ec0d2ab0 con 0x7f83ec162690 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83f11f4640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f83ec15fc20 con 0x7f83ec0cec80 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43348/0 (socket says 172.21.15.81:43348) 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83e3fff640 1 -- 172.21.15.81:0/2693650714 learned_addr learned my addr 172.21.15.81:0/2693650714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83ead9d640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec0cec80 0x7f83ec155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.404+0000 7f83eb59e640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83ec162690 0x7f83ec160ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 -- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec0cec80 msgr2=0x7f83ec155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec0cec80 0x7f83ec155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 -- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83ec162690 msgr2=0x7f83ec160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83ec162690 0x7f83ec160ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 -- 172.21.15.81:0/2693650714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ec0cb830 con 0x7f83ec1622b0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e3fff640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e990 tx=0x7f83d400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4017070 con 0x7f83ec1622b0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83d400c9e0 con 0x7f83ec1622b0 2024-03-18T00:26:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ec0cbad0 con 0x7f83ec1622b0 2024-03-18T00:26:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d400cdb0 con 0x7f83ec1622b0 2024-03-18T00:26:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.405+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ec0cc090 con 0x7f83ec1622b0 2024-03-18T00:26:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.406+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ec04f5b0 con 0x7f83ec1622b0 2024-03-18T00:26:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.407+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f83d401a070 con 0x7f83ec1622b0 2024-03-18T00:26:17.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.407+0000 7f83e37fe640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 0x7f83cc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.407+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f83d408a850 con 0x7f83ec1622b0 2024-03-18T00:26:17.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.407+0000 7f83ead9d640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 0x7f83cc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.408+0000 7f83ead9d640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 0x7f83cc06e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f83dc036000 tx=0x7f83dc03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.411+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f83d4058cf0 con 0x7f83ec1622b0 2024-03-18T00:26:17.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.621+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f83ec0d18d0 con 0x7f83ec1622b0 2024-03-18T00:26:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.621+0000 7f83e37fe640 1 -- 172.21.15.81:0/2693650714 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7f83d405cd90 con 0x7f83ec1622b0 2024-03-18T00:26:17.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:17.622 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T00:26:17.622 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 msgr2=0x7f83cc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 0x7f83cc06e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f83dc036000 tx=0x7f83dc03d040 comp rx=0 tx=0).stop 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 msgr2=0x7f83ec15c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e990 tx=0x7f83d400ee50 comp rx=0 tx=0).stop 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 shutdown_connections 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f83ec162690 0x7f83ec160ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f83cc06bc00 0x7f83cc06e0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ec1622b0 0x7f83ec15c590 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 --2- 172.21.15.81:0/2693650714 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f83ec0cec80 0x7f83ec155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.623+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 >> 172.21.15.81:0/2693650714 conn(0x7f83ec0d4070 msgr2=0x7f83ec06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.624+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 shutdown_connections 2024-03-18T00:26:17.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.624+0000 7f83f11f4640 1 -- 172.21.15.81:0/2693650714 wait complete. 2024-03-18T00:26:17.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T00:26:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.735+0000 7ff0b20de640 1 Processor -- start 2024-03-18T00:26:17.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.735+0000 7ff0b20de640 1 -- start start 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0b20de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 0x7ff0ac15e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0b20de640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0ac071010 0x7ff0ac0714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0b20de640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0ac06e6f0 con 0x7ff0ac154a90 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0b20de640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff0ac15eb10 con 0x7ff0ac071010 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0b20de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ac06d380 con 0x7ff0ac15e170 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0ac071010 0x7ff0ac0714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff0ac071010 0x7ff0ac0714a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43350/0 (socket says 172.21.15.81:43350) 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 -- 172.21.15.81:0/152616307 learned_addr learned my addr 172.21.15.81:0/152616307 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0aaffd640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 0x7ff0ac15e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 -- 172.21.15.81:0/152616307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 msgr2=0x7ff0ac15e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 0x7ff0ac15e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0aa7fc640 1 -- 172.21.15.81:0/152616307 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2951999296 0 0) 0x7ff0ac06e6f0 con 0x7ff0ac154a90 2024-03-18T00:26:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 -- 172.21.15.81:0/152616307 >> v1:172.21.15.136:6789/0 conn(0x7ff0ac154a90 legacy=0x7ff0ac06cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0abfff640 1 -- 172.21.15.81:0/152616307 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac06d650 con 0x7ff0ac071010 2024-03-18T00:26:17.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.736+0000 7ff0aaffd640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 0x7ff0ac15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.737+0000 7ff0abfff640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac071010 0x7ff0ac0714a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009e50 tx=0x7ff0a402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84d70130ebc47d52 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.737+0000 7ff0aa7fc640 1 -- 172.21.15.81:0/152616307 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a402caf0 con 0x7ff0ac071010 2024-03-18T00:26:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.737+0000 7ff0aa7fc640 1 -- 172.21.15.81:0/152616307 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a402cc90 con 0x7ff0ac071010 2024-03-18T00:26:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.737+0000 7ff0aa7fc640 1 -- 172.21.15.81:0/152616307 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4034610 con 0x7ff0ac071010 2024-03-18T00:26:17.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 -- 172.21.15.81:0/152616307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac071010 msgr2=0x7ff0ac0714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac071010 0x7ff0ac0714a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009e50 tx=0x7ff0a402bf50 comp rx=0 tx=0).stop 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 -- 172.21.15.81:0/152616307 shutdown_connections 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac071010 0x7ff0ac0714a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 --2- 172.21.15.81:0/152616307 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac15e170 0x7ff0ac15e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 -- 172.21.15.81:0/152616307 >> 172.21.15.81:0/152616307 conn(0x7ff0ac06b5e0 msgr2=0x7ff0ac06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 -- 172.21.15.81:0/152616307 shutdown_connections 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.738+0000 7ff0b20de640 1 -- 172.21.15.81:0/152616307 wait complete. 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.739+0000 7ff0b20de640 1 Processor -- start 2024-03-18T00:26:17.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.739+0000 7ff0b20de640 1 -- start start 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 0x7ff0ac0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 0x7ff0ac1ef130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac06def0 con 0x7ff0ac15e170 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac06dc10 con 0x7ff0ac154a90 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff0ac06e1d0 con 0x7ff0ac071010 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43366/0 (socket says 172.21.15.81:43366) 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 -- 172.21.15.81:0/144623981 learned_addr learned my addr 172.21.15.81:0/144623981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0ab7fe640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 0x7ff0ac0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0aaffd640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 0x7ff0ac1ef130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 -- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 msgr2=0x7ff0ac0ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 0x7ff0ac0ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 -- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 msgr2=0x7ff0ac1ef130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 0x7ff0ac1ef130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 -- 172.21.15.81:0/144623981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac0cd2d0 con 0x7ff0ac15e170 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0aaffd640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 0x7ff0ac1ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0ab7fe640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 0x7ff0ac0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0abfff640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009e50 tx=0x7ff0a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4043020 con 0x7ff0ac15e170 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0a403e450 con 0x7ff0ac15e170 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac1500f0 con 0x7ff0ac15e170 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.740+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4009510 con 0x7ff0ac15e170 2024-03-18T00:26:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.741+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac148000 con 0x7ff0ac15e170 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.741+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0ac04f5b0 con 0x7ff0ac15e170 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.742+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff0a4046020 con 0x7ff0ac15e170 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.742+0000 7ff093fff640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 0x7ff09806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.742+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff0a40ad180 con 0x7ff0ac15e170 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.742+0000 7ff0ab7fe640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 0x7ff09806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.743+0000 7ff0ab7fe640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 0x7ff09806e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff09c000f60 tx=0x7ff09c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:17.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.747+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff0a404d030 con 0x7ff0ac15e170 2024-03-18T00:26:17.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.921+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff0ac1504b0 con 0x7ff0ac15e170 2024-03-18T00:26:17.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.922+0000 7ff093fff640 1 -- 172.21.15.81:0/144623981 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7ff0a407bd00 con 0x7ff0ac15e170 2024-03-18T00:26:17.923 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:17.923 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:16.273398+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T00:26:17.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 msgr2=0x7ff09806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 0x7ff09806e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff09c000f60 tx=0x7ff09c009040 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 msgr2=0x7ff0ac15ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009e50 tx=0x7ff0a4004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 shutdown_connections 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff09806bbd0 0x7ff09806e090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0ac15e170 0x7ff0ac15ca90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff0ac154a90 0x7ff0ac1ef130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 --2- 172.21.15.81:0/144623981 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff0ac071010 0x7ff0ac0ccd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 >> 172.21.15.81:0/144623981 conn(0x7ff0ac06b5e0 msgr2=0x7ff0ac0af190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 shutdown_connections 2024-03-18T00:26:17.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:17.924+0000 7ff0b20de640 1 -- 172.21.15.81:0/144623981 wait complete. 2024-03-18T00:26:17.935 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T00:26:17.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:26:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.035+0000 7f6a0924d640 1 Processor -- start 2024-03-18T00:26:18.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.035+0000 7f6a0924d640 1 -- start start 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0924d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0924d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 0x7f6a040b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0924d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a040d1200 con 0x7f6a040d1e40 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0924d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6a040cff90 con 0x7f6a040d2d50 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0924d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040b34d0 con 0x7f6a0415e5a0 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6a040d1e40 0x7f6a040d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38164/0 (socket says 172.21.15.81:38164) 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0259c640 1 -- 172.21.15.81:0/1539053240 learned_addr learned my addr 172.21.15.81:0/1539053240 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/1539053240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.036+0000 7f6a0359e640 1 --2- 172.21.15.81:0/1539053240 >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 0x7f6a040b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a01d9b640 1 -- 172.21.15.81:0/1539053240 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242584733 0 0) 0x7f6a040d1200 con 0x7f6a040d1e40 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a01d9b640 1 -- 172.21.15.81:0/1539053240 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69ec003520 con 0x7f6a040d1e40 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a02d9d640 1 -- 172.21.15.81:0/1539053240 >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 msgr2=0x7f6a040b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/1539053240 >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 0x7f6a040b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a02d9d640 1 -- 172.21.15.81:0/1539053240 >> v1:172.21.15.81:6789/0 conn(0x7f6a040d1e40 legacy=0x7f6a040d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a02d9d640 1 -- 172.21.15.81:0/1539053240 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040d14e0 con 0x7f6a0415e5a0 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a0359e640 1 --2- 172.21.15.81:0/1539053240 >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 0x7f6a040b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.037+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/1539053240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040d4b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d5624928fa61e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a01d9b640 1 -- 172.21.15.81:0/1539053240 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4039070 con 0x7f6a0415e5a0 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a01d9b640 1 -- 172.21.15.81:0/1539053240 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f402cbc0 con 0x7f6a0415e5a0 2024-03-18T00:26:18.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a01d9b640 1 -- 172.21.15.81:0/1539053240 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4034440 con 0x7f6a0415e5a0 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 -- 172.21.15.81:0/1539053240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 msgr2=0x7f6a040d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 --2- 172.21.15.81:0/1539053240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040d4b80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f402be10 comp rx=0 tx=0).stop 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 -- 172.21.15.81:0/1539053240 shutdown_connections 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 --2- 172.21.15.81:0/1539053240 >> v2:172.21.15.136:3300/0 conn(0x7f6a040d2d50 0x7f6a040b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 --2- 172.21.15.81:0/1539053240 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040d4b80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 -- 172.21.15.81:0/1539053240 >> 172.21.15.81:0/1539053240 conn(0x7f6a040d4060 msgr2=0x7f6a040d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 -- 172.21.15.81:0/1539053240 shutdown_connections 2024-03-18T00:26:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.038+0000 7f6a0924d640 1 -- 172.21.15.81:0/1539053240 wait complete. 2024-03-18T00:26:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 Processor -- start 2024-03-18T00:26:18.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 -- start start 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a040d2d50 0x7f6a040b8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040b9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040b4300 con 0x7f6a040d1e40 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6a040b4180 con 0x7f6a040d2d50 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0924d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6a040b4480 con 0x7f6a0415e5a0 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a02d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43372/0 (socket says 172.21.15.81:43372) 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a02d9d640 1 -- 172.21.15.81:0/2139479008 learned_addr learned my addr 172.21.15.81:0/2139479008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.040+0000 7f6a0259c640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a040d2d50 0x7f6a040b8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a0359e640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040b9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 -- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 msgr2=0x7f6a040b9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040b9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 -- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a040d2d50 msgr2=0x7f6a040b8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a040d2d50 0x7f6a040b8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 -- 172.21.15.81:0/2139479008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a040c8df0 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a02d9d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4044020 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69f403f470 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69f4039040 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a040c90d0 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.041+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a040b6f60 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.042+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0404f5b0 con 0x7f6a040d1e40 2024-03-18T00:26:18.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.043+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f69f4047020 con 0x7f6a040d1e40 2024-03-18T00:26:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.043+0000 7f69eb7fe640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.043+0000 7f6a0259c640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.043+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f69f40ad390 con 0x7f6a040d1e40 2024-03-18T00:26:18.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.043+0000 7f6a0259c640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 0x7f69f006e090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a040cd9c0 tx=0x7f69f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.048+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f69f404e030 con 0x7f6a040d1e40 2024-03-18T00:26:18.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.216+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6a040b51c0 con 0x7f69f006bbd0 2024-03-18T00:26:18.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.221+0000 7f69eb7fe640 1 -- 172.21.15.81:0/2139479008 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251879 (secure 0 0 0) 0x7f6a040b51c0 con 0x7f69f006bbd0 2024-03-18T00:26:18.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:18.226 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 msgr2=0x7f69f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 0x7f69f006e090 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f6a040cd9c0 tx=0x7f69f8009040 comp rx=0 tx=0).stop 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 msgr2=0x7f6a04156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f69f4009d90 tx=0x7f69f4004a40 comp rx=0 tx=0).stop 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 shutdown_connections 2024-03-18T00:26:18.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6a0415e5a0 0x7f6a040b9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6a040d2d50 0x7f6a040b8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 --2- 172.21.15.81:0/2139479008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a040d1e40 0x7f6a04156c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 >> 172.21.15.81:0/2139479008 conn(0x7f6a040d4060 msgr2=0x7f6a0406d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 shutdown_connections 2024-03-18T00:26:18.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.225+0000 7f6a0924d640 1 -- 172.21.15.81:0/2139479008 wait complete. 2024-03-18T00:26:18.236 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-03-18T00:26:17.369548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220004,"kb_used_data":3820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754716,"statfs":{"total":773094113280,"available":772868829184,"internally_reserved":0,"allocated":3911680,"data_stored":2214524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.113430"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286274+0000","last_change":"2024-03-18T00:26:15.282531+0000","last_active":"2024-03-18T00:26:15.286274+0000","last_peered":"2024-03-18T00:26:15.286274+0000","last_clean":"2024-03-18T00:26:15.286274+0000","last_became_active":"2024-03-18T00:26:15.282270+0000","last_became_peered":"2024-03-18T00:26:15.282270+0000","last_unstale":"2024-03-18T00:26:15.286274+0000","last_undegraded":"2024-03-18T00:26:15.286274+0000","last_fullsized":"2024-03-18T00:26:15.286274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291162+0000","last_change":"2024-03-18T00:26:15.282641+0000","last_active":"2024-03-18T00:26:15.291162+0000","last_peered":"2024-03-18T00:26:15.291162+0000","last_clean":"2024-03-18T00:26:15.291162+0000","last_became_active":"2024-03-18T00:26:15.282216+0000","last_became_peered":"2024-03-18T00:26:15.282216+0000","last_unstale":"2024-03-18T00:26:15.291162+0000","last_undegraded":"2024-03-18T00:26:15.291162+0000","last_fullsized":"2024-03-18T00:26:15.291162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286844+0000","last_change":"2024-03-18T00:26:15.281656+0000","last_active":"2024-03-18T00:26:15.286844+0000","last_peered":"2024-03-18T00:26:15.286844+0000","last_clean":"2024-03-18T00:26:15.286844+0000","last_became_active":"2024-03-18T00:26:15.281354+0000","last_became_peered":"2024-03-18T00:26:15.281354+0000","last_unstale":"2024-03-18T00:26:15.286844+0000","last_undegraded":"2024-03-18T00:26:15.286844+0000","last_fullsized":"2024-03-18T00:26:15.286844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290960+0000","last_change":"2024-03-18T00:26:15.286105+0000","last_active":"2024-03-18T00:26:15.290960+0000","last_peered":"2024-03-18T00:26:15.290960+0000","last_clean":"2024-03-18T00:26:15.290960+0000","last_became_active":"2024-03-18T00:26:15.285335+0000","last_became_peered":"2024-03-18T00:26:15.285335+0000","last_unstale":"2024-03-18T00:26:15.290960+0000","last_undegraded":"2024-03-18T00:26:15.290960+0000","last_fullsized":"2024-03-18T00:26:15.290960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291372+0000","last_change":"2024-03-18T00:26:15.284698+0000","last_active":"2024-03-18T00:26:15.291372+0000","last_peered":"2024-03-18T00:26:15.291372+0000","last_clean":"2024-03-18T00:26:15.291372+0000","last_became_active":"2024-03-18T00:26:15.284366+0000","last_became_peered":"2024-03-18T00:26:15.284366+0000","last_unstale":"2024-03-18T00:26:15.291372+0000","last_undegraded":"2024-03-18T00:26:15.291372+0000","last_fullsized":"2024-03-18T00:26:15.291372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:07.445520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283124+0000","last_change":"2024-03-18T00:26:15.279759+0000","last_active":"2024-03-18T00:26:15.283124+0000","last_peered":"2024-03-18T00:26:15.283124+0000","last_clean":"2024-03-18T00:26:15.283124+0000","last_became_active":"2024-03-18T00:26:15.279453+0000","last_became_peered":"2024-03-18T00:26:15.279453+0000","last_unstale":"2024-03-18T00:26:15.283124+0000","last_undegraded":"2024-03-18T00:26:15.283124+0000","last_fullsized":"2024-03-18T00:26:15.283124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291792+0000","last_change":"2024-03-18T00:26:15.288669+0000","last_active":"2024-03-18T00:26:15.291792+0000","last_peered":"2024-03-18T00:26:15.291792+0000","last_clean":"2024-03-18T00:26:15.291792+0000","last_became_active":"2024-03-18T00:26:15.288404+0000","last_became_peered":"2024-03-18T00:26:15.288404+0000","last_unstale":"2024-03-18T00:26:15.291792+0000","last_undegraded":"2024-03-18T00:26:15.291792+0000","last_fullsized":"2024-03-18T00:26:15.291792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296429+0000","last_change":"2024-03-18T00:26:15.294531+0000","last_active":"2024-03-18T00:26:15.296429+0000","last_peered":"2024-03-18T00:26:15.296429+0000","last_clean":"2024-03-18T00:26:15.296429+0000","last_became_active":"2024-03-18T00:26:15.294204+0000","last_became_peered":"2024-03-18T00:26:15.294204+0000","last_unstale":"2024-03-18T00:26:15.296429+0000","last_undegraded":"2024-03-18T00:26:15.296429+0000","last_fullsized":"2024-03-18T00:26:15.296429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286025+0000","last_change":"2024-03-18T00:26:15.282469+0000","last_active":"2024-03-18T00:26:15.286025+0000","last_peered":"2024-03-18T00:26:15.286025+0000","last_clean":"2024-03-18T00:26:15.286025+0000","last_became_active":"2024-03-18T00:26:15.282199+0000","last_became_peered":"2024-03-18T00:26:15.282199+0000","last_unstale":"2024-03-18T00:26:15.286025+0000","last_undegraded":"2024-03-18T00:26:15.286025+0000","last_fullsized":"2024-03-18T00:26:15.286025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290399+0000","last_change":"2024-03-18T00:26:15.287932+0000","last_active":"2024-03-18T00:26:15.290399+0000","last_peered":"2024-03-18T00:26:15.290399+0000","last_clean":"2024-03-18T00:26:15.290399+0000","last_became_active":"2024-03-18T00:26:15.287660+0000","last_became_peered":"2024-03-18T00:26:15.287660+0000","last_unstale":"2024-03-18T00:26:15.290399+0000","last_undegraded":"2024-03-18T00:26:15.290399+0000","last_fullsized":"2024-03-18T00:26:15.290399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.292899+0000","last_change":"2024-03-18T00:26:15.290621+0000","last_active":"2024-03-18T00:26:15.292899+0000","last_peered":"2024-03-18T00:26:15.292899+0000","last_clean":"2024-03-18T00:26:15.292899+0000","last_became_active":"2024-03-18T00:26:15.290340+0000","last_became_peered":"2024-03-18T00:26:15.290340+0000","last_unstale":"2024-03-18T00:26:15.292899+0000","last_undegraded":"2024-03-18T00:26:15.292899+0000","last_fullsized":"2024-03-18T00:26:15.292899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:53.741084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290121+0000","last_change":"2024-03-18T00:26:15.287786+0000","last_active":"2024-03-18T00:26:15.290121+0000","last_peered":"2024-03-18T00:26:15.290121+0000","last_clean":"2024-03-18T00:26:15.290121+0000","last_became_active":"2024-03-18T00:26:15.284201+0000","last_became_peered":"2024-03-18T00:26:15.284201+0000","last_unstale":"2024-03-18T00:26:15.290121+0000","last_undegraded":"2024-03-18T00:26:15.290121+0000","last_fullsized":"2024-03-18T00:26:15.290121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283931+0000","last_change":"2024-03-18T00:26:15.281613+0000","last_active":"2024-03-18T00:26:15.283931+0000","last_peered":"2024-03-18T00:26:15.283931+0000","last_clean":"2024-03-18T00:26:15.283931+0000","last_became_active":"2024-03-18T00:26:15.280494+0000","last_became_peered":"2024-03-18T00:26:15.280494+0000","last_unstale":"2024-03-18T00:26:15.283931+0000","last_undegraded":"2024-03-18T00:26:15.283931+0000","last_fullsized":"2024-03-18T00:26:15.283931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:35:24.478753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294226+0000","last_change":"2024-03-18T00:26:15.282934+0000","last_active":"2024-03-18T00:26:15.294226+0000","last_peered":"2024-03-18T00:26:15.294226+0000","last_clean":"2024-03-18T00:26:15.294226+0000","last_became_active":"2024-03-18T00:26:15.282200+0000","last_became_peered":"2024-03-18T00:26:15.282200+0000","last_unstale":"2024-03-18T00:26:15.294226+0000","last_undegraded":"2024-03-18T00:26:15.294226+0000","last_fullsized":"2024-03-18T00:26:15.294226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289285+0000","last_change":"2024-03-18T00:26:15.283375+0000","last_active":"2024-03-18T00:26:15.289285+0000","last_peered":"2024-03-18T00:26:15.289285+0000","last_clean":"2024-03-18T00:26:15.289285+0000","last_became_active":"2024-03-18T00:26:15.283069+0000","last_became_peered":"2024-03-18T00:26:15.283069+0000","last_unstale":"2024-03-18T00:26:15.289285+0000","last_undegraded":"2024-03-18T00:26:15.289285+0000","last_fullsized":"2024-03-18T00:26:15.289285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296757+0000","last_change":"2024-03-18T00:26:15.296106+0000","last_active":"2024-03-18T00:26:15.296757+0000","last_peered":"2024-03-18T00:26:15.296757+0000","last_clean":"2024-03-18T00:26:15.296757+0000","last_became_active":"2024-03-18T00:26:15.295772+0000","last_became_peered":"2024-03-18T00:26:15.295772+0000","last_unstale":"2024-03-18T00:26:15.296757+0000","last_undegraded":"2024-03-18T00:26:15.296757+0000","last_fullsized":"2024-03-18T00:26:15.296757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293435+0000","last_change":"2024-03-18T00:26:15.291914+0000","last_active":"2024-03-18T00:26:15.293435+0000","last_peered":"2024-03-18T00:26:15.293435+0000","last_clean":"2024-03-18T00:26:15.293435+0000","last_became_active":"2024-03-18T00:26:15.291650+0000","last_became_peered":"2024-03-18T00:26:15.291650+0000","last_unstale":"2024-03-18T00:26:15.293435+0000","last_undegraded":"2024-03-18T00:26:15.293435+0000","last_fullsized":"2024-03-18T00:26:15.293435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294990+0000","last_change":"2024-03-18T00:26:15.287136+0000","last_active":"2024-03-18T00:26:15.294990+0000","last_peered":"2024-03-18T00:26:15.294990+0000","last_clean":"2024-03-18T00:26:15.294990+0000","last_became_active":"2024-03-18T00:26:15.286880+0000","last_became_peered":"2024-03-18T00:26:15.286880+0000","last_unstale":"2024-03-18T00:26:15.294990+0000","last_undegraded":"2024-03-18T00:26:15.294990+0000","last_fullsized":"2024-03-18T00:26:15.294990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295079+0000","last_change":"2024-03-18T00:26:15.288183+0000","last_active":"2024-03-18T00:26:15.295079+0000","last_peered":"2024-03-18T00:26:15.295079+0000","last_clean":"2024-03-18T00:26:15.295079+0000","last_became_active":"2024-03-18T00:26:15.287880+0000","last_became_peered":"2024-03-18T00:26:15.287880+0000","last_unstale":"2024-03-18T00:26:15.295079+0000","last_undegraded":"2024-03-18T00:26:15.295079+0000","last_fullsized":"2024-03-18T00:26:15.295079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:28:57.292386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283968+0000","last_change":"2024-03-18T00:26:15.282193+0000","last_active":"2024-03-18T00:26:15.283968+0000","last_peered":"2024-03-18T00:26:15.283968+0000","last_clean":"2024-03-18T00:26:15.283968+0000","last_became_active":"2024-03-18T00:26:15.281885+0000","last_became_peered":"2024-03-18T00:26:15.281885+0000","last_unstale":"2024-03-18T00:26:15.283968+0000","last_undegraded":"2024-03-18T00:26:15.283968+0000","last_fullsized":"2024-03-18T00:26:15.283968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:14:07.515832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281766+0000","last_change":"2024-03-18T00:26:15.274175+0000","last_active":"2024-03-18T00:26:15.281766+0000","last_peered":"2024-03-18T00:26:15.281766+0000","last_clean":"2024-03-18T00:26:15.281766+0000","last_became_active":"2024-03-18T00:26:15.273817+0000","last_became_peered":"2024-03-18T00:26:15.273817+0000","last_unstale":"2024-03-18T00:26:15.281766+0000","last_undegraded":"2024-03-18T00:26:15.281766+0000","last_fullsized":"2024-03-18T00:26:15.281766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285238+0000","last_change":"2024-03-18T00:26:15.279958+0000","last_active":"2024-03-18T00:26:15.285238+0000","last_peered":"2024-03-18T00:26:15.285238+0000","last_clean":"2024-03-18T00:26:15.285238+0000","last_became_active":"2024-03-18T00:26:15.279622+0000","last_became_peered":"2024-03-18T00:26:15.279622+0000","last_unstale":"2024-03-18T00:26:15.285238+0000","last_undegraded":"2024-03-18T00:26:15.285238+0000","last_fullsized":"2024-03-18T00:26:15.285238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290710+0000","last_change":"2024-03-18T00:26:15.288936+0000","last_active":"2024-03-18T00:26:15.290710+0000","last_peered":"2024-03-18T00:26:15.290710+0000","last_clean":"2024-03-18T00:26:15.290710+0000","last_became_active":"2024-03-18T00:26:15.288651+0000","last_became_peered":"2024-03-18T00:26:15.288651+0000","last_unstale":"2024-03-18T00:26:15.290710+0000","last_undegraded":"2024-03-18T00:26:15.290710+0000","last_fullsized":"2024-03-18T00:26:15.290710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.282566+0000","last_change":"2024-03-18T00:26:15.277573+0000","last_active":"2024-03-18T00:26:15.282566+0000","last_peered":"2024-03-18T00:26:15.282566+0000","last_clean":"2024-03-18T00:26:15.282566+0000","last_became_active":"2024-03-18T00:26:15.277269+0000","last_became_peered":"2024-03-18T00:26:15.277269+0000","last_unstale":"2024-03-18T00:26:15.282566+0000","last_undegraded":"2024-03-18T00:26:15.282566+0000","last_fullsized":"2024-03-18T00:26:15.282566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296163+0000","last_change":"2024-03-18T00:26:15.291581+0000","last_active":"2024-03-18T00:26:15.296163+0000","last_peered":"2024-03-18T00:26:15.296163+0000","last_clean":"2024-03-18T00:26:15.296163+0000","last_became_active":"2024-03-18T00:26:15.291314+0000","last_became_peered":"2024-03-18T00:26:15.291314+0000","last_unstale":"2024-03-18T00:26:15.296163+0000","last_undegraded":"2024-03-18T00:26:15.296163+0000","last_fullsized":"2024-03-18T00:26:15.296163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295415+0000","last_change":"2024-03-18T00:26:15.288757+0000","last_active":"2024-03-18T00:26:15.295415+0000","last_peered":"2024-03-18T00:26:15.295415+0000","last_clean":"2024-03-18T00:26:15.295415+0000","last_became_active":"2024-03-18T00:26:15.288455+0000","last_became_peered":"2024-03-18T00:26:15.288455+0000","last_unstale":"2024-03-18T00:26:15.295415+0000","last_undegraded":"2024-03-18T00:26:15.295415+0000","last_fullsized":"2024-03-18T00:26:15.295415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:03:11.364105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289413+0000","last_change":"2024-03-18T00:26:15.284127+0000","last_active":"2024-03-18T00:26:15.289413+0000","last_peered":"2024-03-18T00:26:15.289413+0000","last_clean":"2024-03-18T00:26:15.289413+0000","last_became_active":"2024-03-18T00:26:15.283874+0000","last_became_peered":"2024-03-18T00:26:15.283874+0000","last_unstale":"2024-03-18T00:26:15.289413+0000","last_undegraded":"2024-03-18T00:26:15.289413+0000","last_fullsized":"2024-03-18T00:26:15.289413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.287994+0000","last_change":"2024-03-18T00:26:15.281413+0000","last_active":"2024-03-18T00:26:15.287994+0000","last_peered":"2024-03-18T00:26:15.287994+0000","last_clean":"2024-03-18T00:26:15.287994+0000","last_became_active":"2024-03-18T00:26:15.281079+0000","last_became_peered":"2024-03-18T00:26:15.281079+0000","last_unstale":"2024-03-18T00:26:15.287994+0000","last_undegraded":"2024-03-18T00:26:15.287994+0000","last_fullsized":"2024-03-18T00:26:15.287994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:53.741084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288090+0000","last_change":"2024-03-18T00:26:15.285892+0000","last_active":"2024-03-18T00:26:15.288090+0000","last_peered":"2024-03-18T00:26:15.288090+0000","last_clean":"2024-03-18T00:26:15.288090+0000","last_became_active":"2024-03-18T00:26:15.285622+0000","last_became_peered":"2024-03-18T00:26:15.285622+0000","last_unstale":"2024-03-18T00:26:15.288090+0000","last_undegraded":"2024-03-18T00:26:15.288090+0000","last_fullsized":"2024-03-18T00:26:15.288090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291884+0000","last_change":"2024-03-18T00:26:15.289251+0000","last_active":"2024-03-18T00:26:15.291884+0000","last_peered":"2024-03-18T00:26:15.291884+0000","last_clean":"2024-03-18T00:26:15.291884+0000","last_became_active":"2024-03-18T00:26:15.288967+0000","last_became_peered":"2024-03-18T00:26:15.288967+0000","last_unstale":"2024-03-18T00:26:15.291884+0000","last_undegraded":"2024-03-18T00:26:15.291884+0000","last_fullsized":"2024-03-18T00:26:15.291884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.280255+0000","last_change":"2024-03-18T00:26:15.278470+0000","last_active":"2024-03-18T00:26:15.280255+0000","last_peered":"2024-03-18T00:26:15.280255+0000","last_clean":"2024-03-18T00:26:15.280255+0000","last_became_active":"2024-03-18T00:26:15.278179+0000","last_became_peered":"2024-03-18T00:26:15.278179+0000","last_unstale":"2024-03-18T00:26:15.280255+0000","last_undegraded":"2024-03-18T00:26:15.280255+0000","last_fullsized":"2024-03-18T00:26:15.280255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:58.710352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296094+0000","last_change":"2024-03-18T00:26:15.293905+0000","last_active":"2024-03-18T00:26:15.296094+0000","last_peered":"2024-03-18T00:26:15.296094+0000","last_clean":"2024-03-18T00:26:15.296094+0000","last_became_active":"2024-03-18T00:26:15.293613+0000","last_became_peered":"2024-03-18T00:26:15.293613+0000","last_unstale":"2024-03-18T00:26:15.296094+0000","last_undegraded":"2024-03-18T00:26:15.296094+0000","last_fullsized":"2024-03-18T00:26:15.296094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291714+0000","last_change":"2024-03-18T00:26:15.289634+0000","last_active":"2024-03-18T00:26:15.291714+0000","last_peered":"2024-03-18T00:26:15.291714+0000","last_clean":"2024-03-18T00:26:15.291714+0000","last_became_active":"2024-03-18T00:26:15.289378+0000","last_became_peered":"2024-03-18T00:26:15.289378+0000","last_unstale":"2024-03-18T00:26:15.291714+0000","last_undegraded":"2024-03-18T00:26:15.291714+0000","last_fullsized":"2024-03-18T00:26:15.291714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293221+0000","last_change":"2024-03-18T00:26:14.275427+0000","last_active":"2024-03-18T00:26:15.293221+0000","last_peered":"2024-03-18T00:26:15.293221+0000","last_clean":"2024-03-18T00:26:15.293221+0000","last_became_active":"2024-03-18T00:26:14.275140+0000","last_became_peered":"2024-03-18T00:26:14.275140+0000","last_unstale":"2024-03-18T00:26:15.293221+0000","last_undegraded":"2024-03-18T00:26:15.293221+0000","last_fullsized":"2024-03-18T00:26:15.293221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284394+0000","last_change":"2024-03-18T00:26:15.279637+0000","last_active":"2024-03-18T00:26:15.284394+0000","last_peered":"2024-03-18T00:26:15.284394+0000","last_clean":"2024-03-18T00:26:15.284394+0000","last_became_active":"2024-03-18T00:26:15.279276+0000","last_became_peered":"2024-03-18T00:26:15.279276+0000","last_unstale":"2024-03-18T00:26:15.284394+0000","last_undegraded":"2024-03-18T00:26:15.284394+0000","last_fullsized":"2024-03-18T00:26:15.284394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:35.959368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290239+0000","last_change":"2024-03-18T00:26:14.277732+0000","last_active":"2024-03-18T00:26:15.290239+0000","last_peered":"2024-03-18T00:26:15.290239+0000","last_clean":"2024-03-18T00:26:15.290239+0000","last_became_active":"2024-03-18T00:26:14.277455+0000","last_became_peered":"2024-03-18T00:26:14.277455+0000","last_unstale":"2024-03-18T00:26:15.290239+0000","last_undegraded":"2024-03-18T00:26:15.290239+0000","last_fullsized":"2024-03-18T00:26:15.290239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288164+0000","last_change":"2024-03-18T00:26:15.285898+0000","last_active":"2024-03-18T00:26:15.288164+0000","last_peered":"2024-03-18T00:26:15.288164+0000","last_clean":"2024-03-18T00:26:15.288164+0000","last_became_active":"2024-03-18T00:26:15.285590+0000","last_became_peered":"2024-03-18T00:26:15.285590+0000","last_unstale":"2024-03-18T00:26:15.288164+0000","last_undegraded":"2024-03-18T00:26:15.288164+0000","last_fullsized":"2024-03-18T00:26:15.288164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295607+0000","last_change":"2024-03-18T00:26:14.282192+0000","last_active":"2024-03-18T00:26:15.295607+0000","last_peered":"2024-03-18T00:26:15.295607+0000","last_clean":"2024-03-18T00:26:15.295607+0000","last_became_active":"2024-03-18T00:26:14.281914+0000","last_became_peered":"2024-03-18T00:26:14.281914+0000","last_unstale":"2024-03-18T00:26:15.295607+0000","last_undegraded":"2024-03-18T00:26:15.295607+0000","last_fullsized":"2024-03-18T00:26:15.295607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:44.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288201+0000","last_change":"2024-03-18T00:26:15.284127+0000","last_active":"2024-03-18T00:26:15.288201+0000","last_peered":"2024-03-18T00:26:15.288201+0000","last_clean":"2024-03-18T00:26:15.288201+0000","last_became_active":"2024-03-18T00:26:15.283835+0000","last_became_peered":"2024-03-18T00:26:15.283835+0000","last_unstale":"2024-03-18T00:26:15.288201+0000","last_undegraded":"2024-03-18T00:26:15.288201+0000","last_fullsized":"2024-03-18T00:26:15.288201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301980+0000","last_change":"2024-03-18T00:26:14.281066+0000","last_active":"2024-03-18T00:26:15.301980+0000","last_peered":"2024-03-18T00:26:15.301980+0000","last_clean":"2024-03-18T00:26:15.301980+0000","last_became_active":"2024-03-18T00:26:14.280804+0000","last_became_peered":"2024-03-18T00:26:14.280804+0000","last_unstale":"2024-03-18T00:26:15.301980+0000","last_undegraded":"2024-03-18T00:26:15.301980+0000","last_fullsized":"2024-03-18T00:26:15.301980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:35:30.904141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294540+0000","last_change":"2024-03-18T00:26:15.292301+0000","last_active":"2024-03-18T00:26:15.294540+0000","last_peered":"2024-03-18T00:26:15.294540+0000","last_clean":"2024-03-18T00:26:15.294540+0000","last_became_active":"2024-03-18T00:26:15.292043+0000","last_became_peered":"2024-03-18T00:26:15.292043+0000","last_unstale":"2024-03-18T00:26:15.294540+0000","last_undegraded":"2024-03-18T00:26:15.294540+0000","last_fullsized":"2024-03-18T00:26:15.294540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296015+0000","last_change":"2024-03-18T00:26:14.277664+0000","last_active":"2024-03-18T00:26:15.296015+0000","last_peered":"2024-03-18T00:26:15.296015+0000","last_clean":"2024-03-18T00:26:15.296015+0000","last_became_active":"2024-03-18T00:26:14.276483+0000","last_became_peered":"2024-03-18T00:26:14.276483+0000","last_unstale":"2024-03-18T00:26:15.296015+0000","last_undegraded":"2024-03-18T00:26:15.296015+0000","last_fullsized":"2024-03-18T00:26:15.296015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:06.443531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281254+0000","last_change":"2024-03-18T00:26:15.275239+0000","last_active":"2024-03-18T00:26:15.281254+0000","last_peered":"2024-03-18T00:26:15.281254+0000","last_clean":"2024-03-18T00:26:15.281254+0000","last_became_active":"2024-03-18T00:26:15.274920+0000","last_became_peered":"2024-03-18T00:26:15.274920+0000","last_unstale":"2024-03-18T00:26:15.281254+0000","last_undegraded":"2024-03-18T00:26:15.281254+0000","last_fullsized":"2024-03-18T00:26:15.281254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295972+0000","last_change":"2024-03-18T00:26:14.276055+0000","last_active":"2024-03-18T00:26:15.295972+0000","last_peered":"2024-03-18T00:26:15.295972+0000","last_clean":"2024-03-18T00:26:15.295972+0000","last_became_active":"2024-03-18T00:26:14.275359+0000","last_became_peered":"2024-03-18T00:26:14.275359+0000","last_unstale":"2024-03-18T00:26:15.295972+0000","last_undegraded":"2024-03-18T00:26:15.295972+0000","last_fullsized":"2024-03-18T00:26:15.295972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286220+0000","last_change":"2024-03-18T00:26:15.280410+0000","last_active":"2024-03-18T00:26:15.286220+0000","last_peered":"2024-03-18T00:26:15.286220+0000","last_clean":"2024-03-18T00:26:15.286220+0000","last_became_active":"2024-03-18T00:26:15.280089+0000","last_became_peered":"2024-03-18T00:26:15.280089+0000","last_unstale":"2024-03-18T00:26:15.286220+0000","last_undegraded":"2024-03-18T00:26:15.286220+0000","last_fullsized":"2024-03-18T00:26:15.286220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277758+0000","last_change":"2024-03-18T00:26:14.273527+0000","last_active":"2024-03-18T00:26:15.277758+0000","last_peered":"2024-03-18T00:26:15.277758+0000","last_clean":"2024-03-18T00:26:15.277758+0000","last_became_active":"2024-03-18T00:26:14.273224+0000","last_became_peered":"2024-03-18T00:26:14.273224+0000","last_unstale":"2024-03-18T00:26:15.277758+0000","last_undegraded":"2024-03-18T00:26:15.277758+0000","last_fullsized":"2024-03-18T00:26:15.277758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:52.739096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285097+0000","last_change":"2024-03-18T00:26:15.280061+0000","last_active":"2024-03-18T00:26:15.285097+0000","last_peered":"2024-03-18T00:26:15.285097+0000","last_clean":"2024-03-18T00:26:15.285097+0000","last_became_active":"2024-03-18T00:26:15.279762+0000","last_became_peered":"2024-03-18T00:26:15.279762+0000","last_unstale":"2024-03-18T00:26:15.285097+0000","last_undegraded":"2024-03-18T00:26:15.285097+0000","last_fullsized":"2024-03-18T00:26:15.285097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267062+0000","last_change":"2024-03-18T00:26:14.273737+0000","last_active":"2024-03-18T00:26:15.267062+0000","last_peered":"2024-03-18T00:26:15.267062+0000","last_clean":"2024-03-18T00:26:15.267062+0000","last_became_active":"2024-03-18T00:26:14.273314+0000","last_became_peered":"2024-03-18T00:26:14.273314+0000","last_unstale":"2024-03-18T00:26:15.267062+0000","last_undegraded":"2024-03-18T00:26:15.267062+0000","last_fullsized":"2024-03-18T00:26:15.267062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:14:06.513843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290155+0000","last_change":"2024-03-18T00:26:15.284821+0000","last_active":"2024-03-18T00:26:15.290155+0000","last_peered":"2024-03-18T00:26:15.290155+0000","last_clean":"2024-03-18T00:26:15.290155+0000","last_became_active":"2024-03-18T00:26:15.284524+0000","last_became_peered":"2024-03-18T00:26:15.284524+0000","last_unstale":"2024-03-18T00:26:15.290155+0000","last_undegraded":"2024-03-18T00:26:15.290155+0000","last_fullsized":"2024-03-18T00:26:15.290155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277497+0000","last_change":"2024-03-18T00:26:14.277503+0000","last_active":"2024-03-18T00:26:15.277497+0000","last_peered":"2024-03-18T00:26:15.277497+0000","last_clean":"2024-03-18T00:26:15.277497+0000","last_became_active":"2024-03-18T00:26:14.277233+0000","last_became_peered":"2024-03-18T00:26:14.277233+0000","last_unstale":"2024-03-18T00:26:15.277497+0000","last_undegraded":"2024-03-18T00:26:15.277497+0000","last_fullsized":"2024-03-18T00:26:15.277497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:18.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295785+0000","last_change":"2024-03-18T00:26:15.289086+0000","last_active":"2024-03-18T00:26:15.295785+0000","last_peered":"2024-03-18T00:26:15.295785+0000","last_clean":"2024-03-18T00:26:15.295785+0000","last_became_active":"2024-03-18T00:26:15.288080+0000","last_became_peered":"2024-03-18T00:26:15.288080+0000","last_unstale":"2024-03-18T00:26:15.295785+0000","last_undegraded":"2024-03-18T00:26:15.295785+0000","last_fullsized":"2024-03-18T00:26:15.295785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:43:12.498053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268109+0000","last_change":"2024-03-18T00:26:14.277049+0000","last_active":"2024-03-18T00:26:15.268109+0000","last_peered":"2024-03-18T00:26:15.268109+0000","last_clean":"2024-03-18T00:26:15.268109+0000","last_became_active":"2024-03-18T00:26:14.276757+0000","last_became_peered":"2024-03-18T00:26:14.276757+0000","last_unstale":"2024-03-18T00:26:15.268109+0000","last_undegraded":"2024-03-18T00:26:15.268109+0000","last_fullsized":"2024-03-18T00:26:15.268109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295428+0000","last_change":"2024-03-18T00:26:15.288796+0000","last_active":"2024-03-18T00:26:15.295428+0000","last_peered":"2024-03-18T00:26:15.295428+0000","last_clean":"2024-03-18T00:26:15.295428+0000","last_became_active":"2024-03-18T00:26:15.288489+0000","last_became_peered":"2024-03-18T00:26:15.288489+0000","last_unstale":"2024-03-18T00:26:15.295428+0000","last_undegraded":"2024-03-18T00:26:15.295428+0000","last_fullsized":"2024-03-18T00:26:15.295428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:07:46.970888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290400+0000","last_change":"2024-03-18T00:26:14.275623+0000","last_active":"2024-03-18T00:26:15.290400+0000","last_peered":"2024-03-18T00:26:15.290400+0000","last_clean":"2024-03-18T00:26:15.290400+0000","last_became_active":"2024-03-18T00:26:14.275325+0000","last_became_peered":"2024-03-18T00:26:14.275325+0000","last_unstale":"2024-03-18T00:26:15.290400+0000","last_undegraded":"2024-03-18T00:26:15.290400+0000","last_fullsized":"2024-03-18T00:26:15.290400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:56.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290346+0000","last_change":"2024-03-18T00:26:15.286692+0000","last_active":"2024-03-18T00:26:15.290346+0000","last_peered":"2024-03-18T00:26:15.290346+0000","last_clean":"2024-03-18T00:26:15.290346+0000","last_became_active":"2024-03-18T00:26:15.286442+0000","last_became_peered":"2024-03-18T00:26:15.286442+0000","last_unstale":"2024-03-18T00:26:15.290346+0000","last_undegraded":"2024-03-18T00:26:15.290346+0000","last_fullsized":"2024-03-18T00:26:15.290346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.303918+0000","last_change":"2024-03-18T00:26:14.282024+0000","last_active":"2024-03-18T00:26:15.303918+0000","last_peered":"2024-03-18T00:26:15.303918+0000","last_clean":"2024-03-18T00:26:15.303918+0000","last_became_active":"2024-03-18T00:26:14.281656+0000","last_became_peered":"2024-03-18T00:26:14.281656+0000","last_unstale":"2024-03-18T00:26:15.303918+0000","last_undegraded":"2024-03-18T00:26:15.303918+0000","last_fullsized":"2024-03-18T00:26:15.303918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:40.009764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283948+0000","last_change":"2024-03-18T00:26:15.280492+0000","last_active":"2024-03-18T00:26:15.283948+0000","last_peered":"2024-03-18T00:26:15.283948+0000","last_clean":"2024-03-18T00:26:15.283948+0000","last_became_active":"2024-03-18T00:26:15.279970+0000","last_became_peered":"2024-03-18T00:26:15.279970+0000","last_unstale":"2024-03-18T00:26:15.283948+0000","last_undegraded":"2024-03-18T00:26:15.283948+0000","last_fullsized":"2024-03-18T00:26:15.283948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294952+0000","last_change":"2024-03-18T00:26:14.276116+0000","last_active":"2024-03-18T00:26:15.294952+0000","last_peered":"2024-03-18T00:26:15.294952+0000","last_clean":"2024-03-18T00:26:15.294952+0000","last_became_active":"2024-03-18T00:26:14.275831+0000","last_became_peered":"2024-03-18T00:26:14.275831+0000","last_unstale":"2024-03-18T00:26:15.294952+0000","last_undegraded":"2024-03-18T00:26:15.294952+0000","last_fullsized":"2024-03-18T00:26:15.294952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294943+0000","last_change":"2024-03-18T00:26:15.283157+0000","last_active":"2024-03-18T00:26:15.294943+0000","last_peered":"2024-03-18T00:26:15.294943+0000","last_clean":"2024-03-18T00:26:15.294943+0000","last_became_active":"2024-03-18T00:26:15.282426+0000","last_became_peered":"2024-03-18T00:26:15.282426+0000","last_unstale":"2024-03-18T00:26:15.294943+0000","last_undegraded":"2024-03-18T00:26:15.294943+0000","last_fullsized":"2024-03-18T00:26:15.294943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.269290+0000","last_change":"2024-03-18T00:26:14.284375+0000","last_active":"2024-03-18T00:26:15.269290+0000","last_peered":"2024-03-18T00:26:15.269290+0000","last_clean":"2024-03-18T00:26:15.269290+0000","last_became_active":"2024-03-18T00:26:14.284163+0000","last_became_peered":"2024-03-18T00:26:14.284163+0000","last_unstale":"2024-03-18T00:26:15.269290+0000","last_undegraded":"2024-03-18T00:26:15.269290+0000","last_fullsized":"2024-03-18T00:26:15.269290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296409+0000","last_change":"2024-03-18T00:26:15.294228+0000","last_active":"2024-03-18T00:26:15.296409+0000","last_peered":"2024-03-18T00:26:15.296409+0000","last_clean":"2024-03-18T00:26:15.296409+0000","last_became_active":"2024-03-18T00:26:15.293959+0000","last_became_peered":"2024-03-18T00:26:15.293959+0000","last_unstale":"2024-03-18T00:26:15.296409+0000","last_undegraded":"2024-03-18T00:26:15.296409+0000","last_fullsized":"2024-03-18T00:26:15.296409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277623+0000","last_change":"2024-03-18T00:26:14.276817+0000","last_active":"2024-03-18T00:26:15.277623+0000","last_peered":"2024-03-18T00:26:15.277623+0000","last_clean":"2024-03-18T00:26:15.277623+0000","last_became_active":"2024-03-18T00:26:14.276511+0000","last_became_peered":"2024-03-18T00:26:14.276511+0000","last_unstale":"2024-03-18T00:26:15.277623+0000","last_undegraded":"2024-03-18T00:26:15.277623+0000","last_fullsized":"2024-03-18T00:26:15.277623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:39.772951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284398+0000","last_change":"2024-03-18T00:26:15.279560+0000","last_active":"2024-03-18T00:26:15.284398+0000","last_peered":"2024-03-18T00:26:15.284398+0000","last_clean":"2024-03-18T00:26:15.284398+0000","last_became_active":"2024-03-18T00:26:15.279206+0000","last_became_peered":"2024-03-18T00:26:15.279206+0000","last_unstale":"2024-03-18T00:26:15.284398+0000","last_undegraded":"2024-03-18T00:26:15.284398+0000","last_fullsized":"2024-03-18T00:26:15.284398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:44.936528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.302168+0000","last_change":"2024-03-18T00:26:14.281263+0000","last_active":"2024-03-18T00:26:15.302168+0000","last_peered":"2024-03-18T00:26:15.302168+0000","last_clean":"2024-03-18T00:26:15.302168+0000","last_became_active":"2024-03-18T00:26:14.280970+0000","last_became_peered":"2024-03-18T00:26:14.280970+0000","last_unstale":"2024-03-18T00:26:15.302168+0000","last_undegraded":"2024-03-18T00:26:15.302168+0000","last_fullsized":"2024-03-18T00:26:15.302168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:07.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284899+0000","last_change":"2024-03-18T00:26:15.278905+0000","last_active":"2024-03-18T00:26:15.284899+0000","last_peered":"2024-03-18T00:26:15.284899+0000","last_clean":"2024-03-18T00:26:15.284899+0000","last_became_active":"2024-03-18T00:26:15.278586+0000","last_became_peered":"2024-03-18T00:26:15.278586+0000","last_unstale":"2024-03-18T00:26:15.284899+0000","last_undegraded":"2024-03-18T00:26:15.284899+0000","last_fullsized":"2024-03-18T00:26:15.284899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301741+0000","last_change":"2024-03-18T00:26:14.280313+0000","last_active":"2024-03-18T00:26:15.301741+0000","last_peered":"2024-03-18T00:26:15.301741+0000","last_clean":"2024-03-18T00:26:15.301741+0000","last_became_active":"2024-03-18T00:26:14.280016+0000","last_became_peered":"2024-03-18T00:26:14.280016+0000","last_unstale":"2024-03-18T00:26:15.301741+0000","last_undegraded":"2024-03-18T00:26:15.301741+0000","last_fullsized":"2024-03-18T00:26:15.301741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285085+0000","last_change":"2024-03-18T00:26:15.280436+0000","last_active":"2024-03-18T00:26:15.285085+0000","last_peered":"2024-03-18T00:26:15.285085+0000","last_clean":"2024-03-18T00:26:15.285085+0000","last_became_active":"2024-03-18T00:26:15.280168+0000","last_became_peered":"2024-03-18T00:26:15.280168+0000","last_unstale":"2024-03-18T00:26:15.285085+0000","last_undegraded":"2024-03-18T00:26:15.285085+0000","last_fullsized":"2024-03-18T00:26:15.285085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293751+0000","last_change":"2024-03-18T00:26:14.275535+0000","last_active":"2024-03-18T00:26:15.293751+0000","last_peered":"2024-03-18T00:26:15.293751+0000","last_clean":"2024-03-18T00:26:15.293751+0000","last_became_active":"2024-03-18T00:26:14.275213+0000","last_became_peered":"2024-03-18T00:26:14.275213+0000","last_unstale":"2024-03-18T00:26:15.293751+0000","last_undegraded":"2024-03-18T00:26:15.293751+0000","last_fullsized":"2024-03-18T00:26:15.293751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285719+0000","last_change":"2024-03-18T00:26:15.283002+0000","last_active":"2024-03-18T00:26:15.285719+0000","last_peered":"2024-03-18T00:26:15.285719+0000","last_clean":"2024-03-18T00:26:15.285719+0000","last_became_active":"2024-03-18T00:26:15.282752+0000","last_became_peered":"2024-03-18T00:26:15.282752+0000","last_unstale":"2024-03-18T00:26:15.285719+0000","last_undegraded":"2024-03-18T00:26:15.285719+0000","last_fullsized":"2024-03-18T00:26:15.285719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296501+0000","last_change":"2024-03-18T00:26:14.277532+0000","last_active":"2024-03-18T00:26:15.296501+0000","last_peered":"2024-03-18T00:26:15.296501+0000","last_clean":"2024-03-18T00:26:15.296501+0000","last_became_active":"2024-03-18T00:26:14.276438+0000","last_became_peered":"2024-03-18T00:26:14.276438+0000","last_unstale":"2024-03-18T00:26:15.296501+0000","last_undegraded":"2024-03-18T00:26:15.296501+0000","last_fullsized":"2024-03-18T00:26:15.296501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293449+0000","last_change":"2024-03-18T00:26:15.292256+0000","last_active":"2024-03-18T00:26:15.293449+0000","last_peered":"2024-03-18T00:26:15.293449+0000","last_clean":"2024-03-18T00:26:15.293449+0000","last_became_active":"2024-03-18T00:26:15.291987+0000","last_became_peered":"2024-03-18T00:26:15.291987+0000","last_unstale":"2024-03-18T00:26:15.293449+0000","last_undegraded":"2024-03-18T00:26:15.293449+0000","last_fullsized":"2024-03-18T00:26:15.293449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:22.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267994+0000","last_change":"2024-03-18T00:26:14.277912+0000","last_active":"2024-03-18T00:26:15.267994+0000","last_peered":"2024-03-18T00:26:15.267994+0000","last_clean":"2024-03-18T00:26:15.267994+0000","last_became_active":"2024-03-18T00:26:14.277191+0000","last_became_peered":"2024-03-18T00:26:14.277191+0000","last_unstale":"2024-03-18T00:26:15.267994+0000","last_undegraded":"2024-03-18T00:26:15.267994+0000","last_fullsized":"2024-03-18T00:26:15.267994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284949+0000","last_change":"2024-03-18T00:26:15.283054+0000","last_active":"2024-03-18T00:26:15.284949+0000","last_peered":"2024-03-18T00:26:15.284949+0000","last_clean":"2024-03-18T00:26:15.284949+0000","last_became_active":"2024-03-18T00:26:15.282750+0000","last_became_peered":"2024-03-18T00:26:15.282750+0000","last_unstale":"2024-03-18T00:26:15.284949+0000","last_undegraded":"2024-03-18T00:26:15.284949+0000","last_fullsized":"2024-03-18T00:26:15.284949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:07:26.791101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.302163+0000","last_change":"2024-03-18T00:26:14.283891+0000","last_active":"2024-03-18T00:26:15.302163+0000","last_peered":"2024-03-18T00:26:15.302163+0000","last_clean":"2024-03-18T00:26:15.302163+0000","last_became_active":"2024-03-18T00:26:14.283558+0000","last_became_peered":"2024-03-18T00:26:14.283558+0000","last_unstale":"2024-03-18T00:26:15.302163+0000","last_undegraded":"2024-03-18T00:26:15.302163+0000","last_fullsized":"2024-03-18T00:26:15.302163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.278967+0000","last_change":"2024-03-18T00:26:15.275360+0000","last_active":"2024-03-18T00:26:15.278967+0000","last_peered":"2024-03-18T00:26:15.278967+0000","last_clean":"2024-03-18T00:26:15.278967+0000","last_became_active":"2024-03-18T00:26:15.275085+0000","last_became_peered":"2024-03-18T00:26:15.275085+0000","last_unstale":"2024-03-18T00:26:15.278967+0000","last_undegraded":"2024-03-18T00:26:15.278967+0000","last_fullsized":"2024-03-18T00:26:15.278967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:39.645589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.270779+0000","last_change":"2024-03-18T00:26:14.282893+0000","last_active":"2024-03-18T00:26:15.270779+0000","last_peered":"2024-03-18T00:26:15.270779+0000","last_clean":"2024-03-18T00:26:15.270779+0000","last_became_active":"2024-03-18T00:26:14.282625+0000","last_became_peered":"2024-03-18T00:26:14.282625+0000","last_unstale":"2024-03-18T00:26:15.270779+0000","last_undegraded":"2024-03-18T00:26:15.270779+0000","last_fullsized":"2024-03-18T00:26:15.270779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:21.658018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.275708+0000","last_change":"2024-03-18T00:26:15.273821+0000","last_active":"2024-03-18T00:26:15.275708+0000","last_peered":"2024-03-18T00:26:15.275708+0000","last_clean":"2024-03-18T00:26:15.275708+0000","last_became_active":"2024-03-18T00:26:15.273516+0000","last_became_peered":"2024-03-18T00:26:15.273516+0000","last_unstale":"2024-03-18T00:26:15.275708+0000","last_undegraded":"2024-03-18T00:26:15.275708+0000","last_fullsized":"2024-03-18T00:26:15.275708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:40:29.461632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.266973+0000","last_change":"2024-03-18T00:26:14.280537+0000","last_active":"2024-03-18T00:26:15.266973+0000","last_peered":"2024-03-18T00:26:15.266973+0000","last_clean":"2024-03-18T00:26:15.266973+0000","last_became_active":"2024-03-18T00:26:14.280312+0000","last_became_peered":"2024-03-18T00:26:14.280312+0000","last_unstale":"2024-03-18T00:26:15.266973+0000","last_undegraded":"2024-03-18T00:26:15.266973+0000","last_fullsized":"2024-03-18T00:26:15.266973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:07:25.789112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290978+0000","last_change":"2024-03-18T00:26:15.288162+0000","last_active":"2024-03-18T00:26:15.290978+0000","last_peered":"2024-03-18T00:26:15.290978+0000","last_clean":"2024-03-18T00:26:15.290978+0000","last_became_active":"2024-03-18T00:26:15.287794+0000","last_became_peered":"2024-03-18T00:26:15.287794+0000","last_unstale":"2024-03-18T00:26:15.290978+0000","last_undegraded":"2024-03-18T00:26:15.290978+0000","last_fullsized":"2024-03-18T00:26:15.290978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.272591+0000","last_change":"2024-03-18T00:26:14.275777+0000","last_active":"2024-03-18T00:26:15.272591+0000","last_peered":"2024-03-18T00:26:15.272591+0000","last_clean":"2024-03-18T00:26:15.272591+0000","last_became_active":"2024-03-18T00:26:14.275371+0000","last_became_peered":"2024-03-18T00:26:14.275371+0000","last_unstale":"2024-03-18T00:26:15.272591+0000","last_undegraded":"2024-03-18T00:26:15.272591+0000","last_fullsized":"2024-03-18T00:26:15.272591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:40.009764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281363+0000","last_change":"2024-03-18T00:26:15.278709+0000","last_active":"2024-03-18T00:26:15.281363+0000","last_peered":"2024-03-18T00:26:15.281363+0000","last_clean":"2024-03-18T00:26:15.281363+0000","last_became_active":"2024-03-18T00:26:15.278396+0000","last_became_peered":"2024-03-18T00:26:15.278396+0000","last_unstale":"2024-03-18T00:26:15.281363+0000","last_undegraded":"2024-03-18T00:26:15.281363+0000","last_fullsized":"2024-03-18T00:26:15.281363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:55.377409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301657+0000","last_change":"2024-03-18T00:26:14.278817+0000","last_active":"2024-03-18T00:26:15.301657+0000","last_peered":"2024-03-18T00:26:15.301657+0000","last_clean":"2024-03-18T00:26:15.301657+0000","last_became_active":"2024-03-18T00:26:14.278546+0000","last_became_peered":"2024-03-18T00:26:14.278546+0000","last_unstale":"2024-03-18T00:26:15.301657+0000","last_undegraded":"2024-03-18T00:26:15.301657+0000","last_fullsized":"2024-03-18T00:26:15.301657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289171+0000","last_change":"2024-03-18T00:26:15.282087+0000","last_active":"2024-03-18T00:26:15.289171+0000","last_peered":"2024-03-18T00:26:15.289171+0000","last_clean":"2024-03-18T00:26:15.289171+0000","last_became_active":"2024-03-18T00:26:15.281230+0000","last_became_peered":"2024-03-18T00:26:15.281230+0000","last_unstale":"2024-03-18T00:26:15.289171+0000","last_undegraded":"2024-03-18T00:26:15.289171+0000","last_fullsized":"2024-03-18T00:26:15.289171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268166+0000","last_change":"2024-03-18T00:26:14.283925+0000","last_active":"2024-03-18T00:26:15.268166+0000","last_peered":"2024-03-18T00:26:15.268166+0000","last_clean":"2024-03-18T00:26:15.268166+0000","last_became_active":"2024-03-18T00:26:14.283489+0000","last_became_peered":"2024-03-18T00:26:14.283489+0000","last_unstale":"2024-03-18T00:26:15.268166+0000","last_undegraded":"2024-03-18T00:26:15.268166+0000","last_fullsized":"2024-03-18T00:26:15.268166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293260+0000","last_change":"2024-03-18T00:26:15.285907+0000","last_active":"2024-03-18T00:26:15.293260+0000","last_peered":"2024-03-18T00:26:15.293260+0000","last_clean":"2024-03-18T00:26:15.293260+0000","last_became_active":"2024-03-18T00:26:15.285547+0000","last_became_peered":"2024-03-18T00:26:15.285547+0000","last_unstale":"2024-03-18T00:26:15.293260+0000","last_undegraded":"2024-03-18T00:26:15.293260+0000","last_fullsized":"2024-03-18T00:26:15.293260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268723+0000","last_change":"2024-03-18T00:26:14.276464+0000","last_active":"2024-03-18T00:26:15.268723+0000","last_peered":"2024-03-18T00:26:15.268723+0000","last_clean":"2024-03-18T00:26:15.268723+0000","last_became_active":"2024-03-18T00:26:14.276202+0000","last_became_peered":"2024-03-18T00:26:14.276202+0000","last_unstale":"2024-03-18T00:26:15.268723+0000","last_undegraded":"2024-03-18T00:26:15.268723+0000","last_fullsized":"2024-03-18T00:26:15.268723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285455+0000","last_change":"2024-03-18T00:26:15.278865+0000","last_active":"2024-03-18T00:26:15.285455+0000","last_peered":"2024-03-18T00:26:15.285455+0000","last_clean":"2024-03-18T00:26:15.285455+0000","last_became_active":"2024-03-18T00:26:15.278600+0000","last_became_peered":"2024-03-18T00:26:15.278600+0000","last_unstale":"2024-03-18T00:26:15.285455+0000","last_undegraded":"2024-03-18T00:26:15.285455+0000","last_fullsized":"2024-03-18T00:26:15.285455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:04:00.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268097+0000","last_change":"2024-03-18T00:26:14.279624+0000","last_active":"2024-03-18T00:26:15.268097+0000","last_peered":"2024-03-18T00:26:15.268097+0000","last_clean":"2024-03-18T00:26:15.268097+0000","last_became_active":"2024-03-18T00:26:14.279368+0000","last_became_peered":"2024-03-18T00:26:14.279368+0000","last_unstale":"2024-03-18T00:26:15.268097+0000","last_undegraded":"2024-03-18T00:26:15.268097+0000","last_fullsized":"2024-03-18T00:26:15.268097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.279840+0000","last_change":"2024-03-18T00:26:15.277004+0000","last_active":"2024-03-18T00:26:15.279840+0000","last_peered":"2024-03-18T00:26:15.279840+0000","last_clean":"2024-03-18T00:26:15.279840+0000","last_became_active":"2024-03-18T00:26:15.276421+0000","last_became_peered":"2024-03-18T00:26:15.276421+0000","last_unstale":"2024-03-18T00:26:15.279840+0000","last_undegraded":"2024-03-18T00:26:15.279840+0000","last_fullsized":"2024-03-18T00:26:15.279840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.269562+0000","last_change":"2024-03-18T00:26:14.278413+0000","last_active":"2024-03-18T00:26:15.269562+0000","last_peered":"2024-03-18T00:26:15.269562+0000","last_clean":"2024-03-18T00:26:15.269562+0000","last_became_active":"2024-03-18T00:26:14.278134+0000","last_became_peered":"2024-03-18T00:26:14.278134+0000","last_unstale":"2024-03-18T00:26:15.269562+0000","last_undegraded":"2024-03-18T00:26:15.269562+0000","last_fullsized":"2024-03-18T00:26:15.269562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.292415+0000","last_change":"2024-03-18T00:26:15.281448+0000","last_active":"2024-03-18T00:26:15.292415+0000","last_peered":"2024-03-18T00:26:15.292415+0000","last_clean":"2024-03-18T00:26:15.292415+0000","last_became_active":"2024-03-18T00:26:15.281008+0000","last_became_peered":"2024-03-18T00:26:15.281008+0000","last_unstale":"2024-03-18T00:26:15.292415+0000","last_undegraded":"2024-03-18T00:26:15.292415+0000","last_fullsized":"2024-03-18T00:26:15.292415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267158+0000","last_change":"2024-03-18T00:26:14.279598+0000","last_active":"2024-03-18T00:26:15.267158+0000","last_peered":"2024-03-18T00:26:15.267158+0000","last_clean":"2024-03-18T00:26:15.267158+0000","last_became_active":"2024-03-18T00:26:14.279304+0000","last_became_peered":"2024-03-18T00:26:14.279304+0000","last_unstale":"2024-03-18T00:26:15.267158+0000","last_undegraded":"2024-03-18T00:26:15.267158+0000","last_fullsized":"2024-03-18T00:26:15.267158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:21.658018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277761+0000","last_change":"2024-03-18T00:26:15.273962+0000","last_active":"2024-03-18T00:26:15.277761+0000","last_peered":"2024-03-18T00:26:15.277761+0000","last_clean":"2024-03-18T00:26:15.277761+0000","last_became_active":"2024-03-18T00:26:15.273593+0000","last_became_peered":"2024-03-18T00:26:15.273593+0000","last_unstale":"2024-03-18T00:26:15.277761+0000","last_undegraded":"2024-03-18T00:26:15.277761+0000","last_fullsized":"2024-03-18T00:26:15.277761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277419+0000","last_change":"2024-03-18T00:26:14.275365+0000","last_active":"2024-03-18T00:26:15.277419+0000","last_peered":"2024-03-18T00:26:15.277419+0000","last_clean":"2024-03-18T00:26:15.277419+0000","last_became_active":"2024-03-18T00:26:14.275090+0000","last_became_peered":"2024-03-18T00:26:14.275090+0000","last_unstale":"2024-03-18T00:26:15.277419+0000","last_undegraded":"2024-03-18T00:26:15.277419+0000","last_fullsized":"2024-03-18T00:26:15.277419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:56.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288599+0000","last_change":"2024-03-18T00:26:15.287324+0000","last_active":"2024-03-18T00:26:15.288599+0000","last_peered":"2024-03-18T00:26:15.288599+0000","last_clean":"2024-03-18T00:26:15.288599+0000","last_became_active":"2024-03-18T00:26:15.287049+0000","last_became_peered":"2024-03-18T00:26:15.287049+0000","last_unstale":"2024-03-18T00:26:15.288599+0000","last_undegraded":"2024-03-18T00:26:15.288599+0000","last_fullsized":"2024-03-18T00:26:15.288599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.270481+0000","last_change":"2024-03-18T00:26:14.278609+0000","last_active":"2024-03-18T00:26:15.270481+0000","last_peered":"2024-03-18T00:26:15.270481+0000","last_clean":"2024-03-18T00:26:15.270481+0000","last_became_active":"2024-03-18T00:26:14.278306+0000","last_became_peered":"2024-03-18T00:26:14.278306+0000","last_unstale":"2024-03-18T00:26:15.270481+0000","last_undegraded":"2024-03-18T00:26:15.270481+0000","last_fullsized":"2024-03-18T00:26:15.270481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:06.443531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283084+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:26:15.283084+0000","last_peered":"2024-03-18T00:26:15.283084+0000","last_clean":"2024-03-18T00:26:15.283084+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:26:15.283084+0000","last_undegraded":"2024-03-18T00:26:15.283084+0000","last_fullsized":"2024-03-18T00:26:15.283084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:26:18.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T00:26:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.375+0000 7f763e84d640 1 Processor -- start 2024-03-18T00:26:18.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.375+0000 7f763e84d640 1 -- start start 2024-03-18T00:26:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763e84d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 0x7f763806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763e84d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 0x7f76380cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763e84d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76380b1750 con 0x7f763806f2b0 2024-03-18T00:26:18.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763e84d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f76381629b0 con 0x7f76380d2a00 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763e84d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f7638162ee0 con 0x7f763806fab0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f76377fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f763806f2b0 0x7f76380d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38166/0 (socket says 172.21.15.81:38166) 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f76377fe640 1 -- 172.21.15.81:0/2954372843 learned_addr learned my addr 172.21.15.81:0/2954372843 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f7637fff640 1 --2- 172.21.15.81:0/2954372843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 0x7f763806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.376+0000 7f763cdea640 1 --2- 172.21.15.81:0/2954372843 >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 0x7f76380cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7636ffd640 1 -- 172.21.15.81:0/2954372843 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3751390050 0 0) 0x7f76380b1750 con 0x7f763806f2b0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7636ffd640 1 -- 172.21.15.81:0/2954372843 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7620003520 con 0x7f763806f2b0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7637fff640 1 -- 172.21.15.81:0/2954372843 >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 msgr2=0x7f76380cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7637fff640 1 --2- 172.21.15.81:0/2954372843 >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 0x7f76380cc530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7637fff640 1 -- 172.21.15.81:0/2954372843 >> v1:172.21.15.81:6789/0 conn(0x7f763806f2b0 legacy=0x7f76380d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7637fff640 1 -- 172.21.15.81:0/2954372843 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76380703d0 con 0x7f763806fab0 2024-03-18T00:26:18.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f763cdea640 1 --2- 172.21.15.81:0/2954372843 >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 0x7f76380cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.377+0000 7f7637fff640 1 --2- 172.21.15.81:0/2954372843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 0x7f763806fe90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76280097a0 tx=0x7f762802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f61bda7564e4d3b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f7636ffd640 1 -- 172.21.15.81:0/2954372843 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628035020 con 0x7f763806fab0 2024-03-18T00:26:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f7636ffd640 1 -- 172.21.15.81:0/2954372843 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7628031830 con 0x7f763806fab0 2024-03-18T00:26:18.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f7636ffd640 1 -- 172.21.15.81:0/2954372843 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7628031be0 con 0x7f763806fab0 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 -- 172.21.15.81:0/2954372843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 msgr2=0x7f763806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 --2- 172.21.15.81:0/2954372843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 0x7f763806fe90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f76280097a0 tx=0x7f762802b8d0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 -- 172.21.15.81:0/2954372843 shutdown_connections 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 --2- 172.21.15.81:0/2954372843 >> v2:172.21.15.136:3300/0 conn(0x7f76380d2a00 0x7f76380cc530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 --2- 172.21.15.81:0/2954372843 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f763806fab0 0x7f763806fe90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 -- 172.21.15.81:0/2954372843 >> 172.21.15.81:0/2954372843 conn(0x7f76380d1ee0 msgr2=0x7f76380d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 -- 172.21.15.81:0/2954372843 shutdown_connections 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.378+0000 7f763e84d640 1 -- 172.21.15.81:0/2954372843 wait complete. 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.379+0000 7f763e84d640 1 Processor -- start 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 -- start start 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f763806f2b0 0x7f7638150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76380d2a00 0x7f7638160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7638162c00 con 0x7f763806fab0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f7638161d70 con 0x7f763806f2b0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763e84d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f76380d02e0 con 0x7f76380d2a00 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f76377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f76377fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43384/0 (socket says 172.21.15.81:43384) 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f76377fe640 1 -- 172.21.15.81:0/3404172790 learned_addr learned my addr 172.21.15.81:0/3404172790 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f7637fff640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f763806f2b0 0x7f7638150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.380+0000 7f763cdea640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76380d2a00 0x7f7638160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 -- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76380d2a00 msgr2=0x7f7638160a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76380d2a00 0x7f7638160a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 -- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f763806f2b0 msgr2=0x7f7638150260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f763806f2b0 0x7f7638150260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 -- 172.21.15.81:0/3404172790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f763809d090 con 0x7f763806fab0 2024-03-18T00:26:18.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f76377fe640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c390 tx=0x7f762c00c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c017070 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f762c005ce0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f763809bff0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f762c0072f0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.381+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f763809c5b0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.382+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f763804f5b0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.382+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f762c01a070 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.383+0000 7f7634ff9640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 0x7f762406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.383+0000 7f7637fff640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 0x7f762406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.383+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f762c089ce0 con 0x7f763806fab0 2024-03-18T00:26:18.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.383+0000 7f7637fff640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 0x7f762406e0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7628036000 tx=0x7f762803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.387+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f762c058180 con 0x7f763806fab0 2024-03-18T00:26:18.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.557+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f763806f890 con 0x7f762406bc00 2024-03-18T00:26:18.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.563+0000 7f7634ff9640 1 -- 172.21.15.81:0/3404172790 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251879 (secure 0 0 0) 0x7f763806f890 con 0x7f762406bc00 2024-03-18T00:26:18.566 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:18.567 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T00:26:18.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 msgr2=0x7f762406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 0x7f762406e0c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7628036000 tx=0x7f762803d040 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 msgr2=0x7f7638160540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f762c00c390 tx=0x7f762c00c790 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 shutdown_connections 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f76380d2a00 0x7f7638160a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f762406bc00 0x7f762406e0c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f763806fab0 0x7f7638160540 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 --2- 172.21.15.81:0/3404172790 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f763806f2b0 0x7f7638150260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 >> 172.21.15.81:0/3404172790 conn(0x7f76380d1ee0 msgr2=0x7f76381e9db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 shutdown_connections 2024-03-18T00:26:18.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.566+0000 7f763e84d640 1 -- 172.21.15.81:0/3404172790 wait complete. 2024-03-18T00:26:18.577 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2024-03-18T00:26:17.369548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":48,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220004,"kb_used_data":3820,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754716,"statfs":{"total":773094113280,"available":772868829184,"internally_reserved":0,"allocated":3911680,"data_stored":2214524,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.113430"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286274+0000","last_change":"2024-03-18T00:26:15.282531+0000","last_active":"2024-03-18T00:26:15.286274+0000","last_peered":"2024-03-18T00:26:15.286274+0000","last_clean":"2024-03-18T00:26:15.286274+0000","last_became_active":"2024-03-18T00:26:15.282270+0000","last_became_peered":"2024-03-18T00:26:15.282270+0000","last_unstale":"2024-03-18T00:26:15.286274+0000","last_undegraded":"2024-03-18T00:26:15.286274+0000","last_fullsized":"2024-03-18T00:26:15.286274+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291162+0000","last_change":"2024-03-18T00:26:15.282641+0000","last_active":"2024-03-18T00:26:15.291162+0000","last_peered":"2024-03-18T00:26:15.291162+0000","last_clean":"2024-03-18T00:26:15.291162+0000","last_became_active":"2024-03-18T00:26:15.282216+0000","last_became_peered":"2024-03-18T00:26:15.282216+0000","last_unstale":"2024-03-18T00:26:15.291162+0000","last_undegraded":"2024-03-18T00:26:15.291162+0000","last_fullsized":"2024-03-18T00:26:15.291162+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286844+0000","last_change":"2024-03-18T00:26:15.281656+0000","last_active":"2024-03-18T00:26:15.286844+0000","last_peered":"2024-03-18T00:26:15.286844+0000","last_clean":"2024-03-18T00:26:15.286844+0000","last_became_active":"2024-03-18T00:26:15.281354+0000","last_became_peered":"2024-03-18T00:26:15.281354+0000","last_unstale":"2024-03-18T00:26:15.286844+0000","last_undegraded":"2024-03-18T00:26:15.286844+0000","last_fullsized":"2024-03-18T00:26:15.286844+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290960+0000","last_change":"2024-03-18T00:26:15.286105+0000","last_active":"2024-03-18T00:26:15.290960+0000","last_peered":"2024-03-18T00:26:15.290960+0000","last_clean":"2024-03-18T00:26:15.290960+0000","last_became_active":"2024-03-18T00:26:15.285335+0000","last_became_peered":"2024-03-18T00:26:15.285335+0000","last_unstale":"2024-03-18T00:26:15.290960+0000","last_undegraded":"2024-03-18T00:26:15.290960+0000","last_fullsized":"2024-03-18T00:26:15.290960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291372+0000","last_change":"2024-03-18T00:26:15.284698+0000","last_active":"2024-03-18T00:26:15.291372+0000","last_peered":"2024-03-18T00:26:15.291372+0000","last_clean":"2024-03-18T00:26:15.291372+0000","last_became_active":"2024-03-18T00:26:15.284366+0000","last_became_peered":"2024-03-18T00:26:15.284366+0000","last_unstale":"2024-03-18T00:26:15.291372+0000","last_undegraded":"2024-03-18T00:26:15.291372+0000","last_fullsized":"2024-03-18T00:26:15.291372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:07.445520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283124+0000","last_change":"2024-03-18T00:26:15.279759+0000","last_active":"2024-03-18T00:26:15.283124+0000","last_peered":"2024-03-18T00:26:15.283124+0000","last_clean":"2024-03-18T00:26:15.283124+0000","last_became_active":"2024-03-18T00:26:15.279453+0000","last_became_peered":"2024-03-18T00:26:15.279453+0000","last_unstale":"2024-03-18T00:26:15.283124+0000","last_undegraded":"2024-03-18T00:26:15.283124+0000","last_fullsized":"2024-03-18T00:26:15.283124+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291792+0000","last_change":"2024-03-18T00:26:15.288669+0000","last_active":"2024-03-18T00:26:15.291792+0000","last_peered":"2024-03-18T00:26:15.291792+0000","last_clean":"2024-03-18T00:26:15.291792+0000","last_became_active":"2024-03-18T00:26:15.288404+0000","last_became_peered":"2024-03-18T00:26:15.288404+0000","last_unstale":"2024-03-18T00:26:15.291792+0000","last_undegraded":"2024-03-18T00:26:15.291792+0000","last_fullsized":"2024-03-18T00:26:15.291792+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296429+0000","last_change":"2024-03-18T00:26:15.294531+0000","last_active":"2024-03-18T00:26:15.296429+0000","last_peered":"2024-03-18T00:26:15.296429+0000","last_clean":"2024-03-18T00:26:15.296429+0000","last_became_active":"2024-03-18T00:26:15.294204+0000","last_became_peered":"2024-03-18T00:26:15.294204+0000","last_unstale":"2024-03-18T00:26:15.296429+0000","last_undegraded":"2024-03-18T00:26:15.296429+0000","last_fullsized":"2024-03-18T00:26:15.296429+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286025+0000","last_change":"2024-03-18T00:26:15.282469+0000","last_active":"2024-03-18T00:26:15.286025+0000","last_peered":"2024-03-18T00:26:15.286025+0000","last_clean":"2024-03-18T00:26:15.286025+0000","last_became_active":"2024-03-18T00:26:15.282199+0000","last_became_peered":"2024-03-18T00:26:15.282199+0000","last_unstale":"2024-03-18T00:26:15.286025+0000","last_undegraded":"2024-03-18T00:26:15.286025+0000","last_fullsized":"2024-03-18T00:26:15.286025+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290399+0000","last_change":"2024-03-18T00:26:15.287932+0000","last_active":"2024-03-18T00:26:15.290399+0000","last_peered":"2024-03-18T00:26:15.290399+0000","last_clean":"2024-03-18T00:26:15.290399+0000","last_became_active":"2024-03-18T00:26:15.287660+0000","last_became_peered":"2024-03-18T00:26:15.287660+0000","last_unstale":"2024-03-18T00:26:15.290399+0000","last_undegraded":"2024-03-18T00:26:15.290399+0000","last_fullsized":"2024-03-18T00:26:15.290399+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.292899+0000","last_change":"2024-03-18T00:26:15.290621+0000","last_active":"2024-03-18T00:26:15.292899+0000","last_peered":"2024-03-18T00:26:15.292899+0000","last_clean":"2024-03-18T00:26:15.292899+0000","last_became_active":"2024-03-18T00:26:15.290340+0000","last_became_peered":"2024-03-18T00:26:15.290340+0000","last_unstale":"2024-03-18T00:26:15.292899+0000","last_undegraded":"2024-03-18T00:26:15.292899+0000","last_fullsized":"2024-03-18T00:26:15.292899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:53.741084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290121+0000","last_change":"2024-03-18T00:26:15.287786+0000","last_active":"2024-03-18T00:26:15.290121+0000","last_peered":"2024-03-18T00:26:15.290121+0000","last_clean":"2024-03-18T00:26:15.290121+0000","last_became_active":"2024-03-18T00:26:15.284201+0000","last_became_peered":"2024-03-18T00:26:15.284201+0000","last_unstale":"2024-03-18T00:26:15.290121+0000","last_undegraded":"2024-03-18T00:26:15.290121+0000","last_fullsized":"2024-03-18T00:26:15.290121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283931+0000","last_change":"2024-03-18T00:26:15.281613+0000","last_active":"2024-03-18T00:26:15.283931+0000","last_peered":"2024-03-18T00:26:15.283931+0000","last_clean":"2024-03-18T00:26:15.283931+0000","last_became_active":"2024-03-18T00:26:15.280494+0000","last_became_peered":"2024-03-18T00:26:15.280494+0000","last_unstale":"2024-03-18T00:26:15.283931+0000","last_undegraded":"2024-03-18T00:26:15.283931+0000","last_fullsized":"2024-03-18T00:26:15.283931+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:35:24.478753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294226+0000","last_change":"2024-03-18T00:26:15.282934+0000","last_active":"2024-03-18T00:26:15.294226+0000","last_peered":"2024-03-18T00:26:15.294226+0000","last_clean":"2024-03-18T00:26:15.294226+0000","last_became_active":"2024-03-18T00:26:15.282200+0000","last_became_peered":"2024-03-18T00:26:15.282200+0000","last_unstale":"2024-03-18T00:26:15.294226+0000","last_undegraded":"2024-03-18T00:26:15.294226+0000","last_fullsized":"2024-03-18T00:26:15.294226+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289285+0000","last_change":"2024-03-18T00:26:15.283375+0000","last_active":"2024-03-18T00:26:15.289285+0000","last_peered":"2024-03-18T00:26:15.289285+0000","last_clean":"2024-03-18T00:26:15.289285+0000","last_became_active":"2024-03-18T00:26:15.283069+0000","last_became_peered":"2024-03-18T00:26:15.283069+0000","last_unstale":"2024-03-18T00:26:15.289285+0000","last_undegraded":"2024-03-18T00:26:15.289285+0000","last_fullsized":"2024-03-18T00:26:15.289285+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296757+0000","last_change":"2024-03-18T00:26:15.296106+0000","last_active":"2024-03-18T00:26:15.296757+0000","last_peered":"2024-03-18T00:26:15.296757+0000","last_clean":"2024-03-18T00:26:15.296757+0000","last_became_active":"2024-03-18T00:26:15.295772+0000","last_became_peered":"2024-03-18T00:26:15.295772+0000","last_unstale":"2024-03-18T00:26:15.296757+0000","last_undegraded":"2024-03-18T00:26:15.296757+0000","last_fullsized":"2024-03-18T00:26:15.296757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293435+0000","last_change":"2024-03-18T00:26:15.291914+0000","last_active":"2024-03-18T00:26:15.293435+0000","last_peered":"2024-03-18T00:26:15.293435+0000","last_clean":"2024-03-18T00:26:15.293435+0000","last_became_active":"2024-03-18T00:26:15.291650+0000","last_became_peered":"2024-03-18T00:26:15.291650+0000","last_unstale":"2024-03-18T00:26:15.293435+0000","last_undegraded":"2024-03-18T00:26:15.293435+0000","last_fullsized":"2024-03-18T00:26:15.293435+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:44:10.086085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294990+0000","last_change":"2024-03-18T00:26:15.287136+0000","last_active":"2024-03-18T00:26:15.294990+0000","last_peered":"2024-03-18T00:26:15.294990+0000","last_clean":"2024-03-18T00:26:15.294990+0000","last_became_active":"2024-03-18T00:26:15.286880+0000","last_became_peered":"2024-03-18T00:26:15.286880+0000","last_unstale":"2024-03-18T00:26:15.294990+0000","last_undegraded":"2024-03-18T00:26:15.294990+0000","last_fullsized":"2024-03-18T00:26:15.294990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:58:29.320724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295079+0000","last_change":"2024-03-18T00:26:15.288183+0000","last_active":"2024-03-18T00:26:15.295079+0000","last_peered":"2024-03-18T00:26:15.295079+0000","last_clean":"2024-03-18T00:26:15.295079+0000","last_became_active":"2024-03-18T00:26:15.287880+0000","last_became_peered":"2024-03-18T00:26:15.287880+0000","last_unstale":"2024-03-18T00:26:15.295079+0000","last_undegraded":"2024-03-18T00:26:15.295079+0000","last_fullsized":"2024-03-18T00:26:15.295079+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:28:57.292386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283968+0000","last_change":"2024-03-18T00:26:15.282193+0000","last_active":"2024-03-18T00:26:15.283968+0000","last_peered":"2024-03-18T00:26:15.283968+0000","last_clean":"2024-03-18T00:26:15.283968+0000","last_became_active":"2024-03-18T00:26:15.281885+0000","last_became_peered":"2024-03-18T00:26:15.281885+0000","last_unstale":"2024-03-18T00:26:15.283968+0000","last_undegraded":"2024-03-18T00:26:15.283968+0000","last_fullsized":"2024-03-18T00:26:15.283968+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:14:07.515832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281766+0000","last_change":"2024-03-18T00:26:15.274175+0000","last_active":"2024-03-18T00:26:15.281766+0000","last_peered":"2024-03-18T00:26:15.281766+0000","last_clean":"2024-03-18T00:26:15.281766+0000","last_became_active":"2024-03-18T00:26:15.273817+0000","last_became_peered":"2024-03-18T00:26:15.273817+0000","last_unstale":"2024-03-18T00:26:15.281766+0000","last_undegraded":"2024-03-18T00:26:15.281766+0000","last_fullsized":"2024-03-18T00:26:15.281766+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285238+0000","last_change":"2024-03-18T00:26:15.279958+0000","last_active":"2024-03-18T00:26:15.285238+0000","last_peered":"2024-03-18T00:26:15.285238+0000","last_clean":"2024-03-18T00:26:15.285238+0000","last_became_active":"2024-03-18T00:26:15.279622+0000","last_became_peered":"2024-03-18T00:26:15.279622+0000","last_unstale":"2024-03-18T00:26:15.285238+0000","last_undegraded":"2024-03-18T00:26:15.285238+0000","last_fullsized":"2024-03-18T00:26:15.285238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290710+0000","last_change":"2024-03-18T00:26:15.288936+0000","last_active":"2024-03-18T00:26:15.290710+0000","last_peered":"2024-03-18T00:26:15.290710+0000","last_clean":"2024-03-18T00:26:15.290710+0000","last_became_active":"2024-03-18T00:26:15.288651+0000","last_became_peered":"2024-03-18T00:26:15.288651+0000","last_unstale":"2024-03-18T00:26:15.290710+0000","last_undegraded":"2024-03-18T00:26:15.290710+0000","last_fullsized":"2024-03-18T00:26:15.290710+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.282566+0000","last_change":"2024-03-18T00:26:15.277573+0000","last_active":"2024-03-18T00:26:15.282566+0000","last_peered":"2024-03-18T00:26:15.282566+0000","last_clean":"2024-03-18T00:26:15.282566+0000","last_became_active":"2024-03-18T00:26:15.277269+0000","last_became_peered":"2024-03-18T00:26:15.277269+0000","last_unstale":"2024-03-18T00:26:15.282566+0000","last_undegraded":"2024-03-18T00:26:15.282566+0000","last_fullsized":"2024-03-18T00:26:15.282566+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296163+0000","last_change":"2024-03-18T00:26:15.291581+0000","last_active":"2024-03-18T00:26:15.296163+0000","last_peered":"2024-03-18T00:26:15.296163+0000","last_clean":"2024-03-18T00:26:15.296163+0000","last_became_active":"2024-03-18T00:26:15.291314+0000","last_became_peered":"2024-03-18T00:26:15.291314+0000","last_unstale":"2024-03-18T00:26:15.296163+0000","last_undegraded":"2024-03-18T00:26:15.296163+0000","last_fullsized":"2024-03-18T00:26:15.296163+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295415+0000","last_change":"2024-03-18T00:26:15.288757+0000","last_active":"2024-03-18T00:26:15.295415+0000","last_peered":"2024-03-18T00:26:15.295415+0000","last_clean":"2024-03-18T00:26:15.295415+0000","last_became_active":"2024-03-18T00:26:15.288455+0000","last_became_peered":"2024-03-18T00:26:15.288455+0000","last_unstale":"2024-03-18T00:26:15.295415+0000","last_undegraded":"2024-03-18T00:26:15.295415+0000","last_fullsized":"2024-03-18T00:26:15.295415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:03:11.364105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289413+0000","last_change":"2024-03-18T00:26:15.284127+0000","last_active":"2024-03-18T00:26:15.289413+0000","last_peered":"2024-03-18T00:26:15.289413+0000","last_clean":"2024-03-18T00:26:15.289413+0000","last_became_active":"2024-03-18T00:26:15.283874+0000","last_became_peered":"2024-03-18T00:26:15.283874+0000","last_unstale":"2024-03-18T00:26:15.289413+0000","last_undegraded":"2024-03-18T00:26:15.289413+0000","last_fullsized":"2024-03-18T00:26:15.289413+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.287994+0000","last_change":"2024-03-18T00:26:15.281413+0000","last_active":"2024-03-18T00:26:15.287994+0000","last_peered":"2024-03-18T00:26:15.287994+0000","last_clean":"2024-03-18T00:26:15.287994+0000","last_became_active":"2024-03-18T00:26:15.281079+0000","last_became_peered":"2024-03-18T00:26:15.281079+0000","last_unstale":"2024-03-18T00:26:15.287994+0000","last_undegraded":"2024-03-18T00:26:15.287994+0000","last_fullsized":"2024-03-18T00:26:15.287994+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:53.741084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288090+0000","last_change":"2024-03-18T00:26:15.285892+0000","last_active":"2024-03-18T00:26:15.288090+0000","last_peered":"2024-03-18T00:26:15.288090+0000","last_clean":"2024-03-18T00:26:15.288090+0000","last_became_active":"2024-03-18T00:26:15.285622+0000","last_became_peered":"2024-03-18T00:26:15.285622+0000","last_unstale":"2024-03-18T00:26:15.288090+0000","last_undegraded":"2024-03-18T00:26:15.288090+0000","last_fullsized":"2024-03-18T00:26:15.288090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:08.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291884+0000","last_change":"2024-03-18T00:26:15.289251+0000","last_active":"2024-03-18T00:26:15.291884+0000","last_peered":"2024-03-18T00:26:15.291884+0000","last_clean":"2024-03-18T00:26:15.291884+0000","last_became_active":"2024-03-18T00:26:15.288967+0000","last_became_peered":"2024-03-18T00:26:15.288967+0000","last_unstale":"2024-03-18T00:26:15.291884+0000","last_undegraded":"2024-03-18T00:26:15.291884+0000","last_fullsized":"2024-03-18T00:26:15.291884+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.280255+0000","last_change":"2024-03-18T00:26:15.278470+0000","last_active":"2024-03-18T00:26:15.280255+0000","last_peered":"2024-03-18T00:26:15.280255+0000","last_clean":"2024-03-18T00:26:15.280255+0000","last_became_active":"2024-03-18T00:26:15.278179+0000","last_became_peered":"2024-03-18T00:26:15.278179+0000","last_unstale":"2024-03-18T00:26:15.280255+0000","last_undegraded":"2024-03-18T00:26:15.280255+0000","last_fullsized":"2024-03-18T00:26:15.280255+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:58.710352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296094+0000","last_change":"2024-03-18T00:26:15.293905+0000","last_active":"2024-03-18T00:26:15.296094+0000","last_peered":"2024-03-18T00:26:15.296094+0000","last_clean":"2024-03-18T00:26:15.296094+0000","last_became_active":"2024-03-18T00:26:15.293613+0000","last_became_peered":"2024-03-18T00:26:15.293613+0000","last_unstale":"2024-03-18T00:26:15.296094+0000","last_undegraded":"2024-03-18T00:26:15.296094+0000","last_fullsized":"2024-03-18T00:26:15.296094+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:52:52.386226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.291714+0000","last_change":"2024-03-18T00:26:15.289634+0000","last_active":"2024-03-18T00:26:15.291714+0000","last_peered":"2024-03-18T00:26:15.291714+0000","last_clean":"2024-03-18T00:26:15.291714+0000","last_became_active":"2024-03-18T00:26:15.289378+0000","last_became_peered":"2024-03-18T00:26:15.289378+0000","last_unstale":"2024-03-18T00:26:15.291714+0000","last_undegraded":"2024-03-18T00:26:15.291714+0000","last_fullsized":"2024-03-18T00:26:15.291714+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293221+0000","last_change":"2024-03-18T00:26:14.275427+0000","last_active":"2024-03-18T00:26:15.293221+0000","last_peered":"2024-03-18T00:26:15.293221+0000","last_clean":"2024-03-18T00:26:15.293221+0000","last_became_active":"2024-03-18T00:26:14.275140+0000","last_became_peered":"2024-03-18T00:26:14.275140+0000","last_unstale":"2024-03-18T00:26:15.293221+0000","last_undegraded":"2024-03-18T00:26:15.293221+0000","last_fullsized":"2024-03-18T00:26:15.293221+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284394+0000","last_change":"2024-03-18T00:26:15.279637+0000","last_active":"2024-03-18T00:26:15.284394+0000","last_peered":"2024-03-18T00:26:15.284394+0000","last_clean":"2024-03-18T00:26:15.284394+0000","last_became_active":"2024-03-18T00:26:15.279276+0000","last_became_peered":"2024-03-18T00:26:15.279276+0000","last_unstale":"2024-03-18T00:26:15.284394+0000","last_undegraded":"2024-03-18T00:26:15.284394+0000","last_fullsized":"2024-03-18T00:26:15.284394+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:35.959368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290239+0000","last_change":"2024-03-18T00:26:14.277732+0000","last_active":"2024-03-18T00:26:15.290239+0000","last_peered":"2024-03-18T00:26:15.290239+0000","last_clean":"2024-03-18T00:26:15.290239+0000","last_became_active":"2024-03-18T00:26:14.277455+0000","last_became_peered":"2024-03-18T00:26:14.277455+0000","last_unstale":"2024-03-18T00:26:15.290239+0000","last_undegraded":"2024-03-18T00:26:15.290239+0000","last_fullsized":"2024-03-18T00:26:15.290239+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288164+0000","last_change":"2024-03-18T00:26:15.285898+0000","last_active":"2024-03-18T00:26:15.288164+0000","last_peered":"2024-03-18T00:26:15.288164+0000","last_clean":"2024-03-18T00:26:15.288164+0000","last_became_active":"2024-03-18T00:26:15.285590+0000","last_became_peered":"2024-03-18T00:26:15.285590+0000","last_unstale":"2024-03-18T00:26:15.288164+0000","last_undegraded":"2024-03-18T00:26:15.288164+0000","last_fullsized":"2024-03-18T00:26:15.288164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295607+0000","last_change":"2024-03-18T00:26:14.282192+0000","last_active":"2024-03-18T00:26:15.295607+0000","last_peered":"2024-03-18T00:26:15.295607+0000","last_clean":"2024-03-18T00:26:15.295607+0000","last_became_active":"2024-03-18T00:26:14.281914+0000","last_became_peered":"2024-03-18T00:26:14.281914+0000","last_unstale":"2024-03-18T00:26:15.295607+0000","last_undegraded":"2024-03-18T00:26:15.295607+0000","last_fullsized":"2024-03-18T00:26:15.295607+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:44.182694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288201+0000","last_change":"2024-03-18T00:26:15.284127+0000","last_active":"2024-03-18T00:26:15.288201+0000","last_peered":"2024-03-18T00:26:15.288201+0000","last_clean":"2024-03-18T00:26:15.288201+0000","last_became_active":"2024-03-18T00:26:15.283835+0000","last_became_peered":"2024-03-18T00:26:15.283835+0000","last_unstale":"2024-03-18T00:26:15.288201+0000","last_undegraded":"2024-03-18T00:26:15.288201+0000","last_fullsized":"2024-03-18T00:26:15.288201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:41.011753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301980+0000","last_change":"2024-03-18T00:26:14.281066+0000","last_active":"2024-03-18T00:26:15.301980+0000","last_peered":"2024-03-18T00:26:15.301980+0000","last_clean":"2024-03-18T00:26:15.301980+0000","last_became_active":"2024-03-18T00:26:14.280804+0000","last_became_peered":"2024-03-18T00:26:14.280804+0000","last_unstale":"2024-03-18T00:26:15.301980+0000","last_undegraded":"2024-03-18T00:26:15.301980+0000","last_fullsized":"2024-03-18T00:26:15.301980+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:35:30.904141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294540+0000","last_change":"2024-03-18T00:26:15.292301+0000","last_active":"2024-03-18T00:26:15.294540+0000","last_peered":"2024-03-18T00:26:15.294540+0000","last_clean":"2024-03-18T00:26:15.294540+0000","last_became_active":"2024-03-18T00:26:15.292043+0000","last_became_peered":"2024-03-18T00:26:15.292043+0000","last_unstale":"2024-03-18T00:26:15.294540+0000","last_undegraded":"2024-03-18T00:26:15.294540+0000","last_fullsized":"2024-03-18T00:26:15.294540+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296015+0000","last_change":"2024-03-18T00:26:14.277664+0000","last_active":"2024-03-18T00:26:15.296015+0000","last_peered":"2024-03-18T00:26:15.296015+0000","last_clean":"2024-03-18T00:26:15.296015+0000","last_became_active":"2024-03-18T00:26:14.276483+0000","last_became_peered":"2024-03-18T00:26:14.276483+0000","last_unstale":"2024-03-18T00:26:15.296015+0000","last_undegraded":"2024-03-18T00:26:15.296015+0000","last_fullsized":"2024-03-18T00:26:15.296015+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:06.443531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281254+0000","last_change":"2024-03-18T00:26:15.275239+0000","last_active":"2024-03-18T00:26:15.281254+0000","last_peered":"2024-03-18T00:26:15.281254+0000","last_clean":"2024-03-18T00:26:15.281254+0000","last_became_active":"2024-03-18T00:26:15.274920+0000","last_became_peered":"2024-03-18T00:26:15.274920+0000","last_unstale":"2024-03-18T00:26:15.281254+0000","last_undegraded":"2024-03-18T00:26:15.281254+0000","last_fullsized":"2024-03-18T00:26:15.281254+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295972+0000","last_change":"2024-03-18T00:26:14.276055+0000","last_active":"2024-03-18T00:26:15.295972+0000","last_peered":"2024-03-18T00:26:15.295972+0000","last_clean":"2024-03-18T00:26:15.295972+0000","last_became_active":"2024-03-18T00:26:14.275359+0000","last_became_peered":"2024-03-18T00:26:14.275359+0000","last_unstale":"2024-03-18T00:26:15.295972+0000","last_undegraded":"2024-03-18T00:26:15.295972+0000","last_fullsized":"2024-03-18T00:26:15.295972+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.286220+0000","last_change":"2024-03-18T00:26:15.280410+0000","last_active":"2024-03-18T00:26:15.286220+0000","last_peered":"2024-03-18T00:26:15.286220+0000","last_clean":"2024-03-18T00:26:15.286220+0000","last_became_active":"2024-03-18T00:26:15.280089+0000","last_became_peered":"2024-03-18T00:26:15.280089+0000","last_unstale":"2024-03-18T00:26:15.286220+0000","last_undegraded":"2024-03-18T00:26:15.286220+0000","last_fullsized":"2024-03-18T00:26:15.286220+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277758+0000","last_change":"2024-03-18T00:26:14.273527+0000","last_active":"2024-03-18T00:26:15.277758+0000","last_peered":"2024-03-18T00:26:15.277758+0000","last_clean":"2024-03-18T00:26:15.277758+0000","last_became_active":"2024-03-18T00:26:14.273224+0000","last_became_peered":"2024-03-18T00:26:14.273224+0000","last_unstale":"2024-03-18T00:26:15.277758+0000","last_undegraded":"2024-03-18T00:26:15.277758+0000","last_fullsized":"2024-03-18T00:26:15.277758+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:12:52.739096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285097+0000","last_change":"2024-03-18T00:26:15.280061+0000","last_active":"2024-03-18T00:26:15.285097+0000","last_peered":"2024-03-18T00:26:15.285097+0000","last_clean":"2024-03-18T00:26:15.285097+0000","last_became_active":"2024-03-18T00:26:15.279762+0000","last_became_peered":"2024-03-18T00:26:15.279762+0000","last_unstale":"2024-03-18T00:26:15.285097+0000","last_undegraded":"2024-03-18T00:26:15.285097+0000","last_fullsized":"2024-03-18T00:26:15.285097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267062+0000","last_change":"2024-03-18T00:26:14.273737+0000","last_active":"2024-03-18T00:26:15.267062+0000","last_peered":"2024-03-18T00:26:15.267062+0000","last_clean":"2024-03-18T00:26:15.267062+0000","last_became_active":"2024-03-18T00:26:14.273314+0000","last_became_peered":"2024-03-18T00:26:14.273314+0000","last_unstale":"2024-03-18T00:26:15.267062+0000","last_undegraded":"2024-03-18T00:26:15.267062+0000","last_fullsized":"2024-03-18T00:26:15.267062+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T12:14:06.513843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290155+0000","last_change":"2024-03-18T00:26:15.284821+0000","last_active":"2024-03-18T00:26:15.290155+0000","last_peered":"2024-03-18T00:26:15.290155+0000","last_clean":"2024-03-18T00:26:15.290155+0000","last_became_active":"2024-03-18T00:26:15.284524+0000","last_became_peered":"2024-03-18T00:26:15.284524+0000","last_unstale":"2024-03-18T00:26:15.290155+0000","last_undegraded":"2024-03-18T00:26:15.290155+0000","last_fullsized":"2024-03-18T00:26:15.290155+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277497+0000","last_change":"2024-03-18T00:26:14.277503+0000","last_active":"2024-03-18T00:26:15.277497+0000","last_peered":"2024-03-18T00:26:15.277497+0000","last_clean":"2024-03-18T00:26:15.277497+0000","last_became_active":"2024-03-18T00:26:14.277233+0000","last_became_peered":"2024-03-18T00:26:14.277233+0000","last_unstale":"2024-03-18T00:26:15.277497+0000","last_undegraded":"2024-03-18T00:26:15.277497+0000","last_fullsized":"2024-03-18T00:26:15.277497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:18.865373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295785+0000","last_change":"2024-03-18T00:26:15.289086+0000","last_active":"2024-03-18T00:26:15.295785+0000","last_peered":"2024-03-18T00:26:15.295785+0000","last_clean":"2024-03-18T00:26:15.295785+0000","last_became_active":"2024-03-18T00:26:15.288080+0000","last_became_peered":"2024-03-18T00:26:15.288080+0000","last_unstale":"2024-03-18T00:26:15.295785+0000","last_undegraded":"2024-03-18T00:26:15.295785+0000","last_fullsized":"2024-03-18T00:26:15.295785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:43:12.498053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268109+0000","last_change":"2024-03-18T00:26:14.277049+0000","last_active":"2024-03-18T00:26:15.268109+0000","last_peered":"2024-03-18T00:26:15.268109+0000","last_clean":"2024-03-18T00:26:15.268109+0000","last_became_active":"2024-03-18T00:26:14.276757+0000","last_became_peered":"2024-03-18T00:26:14.276757+0000","last_unstale":"2024-03-18T00:26:15.268109+0000","last_undegraded":"2024-03-18T00:26:15.268109+0000","last_fullsized":"2024-03-18T00:26:15.268109+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.295428+0000","last_change":"2024-03-18T00:26:15.288796+0000","last_active":"2024-03-18T00:26:15.295428+0000","last_peered":"2024-03-18T00:26:15.295428+0000","last_clean":"2024-03-18T00:26:15.295428+0000","last_became_active":"2024-03-18T00:26:15.288489+0000","last_became_peered":"2024-03-18T00:26:15.288489+0000","last_unstale":"2024-03-18T00:26:15.295428+0000","last_undegraded":"2024-03-18T00:26:15.295428+0000","last_fullsized":"2024-03-18T00:26:15.295428+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:07:46.970888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290400+0000","last_change":"2024-03-18T00:26:14.275623+0000","last_active":"2024-03-18T00:26:15.290400+0000","last_peered":"2024-03-18T00:26:15.290400+0000","last_clean":"2024-03-18T00:26:15.290400+0000","last_became_active":"2024-03-18T00:26:14.275325+0000","last_became_peered":"2024-03-18T00:26:14.275325+0000","last_unstale":"2024-03-18T00:26:15.290400+0000","last_undegraded":"2024-03-18T00:26:15.290400+0000","last_fullsized":"2024-03-18T00:26:15.290400+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:56.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290346+0000","last_change":"2024-03-18T00:26:15.286692+0000","last_active":"2024-03-18T00:26:15.290346+0000","last_peered":"2024-03-18T00:26:15.290346+0000","last_clean":"2024-03-18T00:26:15.290346+0000","last_became_active":"2024-03-18T00:26:15.286442+0000","last_became_peered":"2024-03-18T00:26:15.286442+0000","last_unstale":"2024-03-18T00:26:15.290346+0000","last_undegraded":"2024-03-18T00:26:15.290346+0000","last_fullsized":"2024-03-18T00:26:15.290346+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.303918+0000","last_change":"2024-03-18T00:26:14.282024+0000","last_active":"2024-03-18T00:26:15.303918+0000","last_peered":"2024-03-18T00:26:15.303918+0000","last_clean":"2024-03-18T00:26:15.303918+0000","last_became_active":"2024-03-18T00:26:14.281656+0000","last_became_peered":"2024-03-18T00:26:14.281656+0000","last_unstale":"2024-03-18T00:26:15.303918+0000","last_undegraded":"2024-03-18T00:26:15.303918+0000","last_fullsized":"2024-03-18T00:26:15.303918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:40.009764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283948+0000","last_change":"2024-03-18T00:26:15.280492+0000","last_active":"2024-03-18T00:26:15.283948+0000","last_peered":"2024-03-18T00:26:15.283948+0000","last_clean":"2024-03-18T00:26:15.283948+0000","last_became_active":"2024-03-18T00:26:15.279970+0000","last_became_peered":"2024-03-18T00:26:15.279970+0000","last_unstale":"2024-03-18T00:26:15.283948+0000","last_undegraded":"2024-03-18T00:26:15.283948+0000","last_fullsized":"2024-03-18T00:26:15.283948+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294952+0000","last_change":"2024-03-18T00:26:14.276116+0000","last_active":"2024-03-18T00:26:15.294952+0000","last_peered":"2024-03-18T00:26:15.294952+0000","last_clean":"2024-03-18T00:26:15.294952+0000","last_became_active":"2024-03-18T00:26:14.275831+0000","last_became_peered":"2024-03-18T00:26:14.275831+0000","last_unstale":"2024-03-18T00:26:15.294952+0000","last_undegraded":"2024-03-18T00:26:15.294952+0000","last_fullsized":"2024-03-18T00:26:15.294952+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.294943+0000","last_change":"2024-03-18T00:26:15.283157+0000","last_active":"2024-03-18T00:26:15.294943+0000","last_peered":"2024-03-18T00:26:15.294943+0000","last_clean":"2024-03-18T00:26:15.294943+0000","last_became_active":"2024-03-18T00:26:15.282426+0000","last_became_peered":"2024-03-18T00:26:15.282426+0000","last_unstale":"2024-03-18T00:26:15.294943+0000","last_undegraded":"2024-03-18T00:26:15.294943+0000","last_fullsized":"2024-03-18T00:26:15.294943+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:18:10.301897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.269290+0000","last_change":"2024-03-18T00:26:14.284375+0000","last_active":"2024-03-18T00:26:15.269290+0000","last_peered":"2024-03-18T00:26:15.269290+0000","last_clean":"2024-03-18T00:26:15.269290+0000","last_became_active":"2024-03-18T00:26:14.284163+0000","last_became_peered":"2024-03-18T00:26:14.284163+0000","last_unstale":"2024-03-18T00:26:15.269290+0000","last_undegraded":"2024-03-18T00:26:15.269290+0000","last_fullsized":"2024-03-18T00:26:15.269290+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:22:57.708364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296409+0000","last_change":"2024-03-18T00:26:15.294228+0000","last_active":"2024-03-18T00:26:15.296409+0000","last_peered":"2024-03-18T00:26:15.296409+0000","last_clean":"2024-03-18T00:26:15.296409+0000","last_became_active":"2024-03-18T00:26:15.293959+0000","last_became_peered":"2024-03-18T00:26:15.293959+0000","last_unstale":"2024-03-18T00:26:15.296409+0000","last_undegraded":"2024-03-18T00:26:15.296409+0000","last_fullsized":"2024-03-18T00:26:15.296409+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:39:31.795807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277623+0000","last_change":"2024-03-18T00:26:14.276817+0000","last_active":"2024-03-18T00:26:15.277623+0000","last_peered":"2024-03-18T00:26:15.277623+0000","last_clean":"2024-03-18T00:26:15.277623+0000","last_became_active":"2024-03-18T00:26:14.276511+0000","last_became_peered":"2024-03-18T00:26:14.276511+0000","last_unstale":"2024-03-18T00:26:15.277623+0000","last_undegraded":"2024-03-18T00:26:15.277623+0000","last_fullsized":"2024-03-18T00:26:15.277623+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:39.772951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284398+0000","last_change":"2024-03-18T00:26:15.279560+0000","last_active":"2024-03-18T00:26:15.284398+0000","last_peered":"2024-03-18T00:26:15.284398+0000","last_clean":"2024-03-18T00:26:15.284398+0000","last_became_active":"2024-03-18T00:26:15.279206+0000","last_became_peered":"2024-03-18T00:26:15.279206+0000","last_unstale":"2024-03-18T00:26:15.284398+0000","last_undegraded":"2024-03-18T00:26:15.284398+0000","last_fullsized":"2024-03-18T00:26:15.284398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:44.936528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.302168+0000","last_change":"2024-03-18T00:26:14.281263+0000","last_active":"2024-03-18T00:26:15.302168+0000","last_peered":"2024-03-18T00:26:15.302168+0000","last_clean":"2024-03-18T00:26:15.302168+0000","last_became_active":"2024-03-18T00:26:14.280970+0000","last_became_peered":"2024-03-18T00:26:14.280970+0000","last_unstale":"2024-03-18T00:26:15.302168+0000","last_undegraded":"2024-03-18T00:26:15.302168+0000","last_fullsized":"2024-03-18T00:26:15.302168+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:49:07.065858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284899+0000","last_change":"2024-03-18T00:26:15.278905+0000","last_active":"2024-03-18T00:26:15.284899+0000","last_peered":"2024-03-18T00:26:15.284899+0000","last_clean":"2024-03-18T00:26:15.284899+0000","last_became_active":"2024-03-18T00:26:15.278586+0000","last_became_peered":"2024-03-18T00:26:15.278586+0000","last_unstale":"2024-03-18T00:26:15.284899+0000","last_undegraded":"2024-03-18T00:26:15.284899+0000","last_fullsized":"2024-03-18T00:26:15.284899+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301741+0000","last_change":"2024-03-18T00:26:14.280313+0000","last_active":"2024-03-18T00:26:15.301741+0000","last_peered":"2024-03-18T00:26:15.301741+0000","last_clean":"2024-03-18T00:26:15.301741+0000","last_became_active":"2024-03-18T00:26:14.280016+0000","last_became_peered":"2024-03-18T00:26:14.280016+0000","last_unstale":"2024-03-18T00:26:15.301741+0000","last_undegraded":"2024-03-18T00:26:15.301741+0000","last_fullsized":"2024-03-18T00:26:15.301741+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285085+0000","last_change":"2024-03-18T00:26:15.280436+0000","last_active":"2024-03-18T00:26:15.285085+0000","last_peered":"2024-03-18T00:26:15.285085+0000","last_clean":"2024-03-18T00:26:15.285085+0000","last_became_active":"2024-03-18T00:26:15.280168+0000","last_became_peered":"2024-03-18T00:26:15.280168+0000","last_unstale":"2024-03-18T00:26:15.285085+0000","last_undegraded":"2024-03-18T00:26:15.285085+0000","last_fullsized":"2024-03-18T00:26:15.285085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:08:40.774940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293751+0000","last_change":"2024-03-18T00:26:14.275535+0000","last_active":"2024-03-18T00:26:15.293751+0000","last_peered":"2024-03-18T00:26:15.293751+0000","last_clean":"2024-03-18T00:26:15.293751+0000","last_became_active":"2024-03-18T00:26:14.275213+0000","last_became_peered":"2024-03-18T00:26:14.275213+0000","last_unstale":"2024-03-18T00:26:15.293751+0000","last_undegraded":"2024-03-18T00:26:15.293751+0000","last_fullsized":"2024-03-18T00:26:15.293751+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285719+0000","last_change":"2024-03-18T00:26:15.283002+0000","last_active":"2024-03-18T00:26:15.285719+0000","last_peered":"2024-03-18T00:26:15.285719+0000","last_clean":"2024-03-18T00:26:15.285719+0000","last_became_active":"2024-03-18T00:26:15.282752+0000","last_became_peered":"2024-03-18T00:26:15.282752+0000","last_unstale":"2024-03-18T00:26:15.285719+0000","last_undegraded":"2024-03-18T00:26:15.285719+0000","last_fullsized":"2024-03-18T00:26:15.285719+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:33:45.184683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.296501+0000","last_change":"2024-03-18T00:26:14.277532+0000","last_active":"2024-03-18T00:26:15.296501+0000","last_peered":"2024-03-18T00:26:15.296501+0000","last_clean":"2024-03-18T00:26:15.296501+0000","last_became_active":"2024-03-18T00:26:14.276438+0000","last_became_peered":"2024-03-18T00:26:14.276438+0000","last_unstale":"2024-03-18T00:26:15.296501+0000","last_undegraded":"2024-03-18T00:26:15.296501+0000","last_fullsized":"2024-03-18T00:26:15.296501+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293449+0000","last_change":"2024-03-18T00:26:15.292256+0000","last_active":"2024-03-18T00:26:15.293449+0000","last_peered":"2024-03-18T00:26:15.293449+0000","last_clean":"2024-03-18T00:26:15.293449+0000","last_became_active":"2024-03-18T00:26:15.291987+0000","last_became_peered":"2024-03-18T00:26:15.291987+0000","last_unstale":"2024-03-18T00:26:15.293449+0000","last_undegraded":"2024-03-18T00:26:15.293449+0000","last_fullsized":"2024-03-18T00:26:15.293449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:22.660007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267994+0000","last_change":"2024-03-18T00:26:14.277912+0000","last_active":"2024-03-18T00:26:15.267994+0000","last_peered":"2024-03-18T00:26:15.267994+0000","last_clean":"2024-03-18T00:26:15.267994+0000","last_became_active":"2024-03-18T00:26:14.277191+0000","last_became_peered":"2024-03-18T00:26:14.277191+0000","last_unstale":"2024-03-18T00:26:15.267994+0000","last_undegraded":"2024-03-18T00:26:15.267994+0000","last_fullsized":"2024-03-18T00:26:15.267994+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T10:10:43.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.284949+0000","last_change":"2024-03-18T00:26:15.283054+0000","last_active":"2024-03-18T00:26:15.284949+0000","last_peered":"2024-03-18T00:26:15.284949+0000","last_clean":"2024-03-18T00:26:15.284949+0000","last_became_active":"2024-03-18T00:26:15.282750+0000","last_became_peered":"2024-03-18T00:26:15.282750+0000","last_unstale":"2024-03-18T00:26:15.284949+0000","last_undegraded":"2024-03-18T00:26:15.284949+0000","last_fullsized":"2024-03-18T00:26:15.284949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:07:26.791101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.302163+0000","last_change":"2024-03-18T00:26:14.283891+0000","last_active":"2024-03-18T00:26:15.302163+0000","last_peered":"2024-03-18T00:26:15.302163+0000","last_clean":"2024-03-18T00:26:15.302163+0000","last_became_active":"2024-03-18T00:26:14.283558+0000","last_became_peered":"2024-03-18T00:26:14.283558+0000","last_unstale":"2024-03-18T00:26:15.302163+0000","last_undegraded":"2024-03-18T00:26:15.302163+0000","last_fullsized":"2024-03-18T00:26:15.302163+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.278967+0000","last_change":"2024-03-18T00:26:15.275360+0000","last_active":"2024-03-18T00:26:15.278967+0000","last_peered":"2024-03-18T00:26:15.278967+0000","last_clean":"2024-03-18T00:26:15.278967+0000","last_became_active":"2024-03-18T00:26:15.275085+0000","last_became_peered":"2024-03-18T00:26:15.275085+0000","last_unstale":"2024-03-18T00:26:15.278967+0000","last_undegraded":"2024-03-18T00:26:15.278967+0000","last_fullsized":"2024-03-18T00:26:15.278967+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T04:07:39.645589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.270779+0000","last_change":"2024-03-18T00:26:14.282893+0000","last_active":"2024-03-18T00:26:15.270779+0000","last_peered":"2024-03-18T00:26:15.270779+0000","last_clean":"2024-03-18T00:26:15.270779+0000","last_became_active":"2024-03-18T00:26:14.282625+0000","last_became_peered":"2024-03-18T00:26:14.282625+0000","last_unstale":"2024-03-18T00:26:15.270779+0000","last_undegraded":"2024-03-18T00:26:15.270779+0000","last_fullsized":"2024-03-18T00:26:15.270779+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:21.658018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.275708+0000","last_change":"2024-03-18T00:26:15.273821+0000","last_active":"2024-03-18T00:26:15.275708+0000","last_peered":"2024-03-18T00:26:15.275708+0000","last_clean":"2024-03-18T00:26:15.275708+0000","last_became_active":"2024-03-18T00:26:15.273516+0000","last_became_peered":"2024-03-18T00:26:15.273516+0000","last_unstale":"2024-03-18T00:26:15.275708+0000","last_undegraded":"2024-03-18T00:26:15.275708+0000","last_fullsized":"2024-03-18T00:26:15.275708+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:40:29.461632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.266973+0000","last_change":"2024-03-18T00:26:14.280537+0000","last_active":"2024-03-18T00:26:15.266973+0000","last_peered":"2024-03-18T00:26:15.266973+0000","last_clean":"2024-03-18T00:26:15.266973+0000","last_became_active":"2024-03-18T00:26:14.280312+0000","last_became_peered":"2024-03-18T00:26:14.280312+0000","last_unstale":"2024-03-18T00:26:15.266973+0000","last_undegraded":"2024-03-18T00:26:15.266973+0000","last_fullsized":"2024-03-18T00:26:15.266973+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:07:25.789112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.290978+0000","last_change":"2024-03-18T00:26:15.288162+0000","last_active":"2024-03-18T00:26:15.290978+0000","last_peered":"2024-03-18T00:26:15.290978+0000","last_clean":"2024-03-18T00:26:15.290978+0000","last_became_active":"2024-03-18T00:26:15.287794+0000","last_became_peered":"2024-03-18T00:26:15.287794+0000","last_unstale":"2024-03-18T00:26:15.290978+0000","last_undegraded":"2024-03-18T00:26:15.290978+0000","last_fullsized":"2024-03-18T00:26:15.290978+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T09:02:19.867361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.272591+0000","last_change":"2024-03-18T00:26:14.275777+0000","last_active":"2024-03-18T00:26:15.272591+0000","last_peered":"2024-03-18T00:26:15.272591+0000","last_clean":"2024-03-18T00:26:15.272591+0000","last_became_active":"2024-03-18T00:26:14.275371+0000","last_became_peered":"2024-03-18T00:26:14.275371+0000","last_unstale":"2024-03-18T00:26:15.272591+0000","last_undegraded":"2024-03-18T00:26:15.272591+0000","last_fullsized":"2024-03-18T00:26:15.272591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T06:38:40.009764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.281363+0000","last_change":"2024-03-18T00:26:15.278709+0000","last_active":"2024-03-18T00:26:15.281363+0000","last_peered":"2024-03-18T00:26:15.281363+0000","last_clean":"2024-03-18T00:26:15.281363+0000","last_became_active":"2024-03-18T00:26:15.278396+0000","last_became_peered":"2024-03-18T00:26:15.278396+0000","last_unstale":"2024-03-18T00:26:15.281363+0000","last_undegraded":"2024-03-18T00:26:15.281363+0000","last_fullsized":"2024-03-18T00:26:15.281363+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:08:55.377409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.301657+0000","last_change":"2024-03-18T00:26:14.278817+0000","last_active":"2024-03-18T00:26:15.301657+0000","last_peered":"2024-03-18T00:26:15.301657+0000","last_clean":"2024-03-18T00:26:15.301657+0000","last_became_active":"2024-03-18T00:26:14.278546+0000","last_became_peered":"2024-03-18T00:26:14.278546+0000","last_unstale":"2024-03-18T00:26:15.301657+0000","last_undegraded":"2024-03-18T00:26:15.301657+0000","last_fullsized":"2024-03-18T00:26:15.301657+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.289171+0000","last_change":"2024-03-18T00:26:15.282087+0000","last_active":"2024-03-18T00:26:15.289171+0000","last_peered":"2024-03-18T00:26:15.289171+0000","last_clean":"2024-03-18T00:26:15.289171+0000","last_became_active":"2024-03-18T00:26:15.281230+0000","last_became_peered":"2024-03-18T00:26:15.281230+0000","last_unstale":"2024-03-18T00:26:15.289171+0000","last_undegraded":"2024-03-18T00:26:15.289171+0000","last_fullsized":"2024-03-18T00:26:15.289171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268166+0000","last_change":"2024-03-18T00:26:14.283925+0000","last_active":"2024-03-18T00:26:15.268166+0000","last_peered":"2024-03-18T00:26:15.268166+0000","last_clean":"2024-03-18T00:26:15.268166+0000","last_became_active":"2024-03-18T00:26:14.283489+0000","last_became_peered":"2024-03-18T00:26:14.283489+0000","last_unstale":"2024-03-18T00:26:15.268166+0000","last_undegraded":"2024-03-18T00:26:15.268166+0000","last_fullsized":"2024-03-18T00:26:15.268166+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:40:34.957379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.293260+0000","last_change":"2024-03-18T00:26:15.285907+0000","last_active":"2024-03-18T00:26:15.293260+0000","last_peered":"2024-03-18T00:26:15.293260+0000","last_clean":"2024-03-18T00:26:15.293260+0000","last_became_active":"2024-03-18T00:26:15.285547+0000","last_became_peered":"2024-03-18T00:26:15.285547+0000","last_unstale":"2024-03-18T00:26:15.293260+0000","last_undegraded":"2024-03-18T00:26:15.293260+0000","last_fullsized":"2024-03-18T00:26:15.293260+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:37:03.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268723+0000","last_change":"2024-03-18T00:26:14.276464+0000","last_active":"2024-03-18T00:26:15.268723+0000","last_peered":"2024-03-18T00:26:15.268723+0000","last_clean":"2024-03-18T00:26:15.268723+0000","last_became_active":"2024-03-18T00:26:14.276202+0000","last_became_peered":"2024-03-18T00:26:14.276202+0000","last_unstale":"2024-03-18T00:26:15.268723+0000","last_undegraded":"2024-03-18T00:26:15.268723+0000","last_fullsized":"2024-03-18T00:26:15.268723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T05:43:18.115429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.285455+0000","last_change":"2024-03-18T00:26:15.278865+0000","last_active":"2024-03-18T00:26:15.285455+0000","last_peered":"2024-03-18T00:26:15.285455+0000","last_clean":"2024-03-18T00:26:15.285455+0000","last_became_active":"2024-03-18T00:26:15.278600+0000","last_became_peered":"2024-03-18T00:26:15.278600+0000","last_unstale":"2024-03-18T00:26:15.285455+0000","last_undegraded":"2024-03-18T00:26:15.285455+0000","last_fullsized":"2024-03-18T00:26:15.285455+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:04:00.332172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.268097+0000","last_change":"2024-03-18T00:26:14.279624+0000","last_active":"2024-03-18T00:26:15.268097+0000","last_peered":"2024-03-18T00:26:15.268097+0000","last_clean":"2024-03-18T00:26:15.268097+0000","last_became_active":"2024-03-18T00:26:14.279368+0000","last_became_peered":"2024-03-18T00:26:14.279368+0000","last_unstale":"2024-03-18T00:26:15.268097+0000","last_undegraded":"2024-03-18T00:26:15.268097+0000","last_fullsized":"2024-03-18T00:26:15.268097+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.279840+0000","last_change":"2024-03-18T00:26:15.277004+0000","last_active":"2024-03-18T00:26:15.279840+0000","last_peered":"2024-03-18T00:26:15.279840+0000","last_clean":"2024-03-18T00:26:15.279840+0000","last_became_active":"2024-03-18T00:26:15.276421+0000","last_became_peered":"2024-03-18T00:26:15.276421+0000","last_unstale":"2024-03-18T00:26:15.279840+0000","last_undegraded":"2024-03-18T00:26:15.279840+0000","last_fullsized":"2024-03-18T00:26:15.279840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.269562+0000","last_change":"2024-03-18T00:26:14.278413+0000","last_active":"2024-03-18T00:26:15.269562+0000","last_peered":"2024-03-18T00:26:15.269562+0000","last_clean":"2024-03-18T00:26:15.269562+0000","last_became_active":"2024-03-18T00:26:14.278134+0000","last_became_peered":"2024-03-18T00:26:14.278134+0000","last_unstale":"2024-03-18T00:26:15.269562+0000","last_undegraded":"2024-03-18T00:26:15.269562+0000","last_fullsized":"2024-03-18T00:26:15.269562+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T11:03:59.330184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.292415+0000","last_change":"2024-03-18T00:26:15.281448+0000","last_active":"2024-03-18T00:26:15.292415+0000","last_peered":"2024-03-18T00:26:15.292415+0000","last_clean":"2024-03-18T00:26:15.292415+0000","last_became_active":"2024-03-18T00:26:15.281008+0000","last_became_peered":"2024-03-18T00:26:15.281008+0000","last_unstale":"2024-03-18T00:26:15.292415+0000","last_undegraded":"2024-03-18T00:26:15.292415+0000","last_fullsized":"2024-03-18T00:26:15.292415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:41:10.979407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.267158+0000","last_change":"2024-03-18T00:26:14.279598+0000","last_active":"2024-03-18T00:26:15.267158+0000","last_peered":"2024-03-18T00:26:15.267158+0000","last_clean":"2024-03-18T00:26:15.267158+0000","last_became_active":"2024-03-18T00:26:14.279304+0000","last_became_peered":"2024-03-18T00:26:14.279304+0000","last_unstale":"2024-03-18T00:26:15.267158+0000","last_undegraded":"2024-03-18T00:26:15.267158+0000","last_fullsized":"2024-03-18T00:26:15.267158+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T03:38:21.658018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277761+0000","last_change":"2024-03-18T00:26:15.273962+0000","last_active":"2024-03-18T00:26:15.277761+0000","last_peered":"2024-03-18T00:26:15.277761+0000","last_clean":"2024-03-18T00:26:15.277761+0000","last_became_active":"2024-03-18T00:26:15.273593+0000","last_became_peered":"2024-03-18T00:26:15.273593+0000","last_unstale":"2024-03-18T00:26:15.277761+0000","last_undegraded":"2024-03-18T00:26:15.277761+0000","last_fullsized":"2024-03-18T00:26:15.277761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T01:03:08.926795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.277419+0000","last_change":"2024-03-18T00:26:14.275365+0000","last_active":"2024-03-18T00:26:15.277419+0000","last_peered":"2024-03-18T00:26:15.277419+0000","last_clean":"2024-03-18T00:26:15.277419+0000","last_became_active":"2024-03-18T00:26:14.275090+0000","last_became_peered":"2024-03-18T00:26:14.275090+0000","last_unstale":"2024-03-18T00:26:15.277419+0000","last_undegraded":"2024-03-18T00:26:15.277419+0000","last_fullsized":"2024-03-18T00:26:15.277419+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:56.786259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.288599+0000","last_change":"2024-03-18T00:26:15.287324+0000","last_active":"2024-03-18T00:26:15.288599+0000","last_peered":"2024-03-18T00:26:15.288599+0000","last_clean":"2024-03-18T00:26:15.288599+0000","last_became_active":"2024-03-18T00:26:15.287049+0000","last_became_peered":"2024-03-18T00:26:15.287049+0000","last_unstale":"2024-03-18T00:26:15.288599+0000","last_undegraded":"2024-03-18T00:26:15.288599+0000","last_fullsized":"2024-03-18T00:26:15.288599+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:14.255966+0000","last_clean_scrub_stamp":"2024-03-18T00:26:14.255966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T08:14:57.788247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.270481+0000","last_change":"2024-03-18T00:26:14.278609+0000","last_active":"2024-03-18T00:26:15.270481+0000","last_peered":"2024-03-18T00:26:15.270481+0000","last_clean":"2024-03-18T00:26:15.270481+0000","last_became_active":"2024-03-18T00:26:14.278306+0000","last_became_peered":"2024-03-18T00:26:14.278306+0000","last_unstale":"2024-03-18T00:26:15.270481+0000","last_undegraded":"2024-03-18T00:26:15.270481+0000","last_fullsized":"2024-03-18T00:26:15.270481+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:26:13.253977+0000","last_clean_scrub_stamp":"2024-03-18T00:26:13.253977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T02:20:06.443531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":190,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-03-18T00:26:15.283084+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T00:26:15.283084+0000","last_peered":"2024-03-18T00:26:15.283084+0000","last_clean":"2024-03-18T00:26:15.283084+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T00:26:15.283084+0000","last_undegraded":"2024-03-18T00:26:15.283084+0000","last_fullsized":"2024-03-18T00:26:15.283084+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":134387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134353,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27352,"kb_used_data":328,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344488,"statfs":{"total":96636764160,"available":96608755712,"internally_reserved":0,"allocated":335872,"data_stored":127508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":929792,"data_stored":717876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T00:26:18.581 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T00:26:18.581 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-18T00:26:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.725+0000 7f926919d640 1 Processor -- start 2024-03-18T00:26:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.725+0000 7f926919d640 1 -- start start 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926919d640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92640b5310 0x7f92640d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926919d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f92640d27a0 0x7f92640d2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926919d640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f926415fdd0 con 0x7f92640b34a0 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926919d640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f92641609e0 con 0x7f92640b5310 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926919d640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f92641600b0 con 0x7f92640d27a0 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f9263fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92640b5310 0x7f92640d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f9263fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f92640b5310 0x7f92640d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43388/0 (socket says 172.21.15.81:43388) 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f9263fff640 1 -- 172.21.15.81:0/4190564397 learned_addr learned my addr 172.21.15.81:0/4190564397 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.726+0000 7f926899c640 1 --2- 172.21.15.81:0/4190564397 >> v2:172.21.15.136:3300/0 conn(0x7f92640d27a0 0x7f92640d2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9263fff640 1 -- 172.21.15.81:0/4190564397 >> v2:172.21.15.136:3300/0 conn(0x7f92640d27a0 msgr2=0x7f92640d2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9263fff640 1 --2- 172.21.15.81:0/4190564397 >> v2:172.21.15.136:3300/0 conn(0x7f92640d27a0 0x7f92640d2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9263fff640 1 -- 172.21.15.81:0/4190564397 >> v1:172.21.15.136:6789/0 conn(0x7f92640b34a0 legacy=0x7f92641628f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9263fff640 1 -- 172.21.15.81:0/4190564397 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9264160390 con 0x7f92640b5310 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9263fff640 1 --2- 172.21.15.81:0/4190564397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b5310 0x7f92640d21a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92640c74a0 tx=0x7f925402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744ad73069c1c50d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9262ffd640 1 -- 172.21.15.81:0/4190564397 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254034070 con 0x7f92640b5310 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9262ffd640 1 -- 172.21.15.81:0/4190564397 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9254030860 con 0x7f92640b5310 2024-03-18T00:26:18.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.727+0000 7f9262ffd640 1 -- 172.21.15.81:0/4190564397 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254030c30 con 0x7f92640b5310 2024-03-18T00:26:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 -- 172.21.15.81:0/4190564397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b5310 msgr2=0x7f92640d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 --2- 172.21.15.81:0/4190564397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b5310 0x7f92640d21a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f92640c74a0 tx=0x7f925402b9a0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 -- 172.21.15.81:0/4190564397 shutdown_connections 2024-03-18T00:26:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 --2- 172.21.15.81:0/4190564397 >> v2:172.21.15.136:3300/0 conn(0x7f92640d27a0 0x7f92640d2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 --2- 172.21.15.81:0/4190564397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b5310 0x7f92640d21a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 -- 172.21.15.81:0/4190564397 >> 172.21.15.81:0/4190564397 conn(0x7f92640d3e90 msgr2=0x7f92640d42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 -- 172.21.15.81:0/4190564397 shutdown_connections 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.728+0000 7f926919d640 1 -- 172.21.15.81:0/4190564397 wait complete. 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.729+0000 7f926919d640 1 Processor -- start 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.729+0000 7f926919d640 1 -- start start 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92640b5310 0x7f926415c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 0x7f9264156ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f926415dae0 con 0x7f92640b34a0 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f92640b56f0 con 0x7f92640d27a0 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926919d640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f926415dc60 con 0x7f92640b5310 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43404/0 (socket says 172.21.15.81:43404) 2024-03-18T00:26:18.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 -- 172.21.15.81:0/2329982999 learned_addr learned my addr 172.21.15.81:0/2329982999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f92637fe640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92640b5310 0x7f926415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926899c640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 0x7f9264156ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 -- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92640b5310 msgr2=0x7f926415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92640b5310 0x7f926415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 -- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 msgr2=0x7f9264156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 0x7f9264156ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f9263fff640 1 -- 172.21.15.81:0/2329982999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92640cf120 con 0x7f92640b34a0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.730+0000 7f926899c640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 0x7f9264156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f9263fff640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f925402b9e0 tx=0x7f9254004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254048070 con 0x7f92640b34a0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9254030660 con 0x7f92640b34a0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254034040 con 0x7f92640b34a0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92640cf400 con 0x7f92640b34a0 2024-03-18T00:26:18.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.731+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92640cf9c0 con 0x7f92640b34a0 2024-03-18T00:26:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.732+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92640755f0 con 0x7f92640b34a0 2024-03-18T00:26:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.732+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9254037070 con 0x7f92640b34a0 2024-03-18T00:26:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.733+0000 7f9260ff9640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 0x7f925006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.733+0000 7f92637fe640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 0x7f925006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.733+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f92540ac800 con 0x7f92640b34a0 2024-03-18T00:26:18.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.733+0000 7f92637fe640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 0x7f925006e090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92640c74c0 tx=0x7f9258009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.737+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f925407adc0 con 0x7f92640b34a0 2024-03-18T00:26:18.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.975+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f92640d1440 con 0x7f92640b34a0 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.977+0000 7f9260ff9640 1 -- 172.21.15.81:0/2329982999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7f925407ee60 con 0x7f92640b34a0 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC5ifdlMETNJRAA/du1tDc2rDvVDvLyJhOxSg== 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-18T00:26:18.978 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 msgr2=0x7f925006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 0x7f925006e090 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f92640c74c0 tx=0x7f9258009040 comp rx=0 tx=0).stop 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 msgr2=0x7f92640d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f925402b9e0 tx=0x7f9254004730 comp rx=0 tx=0).stop 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 shutdown_connections 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f92640d27a0 0x7f9264156ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f92640b5310 0x7f926415c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f925006bbd0 0x7f925006e090 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 --2- 172.21.15.81:0/2329982999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92640b34a0 0x7f92640d0c00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:18.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 >> 172.21.15.81:0/2329982999 conn(0x7f92640d3e90 msgr2=0x7f92640b58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:18.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.979+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 shutdown_connections 2024-03-18T00:26:18.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:18.980+0000 7f926919d640 1 -- 172.21.15.81:0/2329982999 wait complete. 2024-03-18T00:26:18.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T00:26:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.091+0000 7ff51135b640 1 Processor -- start 2024-03-18T00:26:19.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.091+0000 7ff51135b640 1 -- start start 2024-03-18T00:26:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff51135b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff50c1622b0 0x7ff50c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff51135b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 0x7ff50c162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff51135b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff50c0b3440 con 0x7ff50c0cec80 2024-03-18T00:26:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff51135b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff50c0d16c0 con 0x7ff50c1622b0 2024-03-18T00:26:19.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff51135b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c0d2660 con 0x7ff50c162690 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50b7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff50c0cec80 0x7ff50c0cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38168/0 (socket says 172.21.15.81:38168) 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50b7fe640 1 -- 172.21.15.81:0/150969349 learned_addr learned my addr 172.21.15.81:0/150969349 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50affd640 1 --2- 172.21.15.81:0/150969349 >> v2:172.21.15.136:3300/0 conn(0x7ff50c1622b0 0x7ff50c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50a7fc640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 0x7ff50c162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff509ffb640 1 -- 172.21.15.81:0/150969349 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3663926169 0 0) 0x7ff50c0b3440 con 0x7ff50c0cec80 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff509ffb640 1 -- 172.21.15.81:0/150969349 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4f4003520 con 0x7ff50c0cec80 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50affd640 1 -- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 msgr2=0x7ff50c162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50affd640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 0x7ff50c162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50affd640 1 -- 172.21.15.81:0/150969349 >> v1:172.21.15.81:6789/0 conn(0x7ff50c0cec80 legacy=0x7ff50c0cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50affd640 1 -- 172.21.15.81:0/150969349 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0d20a0 con 0x7ff50c1622b0 2024-03-18T00:26:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.092+0000 7ff50a7fc640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 0x7ff50c162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.093+0000 7ff50affd640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c1622b0 0x7ff50c0d10d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097a0 tx=0x7ff4fc02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fc7a003969711e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.093+0000 7ff509ffb640 1 -- 172.21.15.81:0/150969349 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc038070 con 0x7ff50c1622b0 2024-03-18T00:26:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.093+0000 7ff509ffb640 1 -- 172.21.15.81:0/150969349 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4fc031700 con 0x7ff50c1622b0 2024-03-18T00:26:19.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.093+0000 7ff509ffb640 1 -- 172.21.15.81:0/150969349 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc031ad0 con 0x7ff50c1622b0 2024-03-18T00:26:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 -- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c1622b0 msgr2=0x7ff50c0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c1622b0 0x7ff50c0d10d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0097a0 tx=0x7ff4fc02b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 -- 172.21.15.81:0/150969349 shutdown_connections 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c162690 0x7ff50c162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 --2- 172.21.15.81:0/150969349 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c1622b0 0x7ff50c0d10d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 -- 172.21.15.81:0/150969349 >> 172.21.15.81:0/150969349 conn(0x7ff50c0d4070 msgr2=0x7ff50c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 -- 172.21.15.81:0/150969349 shutdown_connections 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.094+0000 7ff51135b640 1 -- 172.21.15.81:0/150969349 wait complete. 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.095+0000 7ff51135b640 1 Processor -- start 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.095+0000 7ff51135b640 1 -- start start 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 0x7ff50c0cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c1622b0 0x7ff50c0b76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c15faa0 con 0x7ff50c162690 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff50c0d2ab0 con 0x7ff50c0cec80 2024-03-18T00:26:19.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff50c15fc20 con 0x7ff50c1622b0 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50a7fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c1622b0 0x7ff50c0b76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43410/0 (socket says 172.21.15.81:43410) 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 -- 172.21.15.81:0/3945172485 learned_addr learned my addr 172.21.15.81:0/3945172485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50affd640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 0x7ff50c0cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 -- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c1622b0 msgr2=0x7ff50c0b76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c1622b0 0x7ff50c0b76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 -- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 msgr2=0x7ff50c0cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 0x7ff50c0cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 -- 172.21.15.81:0/3945172485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff50c0b7bf0 con 0x7ff50c162690 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50affd640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 0x7ff50c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff50b7fe640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cb40 tx=0x7ff50400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504017070 con 0x7ff50c162690 2024-03-18T00:26:19.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50400aca0 con 0x7ff50c162690 2024-03-18T00:26:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff50c0cca60 con 0x7ff50c162690 2024-03-18T00:26:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff504012620 con 0x7ff50c162690 2024-03-18T00:26:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.096+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff50c1e8510 con 0x7ff50c162690 2024-03-18T00:26:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.097+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff50c04f5b0 con 0x7ff50c162690 2024-03-18T00:26:19.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.098+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff50401a070 con 0x7ff50c162690 2024-03-18T00:26:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.098+0000 7ff4f37fe640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 0x7ff4f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.098+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7ff50408a7f0 con 0x7ff50c162690 2024-03-18T00:26:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.098+0000 7ff50affd640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 0x7ff4f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.099+0000 7ff50affd640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 0x7ff4f806e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc035000 tx=0x7ff4fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.103+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff504058d20 con 0x7ff50c162690 2024-03-18T00:26:19.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.311+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff50c1eafa0 con 0x7ff50c162690 2024-03-18T00:26:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.311+0000 7ff4f37fe640 1 -- 172.21.15.81:0/3945172485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7ff50405cdc0 con 0x7ff50c162690 2024-03-18T00:26:19.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:19.312 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T00:26:19.312 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 msgr2=0x7ff4f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 0x7ff4f806e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc035000 tx=0x7ff4fc008030 comp rx=0 tx=0).stop 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 msgr2=0x7ff50c0cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7ff50400cb40 tx=0x7ff50400a060 comp rx=0 tx=0).stop 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 shutdown_connections 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff4f806bbd0 0x7ff4f806e090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff50c162690 0x7ff50c0cb140 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff50c1622b0 0x7ff50c0b76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 --2- 172.21.15.81:0/3945172485 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff50c0cec80 0x7ff50c0cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 >> 172.21.15.81:0/3945172485 conn(0x7ff50c0d4070 msgr2=0x7ff50c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.313+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 shutdown_connections 2024-03-18T00:26:19.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.314+0000 7ff51135b640 1 -- 172.21.15.81:0/3945172485 wait complete. 2024-03-18T00:26:19.666 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T00:26:19.665+0000 7fe02e9a7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T00:26:19.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T00:26:14.611226+0000', 'modified': '2024-03-18T00:26:16.618155+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5070}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5070': {'gid': 5070, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.136:6834/1616882519', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.136:6832', 'nonce': 1616882519}, {'type': 'v1', 'addr': '172.21.15.136:6834', 'nonce': 1616882519}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5070, 'qdb_cluster': [5070]} 2024-03-18T00:26:19.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T00:26:19.728 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-03-18T00:26:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.829+0000 7feb5b377640 1 Processor -- start 2024-03-18T00:26:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 -- start start 2024-03-18T00:26:19.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7feb540d10d0 0x7feb54162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb5415ea90 0x7feb5415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb540b3440 con 0x7feb541622b0 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7feb540d16c0 con 0x7feb5415ea90 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb5b377640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7feb540d2660 con 0x7feb540d10d0 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.830+0000 7feb59113640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feb541622b0 0x7feb54162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38180/0 (socket says 172.21.15.81:38180) 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59113640 1 -- 172.21.15.81:0/812313904 learned_addr learned my addr 172.21.15.81:0/812313904 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59914640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feb5415ea90 0x7feb5415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb58912640 1 --2- 172.21.15.81:0/812313904 >> v2:172.21.15.136:3300/0 conn(0x7feb540d10d0 0x7feb54162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59914640 1 -- 172.21.15.81:0/812313904 >> v2:172.21.15.136:3300/0 conn(0x7feb540d10d0 msgr2=0x7feb54162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59914640 1 --2- 172.21.15.81:0/812313904 >> v2:172.21.15.136:3300/0 conn(0x7feb540d10d0 0x7feb54162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59914640 1 -- 172.21.15.81:0/812313904 >> v1:172.21.15.81:6789/0 conn(0x7feb541622b0 legacy=0x7feb54162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb4bfff640 1 -- 172.21.15.81:0/812313904 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245767638 0 0) 0x7feb540b3440 con 0x7feb541622b0 2024-03-18T00:26:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.831+0000 7feb59914640 1 -- 172.21.15.81:0/812313904 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb540d20a0 con 0x7feb5415ea90 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb59914640 1 --2- 172.21.15.81:0/812313904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5415ea90 0x7feb5415eee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb5002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9efafe0a66401c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb4bfff640 1 -- 172.21.15.81:0/812313904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50038070 con 0x7feb5415ea90 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb4bfff640 1 -- 172.21.15.81:0/812313904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50031700 con 0x7feb5415ea90 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb4bfff640 1 -- 172.21.15.81:0/812313904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50031ad0 con 0x7feb5415ea90 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 -- 172.21.15.81:0/812313904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5415ea90 msgr2=0x7feb5415eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 --2- 172.21.15.81:0/812313904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5415ea90 0x7feb5415eee0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb5002b7a0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 -- 172.21.15.81:0/812313904 shutdown_connections 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 --2- 172.21.15.81:0/812313904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb5415ea90 0x7feb5415eee0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 --2- 172.21.15.81:0/812313904 >> v2:172.21.15.136:3300/0 conn(0x7feb540d10d0 0x7feb54162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 -- 172.21.15.81:0/812313904 >> 172.21.15.81:0/812313904 conn(0x7feb540d4070 msgr2=0x7feb540d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 -- 172.21.15.81:0/812313904 shutdown_connections 2024-03-18T00:26:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.832+0000 7feb5b377640 1 -- 172.21.15.81:0/812313904 wait complete. 2024-03-18T00:26:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.833+0000 7feb5b377640 1 Processor -- start 2024-03-18T00:26:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.833+0000 7feb5b377640 1 -- start start 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb5415ea90 0x7feb540b4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feb541622b0 0x7feb5415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb540cfc90 con 0x7feb540d10d0 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb540d2ab0 con 0x7feb5415ea90 2024-03-18T00:26:19.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb5b377640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feb540cfe10 con 0x7feb541622b0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43420/0 (socket says 172.21.15.81:43420) 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 -- 172.21.15.81:0/1860124642 learned_addr learned my addr 172.21.15.81:0/1860124642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59914640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feb541622b0 0x7feb5415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb58912640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb5415ea90 0x7feb540b4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 -- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feb541622b0 msgr2=0x7feb5415a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feb541622b0 0x7feb5415a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 -- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb5415ea90 msgr2=0x7feb540b4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb5415ea90 0x7feb540b4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.834+0000 7feb59113640 1 -- 172.21.15.81:0/1860124642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb541491a0 con 0x7feb540d10d0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb59113640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c8c0 tx=0x7feb4c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb49ffb640 1 -- 172.21.15.81:0/1860124642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c018070 con 0x7feb540d10d0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb49ffb640 1 -- 172.21.15.81:0/1860124642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c00a640 con 0x7feb540d10d0 2024-03-18T00:26:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5415ef10 con 0x7feb540d10d0 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb49ffb640 1 -- 172.21.15.81:0/1860124642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c00aa30 con 0x7feb540d10d0 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.835+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5415f4d0 con 0x7feb540d10d0 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.836+0000 7feb49ffb640 1 -- 172.21.15.81:0/1860124642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feb4c01b070 con 0x7feb540d10d0 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.837+0000 7feb49ffb640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 0x7feb3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.837+0000 7feb49ffb640 1 -- 172.21.15.81:0/1860124642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feb4c08a0d0 con 0x7feb540d10d0 2024-03-18T00:26:19.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.837+0000 7feb58912640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 0x7feb3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.837+0000 7feb58912640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 0x7feb3806e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb54160640 tx=0x7feb44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 Processor -- start 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 -- start start 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95095c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c950c5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c94ffec80 con 0x559c95096160 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559c94fa7aa0 con 0x559c950c2c80 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.838+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x559c94ffad20 con 0x559c950c3060 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43436/0 (socket says 172.21.15.81:43436) 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59113640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95095c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 -- 172.21.15.81:0/4103314923 learned_addr learned my addr 172.21.15.81:0/4103314923 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb58912640 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c950c5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 -- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 msgr2=0x559c950c5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c950c5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 -- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 msgr2=0x559c95095c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95095c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 -- 172.21.15.81:0/4103314923 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c94fc9ff0 con 0x559c95096160 2024-03-18T00:26:19.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59113640 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95095c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb59914640 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb50030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=976d869ad18ca0ad server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb3effd640 1 -- 172.21.15.81:0/4103314923 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50042070 con 0x559c95096160 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb3effd640 1 -- 172.21.15.81:0/4103314923 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50004440 con 0x559c95096160 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.839+0000 7feb3effd640 1 -- 172.21.15.81:0/4103314923 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50038040 con 0x559c95096160 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- 172.21.15.81:0/4103314923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 msgr2=0x559c950c5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb50030000 comp rx=0 tx=0).stop 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- 172.21.15.81:0/4103314923 shutdown_connections 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c95096160 0x559c950c5f50 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c950c5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 --2- 172.21.15.81:0/4103314923 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95095c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- 172.21.15.81:0/4103314923 >> 172.21.15.81:0/4103314923 conn(0x559c95097e90 msgr2=0x559c950e0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- 172.21.15.81:0/4103314923 shutdown_connections 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- 172.21.15.81:0/4103314923 wait complete. 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 -- start start 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.840+0000 7feb5e038740 1 Processor -- start 2024-03-18T00:26:19.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c950b5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c3060 0x559c950cc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c9509a530 con 0x559c950c7d60 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559c94fbaef0 con 0x559c950c3060 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x559c9509cd70 con 0x559c950c2c80 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb5e038740 10 client.0 _ll_register_callbacks cb 0x559c94fb5dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.841+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43440/0 (socket says 172.21.15.81:43440) 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 -- 172.21.15.81:0/320929444 learned_addr learned my addr 172.21.15.81:0/320929444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59113640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c950b5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb58912640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c3060 0x559c950cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 -- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 msgr2=0x559c950b5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c950b5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 -- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c3060 msgr2=0x559c950cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c3060 0x559c950cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 -- 172.21.15.81:0/320929444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c94fc7a30 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb59914640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1133637044e93b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5004d070 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feb50003820 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb50004440 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7feb50057050 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 10 client.5247 fetch_fsmap learned FSMap version 14 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559c94d132d0 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb50004440 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7feb5005a020 con 0x559c950c7d60 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 10 client.5247 fetch_fsmap finished waiting for FSMap version 14 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 10 client.5247 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-18T00:26:19.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 20 client.5247 populate_metadata read hostname 'smithi081' 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950f4110 0x559c950cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.842+0000 7feb5e038740 4 client.5247 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.843+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 --> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559c9500c1c0 con 0x559c950f4110 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.843+0000 7feb59113640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950f4110 0x559c950cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.843+0000 7feb59113640 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950f4110 0x559c950cae80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54fc9556516fcc47 server_cookie=7f49a13af8cb96dd in_seq=0 out_seq=0 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.843+0000 7feb33fff640 10 client.5247 ms_handle_connect on v2:172.21.15.136:6832/1616882519 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb33fff640 1 -- 172.21.15.81:0/320929444 <== mds.0 v2:172.21.15.136:6832/1616882519 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559c9500c1c0 con 0x559c950f4110 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb33fff640 10 client.5247 handle_command_reply: tid=0 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 client.5247 shutdown 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 msgr2=0x559c950cccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7feb500097a0 tx=0x7feb50004730 comp rx=0 tx=0).stop 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 shutdown_connections 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950f4110 0x559c950cae80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c950cccb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb33fff640 0 client.5247 ms_handle_reset on v2:172.21.15.136:6832/1616882519 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c3060 0x559c950cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 --2- 172.21.15.81:0/320929444 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c950b5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 >> 172.21.15.81:0/320929444 conn(0x559c95096160 msgr2=0x559c95099d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 shutdown_connections 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 1 -- 172.21.15.81:0/320929444 wait complete. 2024-03-18T00:26:19.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.844+0000 7feb5e038740 20 client.5247 trim_cache size 0 max 16384 2024-03-18T00:26:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 Processor -- start 2024-03-18T00:26:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 -- start start 2024-03-18T00:26:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95150650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c95099780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feb540b3ef0 con 0x559c950c7d60 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feb54161260 con 0x559c950c2c80 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feb540b38a0 con 0x559c950c3060 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.862+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43456/0 (socket says 172.21.15.81:43456) 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 -- 172.21.15.81:0/2962324105 learned_addr learned my addr 172.21.15.81:0/2962324105 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb58912640 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c95099780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59113640 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 -- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 msgr2=0x559c95099780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c95099780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 -- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 msgr2=0x559c95150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 -- 172.21.15.81:0/2962324105 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c94ddd6b0 con 0x559c950c7d60 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb59914640 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feb50006f70 tx=0x7feb50035070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53584b82462af750 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb3e7fc640 1 -- 172.21.15.81:0/2962324105 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5004d040 con 0x559c950c7d60 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb3e7fc640 1 -- 172.21.15.81:0/2962324105 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb500044c0 con 0x559c950c7d60 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.863+0000 7feb3e7fc640 1 -- 172.21.15.81:0/2962324105 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb50038050 con 0x559c950c7d60 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- 172.21.15.81:0/2962324105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 msgr2=0x559c95099cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7feb50006f70 tx=0x7feb50035070 comp rx=0 tx=0).stop 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- 172.21.15.81:0/2962324105 shutdown_connections 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c7d60 0x559c95099cc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c3060 0x559c95099780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 --2- 172.21.15.81:0/2962324105 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c2c80 0x559c95150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- 172.21.15.81:0/2962324105 >> 172.21.15.81:0/2962324105 conn(0x559c95096160 msgr2=0x559c950f2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- 172.21.15.81:0/2962324105 shutdown_connections 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- 172.21.15.81:0/2962324105 wait complete. 2024-03-18T00:26:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 -- start start 2024-03-18T00:26:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.864+0000 7feb5e038740 1 Processor -- start 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c9514f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c7d60 0x559c950cca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x559c950cbeb0 con 0x559c950c3060 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x559c9509a530 con 0x559c950c7d60 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x559c950f4530 con 0x559c950c2c80 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb5e038740 10 client.0 _ll_register_callbacks cb 0x7feb4c001910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43470/0 (socket says 172.21.15.81:43470) 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 -- 172.21.15.81:0/745434215 learned_addr learned my addr 172.21.15.81:0/745434215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb59113640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c9514f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb59914640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c7d60 0x559c950cca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 -- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 msgr2=0x559c9514f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c9514f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 -- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c7d60 msgr2=0x559c950cca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c7d60 0x559c950cca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.865+0000 7feb58912640 1 -- 172.21.15.81:0/745434215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c9514f9c0 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb58912640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb44009810 tx=0x7feb440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2d826d9ae9d08e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb44031060 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7feb4400f050 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x559c95006510 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7feb44037050 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 10 client.5253 fetch_fsmap learned FSMap version 14 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559c9509ba00 con 0x559c950c3060 2024-03-18T00:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x559c95006510 con 0x559c950c3060 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 14) ==== 3494+0+0 (secure 0 0 0) 0x7feb4403a020 con 0x559c950c3060 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 10 client.5253 fetch_fsmap finished waiting for FSMap version 14 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 10 client.5253 resolve_mds: resolved name 'd' to daemon mds.d 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 20 client.5253 populate_metadata read hostname 'smithi081' 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950952e0 0x559c950caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 4 client.5253 mds_command: new command op to 5070 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 --> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] -- command(tid 0: {"prefix": "status"}) -- 0x559c94f84a00 con 0x559c950952e0 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.866+0000 7feb59113640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950952e0 0x559c950caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb33fff640 10 client.5253 ms_handle_connect on v2:172.21.15.136:6832/1616882519 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb59113640 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950952e0 0x559c950caac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9557ea6e28627287 server_cookie=1ac0a35ecf49338e in_seq=0 out_seq=0 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb33fff640 1 -- 172.21.15.81:0/745434215 <== mds.0 v2:172.21.15.136:6832/1616882519 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559c94f84a00 con 0x559c950952e0 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb33fff640 10 client.5253 handle_command_reply: tid=0 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 client.5253 shutdown 2024-03-18T00:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 msgr2=0x559c951035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7feb44009810 tx=0x7feb440046c0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 shutdown_connections 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:6832/1616882519,v1:172.21.15.136:6834/1616882519] conn(0x559c950952e0 0x559c950caac0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x559c950c7d60 0x559c950cca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb33fff640 0 client.5253 ms_handle_reset on v2:172.21.15.136:6832/1616882519 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x559c950c3060 0x559c951035a0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 --2- 172.21.15.81:0/745434215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x559c950c2c80 0x559c9514f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 >> 172.21.15.81:0/745434215 conn(0x559c95096160 msgr2=0x559c950c5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 shutdown_connections 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 1 -- 172.21.15.81:0/745434215 wait complete. 2024-03-18T00:26:19.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.867+0000 7feb5e038740 20 client.5253 trim_cache size 0 max 16384 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "a215fc89-10fc-4af5-b2ff-78f3e4709ee3", 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5070, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.5939669820000004, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 14, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 32, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 32, 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.058680517000001 2024-03-18T00:26:19.875 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T00:26:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 msgr2=0x7feb3806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 0x7feb3806e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feb54160640 tx=0x7feb44008040 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 msgr2=0x7feb5415fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c8c0 tx=0x7feb4c00cd80 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 shutdown_connections 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feb541622b0 0x7feb5415a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feb5415ea90 0x7feb540b4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feb3806bbd0 0x7feb3806e090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 --2- 172.21.15.81:0/1860124642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feb540d10d0 0x7feb5415fcd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 >> 172.21.15.81:0/1860124642 conn(0x7feb540d4070 msgr2=0x7feb54159bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 shutdown_connections 2024-03-18T00:26:19.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.868+0000 7feb5b377640 1 -- 172.21.15.81:0/1860124642 wait complete. 2024-03-18T00:26:19.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T00:26:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 Processor -- start 2024-03-18T00:26:19.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 -- start start 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40cf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4071930 con 0x7f45d406f0e0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45d4071c10 con 0x7f45d415e4f0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.979+0000 7f45dbac0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f45d4071ef0 con 0x7f45d415e110 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45da05d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45d406f0e0 0x7f45d40ad8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38196/0 (socket says 172.21.15.81:38196) 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45da05d640 1 -- 172.21.15.81:0/2933557111 learned_addr learned my addr 172.21.15.81:0/2933557111 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d985c640 1 --2- 172.21.15.81:0/2933557111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368391980 0 0) 0x7f45d4071930 con 0x7f45d406f0e0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45c0003520 con 0x7f45d406f0e0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d985c640 1 -- 172.21.15.81:0/2933557111 >> v1:172.21.15.136:6789/0 conn(0x7f45d415e4f0 legacy=0x7f45d406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374351469 0 0) 0x7f45d4071c10 con 0x7f45d415e4f0 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d985c640 1 -- 172.21.15.81:0/2933557111 >> v1:172.21.15.81:6789/0 conn(0x7f45d406f0e0 legacy=0x7f45d40ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.980+0000 7f45d985c640 1 -- 172.21.15.81:0/2933557111 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d40721d0 con 0x7f45d415e110 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45d985c640 1 --2- 172.21.15.81:0/2933557111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40cf620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45c40097d0 tx=0x7f45c402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9ddd462be0e237 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4035020 con 0x7f45d415e110 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45c4031890 con 0x7f45d415e110 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45d885a640 1 -- 172.21.15.81:0/2933557111 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45c4031c40 con 0x7f45d415e110 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45dbac0640 1 -- 172.21.15.81:0/2933557111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 msgr2=0x7f45d40cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45dbac0640 1 --2- 172.21.15.81:0/2933557111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40cf620 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f45c40097d0 tx=0x7f45c402b930 comp rx=0 tx=0).stop 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45dbac0640 1 -- 172.21.15.81:0/2933557111 shutdown_connections 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45dbac0640 1 --2- 172.21.15.81:0/2933557111 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40cf620 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.981+0000 7f45dbac0640 1 -- 172.21.15.81:0/2933557111 >> 172.21.15.81:0/2933557111 conn(0x7f45d40ccfb0 msgr2=0x7f45d40cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.982+0000 7f45dbac0640 1 -- 172.21.15.81:0/2933557111 shutdown_connections 2024-03-18T00:26:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.982+0000 7f45dbac0640 1 -- 172.21.15.81:0/2933557111 wait complete. 2024-03-18T00:26:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 Processor -- start 2024-03-18T00:26:19.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 -- start start 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45d406f0e0 0x7f45d41f3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40cff30 con 0x7f45d415e4f0 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f45d40cfdb0 con 0x7f45d406f0e0 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45dbac0640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f45d40d00b0 con 0x7f45d415e110 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.983+0000 7f45da05d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43484/0 (socket says 172.21.15.81:43484) 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 -- 172.21.15.81:0/3175339400 learned_addr learned my addr 172.21.15.81:0/3175339400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45d905b640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45d985c640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45d406f0e0 0x7f45d41f3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 -- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 msgr2=0x7f45d40b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 -- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45d406f0e0 msgr2=0x7f45d41f3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45d406f0e0 0x7f45d41f3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 -- 172.21.15.81:0/3175339400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45d415fa90 con 0x7f45d415e4f0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45da05d640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00caa0 tx=0x7f45cc00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc017070 con 0x7f45d415e4f0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45cc00ac00 con 0x7f45d415e4f0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45d415fd70 con 0x7f45d415e4f0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc012400 con 0x7f45d415e4f0 2024-03-18T00:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.984+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45d4160610 con 0x7f45d415e4f0 2024-03-18T00:26:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.985+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45d415ff40 con 0x7f45d415e4f0 2024-03-18T00:26:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.986+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f45cc01a070 con 0x7f45d415e4f0 2024-03-18T00:26:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.986+0000 7f45ca7fc640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 0x7f45b806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:26:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.986+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f45cc08a780 con 0x7f45d415e4f0 2024-03-18T00:26:19.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.986+0000 7f45d985c640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 0x7f45b806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.986+0000 7f45d985c640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 0x7f45b806e0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45c4036000 tx=0x7f45c4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:19.990+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f45cc058c30 con 0x7f45d415e4f0 2024-03-18T00:26:20.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.203+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f45d404f5b0 con 0x7f45d415e4f0 2024-03-18T00:26:20.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.203+0000 7f45ca7fc640 1 -- 172.21.15.81:0/3175339400 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f45cc05ccd0 con 0x7f45d415e4f0 2024-03-18T00:26:20.204 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 msgr2=0x7f45b806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 0x7f45b806e0c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f45c4036000 tx=0x7f45c4008030 comp rx=0 tx=0).stop 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 msgr2=0x7f45d41563e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00caa0 tx=0x7f45cc00cf60 comp rx=0 tx=0).stop 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 shutdown_connections 2024-03-18T00:26:20.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f45b806bc00 0x7f45b806e0c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45d415e4f0 0x7f45d41563e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f45d415e110 0x7f45d40b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 --2- 172.21.15.81:0/3175339400 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f45d406f0e0 0x7f45d41f3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 >> 172.21.15.81:0/3175339400 conn(0x7f45d40ccfb0 msgr2=0x7f45d40ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 shutdown_connections 2024-03-18T00:26:20.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20.205+0000 7f45dbac0640 1 -- 172.21.15.81:0/3175339400 wait complete. 2024-03-18T00:26:20.216 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-18T00:26:20.216 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T00:26:20.217 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T00:26:20.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.217 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-03-18T00:26:20.232 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T00:26:20.232 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T00:26:20.232 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T00:26:20.232 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.232 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42594sec preferred_lft 42594sec 2024-03-18T00:26:20.233 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether c2:24:87:58:6b:b0 brd ff:ff:ff:ff:ff:ff 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::4c51:5dff:fe57:7c/64 scope link 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether ee:c8:ce:71:e8:a6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ecc8:ceff:fe71:e8a6/64 scope link 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether c2:24:87:58:6b:b0 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T00:26:20.234 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::c024:87ff:fe58:6bb0/64 scope link 2024-03-18T00:26:20.235 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-03-18T00:26:20.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.235 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T00:26:20.297 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-03-18T00:26:20.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.299 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-03-18T00:26:20.355 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-03-18T00:26:20.355 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T00:26:20.355 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T00:26:20.356 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T00:26:20.356 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T00:26:20.356 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T00:26:20.356 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-03-18T00:26:20.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T00:26:20.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T00:26:20.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T00:26:20.357 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-03-18T00:26:20.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T00:26:20.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:26:20.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.490 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T00:26:20.505 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-18T00:26:20.505 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T00:26:20.505 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T00:26:20.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-03-18T00:26:20.572 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:26:20.572 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-18T00:26:20.627 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-18T00:26:20.627 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T00:26:20.627 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-18T00:26:20.681 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-18T00:26:20.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:26:20.766 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:26:20.766 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:26:20.785 INFO:teuthology.orchestra.run.smithi081.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: resolved to: "172.21.15.81:3300,172.21.15.136:3300,172.21.15.136:3301" 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: trying mount with new device syntax: 0@a215fc89-10fc-4af5-b2ff-78f3e4709ee3.cephfs=/ 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.81:3300/172.21.15.136:3300/172.21.15.136:3301" will pass to kernel 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: You just mounted a file system that supports labels which does not 2024-03-18T00:26:20.786 INFO:teuthology.orchestra.run.smithi081.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T00:26:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T00:26:20.787 INFO:teuthology.orchestra.run.smithi081.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T00:26:20.788 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T00:26:20.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-18T00:26:20.815 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T00:26:20.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T00:26:20.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:26:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T00:26:20.914 INFO:teuthology.orchestra.run.smithi081.stdout:client5212 2024-03-18T00:26:20.914 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:26:20.915 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T00:26:20.929 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=xfstests-dev 2024-03-18T00:26:20.985 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.MYwjXdaX5wxfstests-dev 2024-03-18T00:26:20.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:20.985 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.MYwjXdaX5wxfstests-dev) 2024-03-18T00:26:21.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:21.053 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.MYwjXdaX5wxfstests-dev) 2024-03-18T00:26:21.111 INFO:teuthology.orchestra.run.smithi081.stderr:Cloning into '/tmp/tmp.MYwjXdaX5wxfstests-dev'... 2024-03-18T00:26:21.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:21.817 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-18T00:26:21.878 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=test 2024-03-18T00:26:21.933 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.9eDfu8RZ3Ntest 2024-03-18T00:26:21.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:26:21.933 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-18T00:26:21.990 DEBUG:teuthology.orchestra.run.smithi081:> mktemp -d --suffix=scratch 2024-03-18T00:26:22.045 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:26:22.045 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-18T00:26:22.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-18T00:26:22.668 INFO:teuthology.orchestra.run.smithi081.stdout:Last metadata expiration check: 0:03:33 ago on Mon 18 Mar 2024 12:22:49 AM UTC. 2024-03-18T00:26:22.765 INFO:teuthology.orchestra.run.smithi081.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-18T00:26:22.766 INFO:teuthology.orchestra.run.smithi081.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T00:26:22.767 INFO:teuthology.orchestra.run.smithi081.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-18T00:26:22.768 INFO:teuthology.orchestra.run.smithi081.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-18T00:26:22.769 INFO:teuthology.orchestra.run.smithi081.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-18T00:26:22.771 INFO:teuthology.orchestra.run.smithi081.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-18T00:26:22.773 INFO:teuthology.orchestra.run.smithi081.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-18T00:26:22.774 INFO:teuthology.orchestra.run.smithi081.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-18T00:26:22.776 INFO:teuthology.orchestra.run.smithi081.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-18T00:26:22.779 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-18T00:26:22.780 INFO:teuthology.orchestra.run.smithi081.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-18T00:26:22.782 INFO:teuthology.orchestra.run.smithi081.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-18T00:26:22.783 INFO:teuthology.orchestra.run.smithi081.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-18T00:26:22.784 INFO:teuthology.orchestra.run.smithi081.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-18T00:26:22.785 INFO:teuthology.orchestra.run.smithi081.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-18T00:26:22.786 INFO:teuthology.orchestra.run.smithi081.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-18T00:26:22.787 INFO:teuthology.orchestra.run.smithi081.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-18T00:26:22.788 INFO:teuthology.orchestra.run.smithi081.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-18T00:26:22.789 INFO:teuthology.orchestra.run.smithi081.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-18T00:26:22.792 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-18T00:26:22.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:26:22.847 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:26:22.859 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-devel x86_64 5.14.0-427.el9 appstream 22 M 2024-03-18T00:26:22.863 INFO:teuthology.orchestra.run.smithi081.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-18T00:26:22.864 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-18T00:26:22.865 INFO:teuthology.orchestra.run.smithi081.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-18T00:26:22.866 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:Install 17 Packages 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 28 Packages 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 109 M 2024-03-18T00:26:22.867 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-03-18T00:26:23.380 INFO:teuthology.orchestra.run.smithi081.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 156 kB/s | 17 kB 00:00 2024-03-18T00:26:23.397 INFO:teuthology.orchestra.run.smithi081.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 115 kB/s | 14 kB 00:00 2024-03-18T00:26:23.489 INFO:teuthology.orchestra.run.smithi081.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 125 kB/s | 13 kB 00:00 2024-03-18T00:26:23.506 INFO:teuthology.orchestra.run.smithi081.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 135 kB/s | 15 kB 00:00 2024-03-18T00:26:23.689 INFO:teuthology.orchestra.run.smithi081.stdout:(5/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 107 kB/s | 20 kB 00:00 2024-03-18T00:26:23.715 INFO:teuthology.orchestra.run.smithi081.stdout:(6/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 73 kB/s | 15 kB 00:00 2024-03-18T00:26:23.799 INFO:teuthology.orchestra.run.smithi081.stdout:(7/45): fio-3.35-1.el9.x86_64.rpm 12 MB/s | 6.2 MB 00:00 2024-03-18T00:26:23.824 INFO:teuthology.orchestra.run.smithi081.stdout:(8/45): libcap-devel-2.48-9.el9.x86_64.rpm 246 kB/s | 33 kB 00:00 2024-03-18T00:26:23.857 INFO:teuthology.orchestra.run.smithi081.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 5.2 MB/s | 747 kB 00:00 2024-03-18T00:26:23.891 INFO:teuthology.orchestra.run.smithi081.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 1.5 MB/s | 144 kB 00:00 2024-03-18T00:26:23.916 INFO:teuthology.orchestra.run.smithi081.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-03-18T00:26:24.100 INFO:teuthology.orchestra.run.smithi081.stdout:(12/45): libnbd-1.18.1-3.el9.x86_64.rpm 797 kB/s | 166 kB 00:00 2024-03-18T00:26:24.183 INFO:teuthology.orchestra.run.smithi081.stdout:(13/45): gdbm-1.19-4.el9.x86_64.rpm 495 kB/s | 132 kB 00:00 2024-03-18T00:26:24.301 INFO:teuthology.orchestra.run.smithi081.stdout:(14/45): gdbm-devel-1.19-4.el9.x86_64.rpm 293 kB/s | 59 kB 00:00 2024-03-18T00:26:24.368 INFO:teuthology.orchestra.run.smithi081.stdout:(15/45): dump-0.4-0.51.b47.el9.x86_64.rpm 481 kB/s | 88 kB 00:00 2024-03-18T00:26:24.401 INFO:teuthology.orchestra.run.smithi081.stdout:(16/45): python-unversioned-command-3.9.18-3.el 250 kB/s | 8.3 kB 00:00 2024-03-18T00:26:24.443 INFO:teuthology.orchestra.run.smithi081.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 4.8 MB/s | 204 kB 00:00 2024-03-18T00:26:24.476 INFO:teuthology.orchestra.run.smithi081.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 757 kB/s | 25 kB 00:00 2024-03-18T00:26:24.494 INFO:teuthology.orchestra.run.smithi081.stdout:(19/45): indent-2.2.13-5.el9.x86_64.rpm 931 kB/s | 179 kB 00:00 2024-03-18T00:26:24.686 INFO:teuthology.orchestra.run.smithi081.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 3.2 MB/s | 619 kB 00:00 2024-03-18T00:26:24.794 INFO:teuthology.orchestra.run.smithi081.stdout:(21/45): python3-libs-3.9.18-3.el9.x86_64.rpm 23 MB/s | 7.3 MB 00:00 2024-03-18T00:26:25.070 INFO:teuthology.orchestra.run.smithi081.stdout:(22/45): device-mapper-event-1.02.197-2.el9.x86 125 kB/s | 34 kB 00:00 2024-03-18T00:26:25.153 INFO:teuthology.orchestra.run.smithi081.stdout:(23/45): device-mapper-1.02.197-2.el9.x86_64.rp 303 kB/s | 141 kB 00:00 2024-03-18T00:26:25.270 INFO:teuthology.orchestra.run.smithi081.stdout:(24/45): device-mapper-event-libs-1.02.197-2.el 161 kB/s | 32 kB 00:00 2024-03-18T00:26:25.337 INFO:teuthology.orchestra.run.smithi081.stdout:(25/45): device-mapper-libs-1.02.197-2.el9.x86_ 972 kB/s | 179 kB 00:00 2024-03-18T00:26:25.446 INFO:teuthology.orchestra.run.smithi081.stdout:(26/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 2.0 MB/s | 222 kB 00:00 2024-03-18T00:26:25.655 INFO:teuthology.orchestra.run.smithi081.stdout:(27/45): kernel-devel-5.14.0-427.el9.x86_64.rpm 12 MB/s | 22 MB 00:01 2024-03-18T00:26:25.680 INFO:teuthology.orchestra.run.smithi081.stdout:(28/45): libcom_err-1.46.5-5.el9.x86_64.rpm 113 kB/s | 26 kB 00:00 2024-03-18T00:26:25.789 INFO:teuthology.orchestra.run.smithi081.stdout:(29/45): libgomp-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 268 kB 00:00 2024-03-18T00:26:25.889 INFO:teuthology.orchestra.run.smithi081.stdout:(30/45): libss-1.46.5-5.el9.x86_64.rpm 318 kB/s | 32 kB 00:00 2024-03-18T00:26:25.956 INFO:teuthology.orchestra.run.smithi081.stdout:(31/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 1.5 MB/s | 1.0 MB 00:00 2024-03-18T00:26:26.305 INFO:teuthology.orchestra.run.smithi081.stdout:(32/45): libgcc-11.4.1-3.el9.x86_64.rpm 142 kB/s | 92 kB 00:00 2024-03-18T00:26:26.424 INFO:teuthology.orchestra.run.smithi081.stdout:(33/45): libstdc++-11.4.1-3.el9.x86_64.rpm 1.4 MB/s | 743 kB 00:00 2024-03-18T00:26:26.466 INFO:teuthology.orchestra.run.smithi081.stdout:(34/45): lvm2-2.03.23-2.el9.x86_64.rpm 3.0 MB/s | 1.5 MB 00:00 2024-03-18T00:26:26.533 INFO:teuthology.orchestra.run.smithi081.stdout:(35/45): make-4.3-8.el9.x86_64.rpm 4.8 MB/s | 536 kB 00:00 2024-03-18T00:26:26.908 INFO:teuthology.orchestra.run.smithi081.stdout:(36/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 1.7 MB/s | 1.0 MB 00:00 2024-03-18T00:26:27.025 INFO:teuthology.orchestra.run.smithi081.stdout:(37/45): cpp-11.4.1-3.el9.x86_64.rpm 19 MB/s | 11 MB 00:00 2024-03-18T00:26:27.083 INFO:teuthology.orchestra.run.smithi081.stdout:(38/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 820 kB/s | 47 kB 00:00 2024-03-18T00:26:27.167 INFO:teuthology.orchestra.run.smithi081.stdout:(39/45): git-2.43.0-1.el9.x86_64.rpm 609 kB/s | 51 kB 00:00 2024-03-18T00:26:27.442 INFO:teuthology.orchestra.run.smithi081.stdout:(40/45): git-core-2.43.0-1.el9.x86_64.rpm 16 MB/s | 4.4 MB 00:00 2024-03-18T00:26:27.668 INFO:teuthology.orchestra.run.smithi081.stdout:(41/45): git-core-doc-2.43.0-1.el9.noarch.rpm 13 MB/s | 2.9 MB 00:00 2024-03-18T00:26:27.818 INFO:teuthology.orchestra.run.smithi081.stdout:(42/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 16 MB/s | 2.4 MB 00:00 2024-03-18T00:26:27.876 INFO:teuthology.orchestra.run.smithi081.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 651 kB/s | 38 kB 00:00 2024-03-18T00:26:29.110 INFO:teuthology.orchestra.run.smithi081.stdout:(44/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 5.8 MB/s | 13 MB 00:02 2024-03-18T00:26:31.660 INFO:teuthology.orchestra.run.smithi081.stdout:(45/45): gcc-11.4.1-3.el9.x86_64.rpm 6.3 MB/s | 32 MB 00:05 2024-03-18T00:26:31.662 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-03-18T00:26:31.663 INFO:teuthology.orchestra.run.smithi081.stdout:Total 12 MB/s | 109 MB 00:08 2024-03-18T00:26:32.666 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-03-18T00:26:33.261 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-03-18T00:26:33.261 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-03-18T00:26:34.694 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-03-18T00:26:34.694 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-03-18T00:26:37.647 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-03-18T00:26:37.710 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-18T00:26:37.765 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-18T00:26:37.834 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-18T00:26:37.891 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-18T00:26:37.939 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-18T00:26:38.000 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-18T00:26:38.051 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-18T00:26:38.256 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-18T00:26:38.486 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-18T00:26:38.540 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-18T00:26:39.813 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-18T00:26:39.951 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-18T00:26:39.982 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-18T00:26:40.732 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-18T00:26:40.859 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-18T00:26:40.895 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-18T00:26:40.947 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-18T00:26:40.979 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-18T00:26:41.172 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-18T00:26:41.764 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-18T00:26:41.869 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-18T00:26:42.214 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-18T00:26:42.266 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-18T00:26:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-18T00:26:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-18T00:26:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-18T00:26:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-18T00:26:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-18T00:26:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-18T00:26:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-18T00:26:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-18T00:26:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-18T00:26:43.661 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-18T00:26:43.814 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-18T00:26:43.849 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-18T00:26:43.885 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-18T00:26:43.916 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-18T00:26:52.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:26:52.934 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:26:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-18T00:26:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-18T00:27:03.767 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-18T00:27:03.830 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-18T00:27:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-18T00:27:03.961 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-18T00:27:04.213 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-18T00:27:04.213 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-18T00:27:04.213 INFO:teuthology.orchestra.run.smithi081.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-18T00:27:04.213 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:27:04.511 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-18T00:27:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-18T00:27:04.612 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-18T00:27:04.657 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-18T00:27:04.698 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-18T00:27:04.724 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-18T00:27:04.752 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-18T00:27:04.785 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-18T00:27:04.818 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-18T00:27:04.860 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-18T00:27:04.885 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-18T00:27:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-18T00:27:04.910 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-18T00:27:04.957 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-18T00:27:04.987 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-18T00:27:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T00:27:04.994 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T00:27:05.057 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T00:27:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-18T00:27:05.138 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-18T00:27:05.163 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-18T00:27:05.188 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-18T00:27:05.193 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-18T00:27:05.223 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-18T00:27:05.247 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-18T00:27:05.273 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-18T00:27:05.298 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-18T00:27:05.323 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-18T00:27:05.349 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-18T00:27:05.408 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-18T00:27:05.461 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-18T00:27:05.485 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-18T00:27:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-18T00:27:05.511 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-18T00:27:05.590 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-18T00:27:05.622 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-18T00:27:05.646 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-18T00:27:05.672 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-18T00:27:05.739 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-18T00:27:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-18T00:27:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-18T00:27:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-18T00:27:08.231 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-devel-5.14.0-427.el9.x86_64 12/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-18T00:27:08.232 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-18T00:27:08.233 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-18T00:27:08.238 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-18T00:27:08.239 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-18T00:27:08.240 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-18T00:27:08.241 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.419 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: git-2.43.0-1.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libss-1.46.5-5.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: make-1:4.3-8.el9.x86_64 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-18T00:27:09.420 INFO:teuthology.orchestra.run.smithi081.stdout: python3-3.9.18-3.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-427.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: udftools-2.2-5.el9.x86_64 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:27:09.421 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-03-18T00:27:10.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd -m fsgqa 2024-03-18T00:27:10.203 INFO:teuthology.orchestra.run.smithi081.stderr:useradd: user 'fsgqa' already exists 2024-03-18T00:27:10.204 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-18T00:27:10.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo groupadd fsgqa 2024-03-18T00:27:10.270 INFO:teuthology.orchestra.run.smithi081.stderr:groupadd: group 'fsgqa' already exists 2024-03-18T00:27:10.271 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-18T00:27:10.272 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd fsgqa2 2024-03-18T00:27:10.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo useradd 123456-fsgqa 2024-03-18T00:27:11.414 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-18T00:27:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.515+0000 7efd5ca4b640 1 Processor -- start 2024-03-18T00:27:11.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.515+0000 7efd5ca4b640 1 -- start start 2024-03-18T00:27:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd581598e0 0x7efd580b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7efd58159cc0 0x7efd580d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd5806cc70 0x7efd580d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7efd580b3c80 con 0x7efd581598e0 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7efd5815fc70 con 0x7efd58159cc0 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5ca4b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd5815ff50 con 0x7efd5806cc70 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd581598e0 0x7efd580b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7efd581598e0 0x7efd580b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54134/0 (socket says 172.21.15.81:54134) 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd5659c640 1 -- 172.21.15.81:0/4056662516 learned_addr learned my addr 172.21.15.81:0/4056662516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd56d9d640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd5806cc70 0x7efd580d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.516+0000 7efd55d9b640 1 --2- 172.21.15.81:0/4056662516 >> v2:172.21.15.136:3300/0 conn(0x7efd58159cc0 0x7efd580d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 -- 172.21.15.81:0/4056662516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd5806cc70 msgr2=0x7efd580d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd5806cc70 0x7efd580d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 -- 172.21.15.81:0/4056662516 >> v2:172.21.15.136:3300/0 conn(0x7efd58159cc0 msgr2=0x7efd580d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 --2- 172.21.15.81:0/4056662516 >> v2:172.21.15.136:3300/0 conn(0x7efd58159cc0 0x7efd580d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 -- 172.21.15.81:0/4056662516 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd58160230 con 0x7efd581598e0 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5659c640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd581598e0 0x7efd580b3740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd5806f400 tx=0x7efd4802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda197d2c16a4fd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.517+0000 7efd5559a640 1 -- 172.21.15.81:0/4056662516 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48035020 con 0x7efd581598e0 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5559a640 1 -- 172.21.15.81:0/4056662516 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd48031870 con 0x7efd581598e0 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5559a640 1 -- 172.21.15.81:0/4056662516 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48031c40 con 0x7efd581598e0 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 -- 172.21.15.81:0/4056662516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd581598e0 msgr2=0x7efd580b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd581598e0 0x7efd580b3740 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7efd5806f400 tx=0x7efd4802b910 comp rx=0 tx=0).stop 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 -- 172.21.15.81:0/4056662516 shutdown_connections 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd5806cc70 0x7efd580d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/4056662516 >> v2:172.21.15.136:3300/0 conn(0x7efd58159cc0 0x7efd580d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/4056662516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd581598e0 0x7efd580b3740 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 -- 172.21.15.81:0/4056662516 >> 172.21.15.81:0/4056662516 conn(0x7efd5806b5e0 msgr2=0x7efd5806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:27:11.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 -- 172.21.15.81:0/4056662516 shutdown_connections 2024-03-18T00:27:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.518+0000 7efd5ca4b640 1 -- 172.21.15.81:0/4056662516 wait complete. 2024-03-18T00:27:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 Processor -- start 2024-03-18T00:27:11.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 -- start start 2024-03-18T00:27:11.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd581598e0 0x7efd58150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 0x7efd5809c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd580acd80 con 0x7efd5806cc70 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7efd581607f0 con 0x7efd581598e0 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5ca4b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7efd580acf00 con 0x7efd58159cc0 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54144/0 (socket says 172.21.15.81:54144) 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd5659c640 1 -- 172.21.15.81:0/2516589204 learned_addr learned my addr 172.21.15.81:0/2516589204 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.520+0000 7efd55d9b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd581598e0 0x7efd58150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd56d9d640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 0x7efd5809c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 -- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 msgr2=0x7efd5809c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 0x7efd5809c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 -- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd581598e0 msgr2=0x7efd58150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd581598e0 0x7efd58150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 -- 172.21.15.81:0/2516589204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd581542a0 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd56d9d640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 0x7efd5809c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5659c640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd48000c00 tx=0x7efd480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48035040 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd48030d00 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd5815d1a0 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd480456a0 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.521+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd5815d9e0 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.522+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd5804f5b0 con 0x7efd5806cc70 2024-03-18T00:27:11.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.522+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7efd48038020 con 0x7efd5806cc70 2024-03-18T00:27:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.523+0000 7efd46ffd640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 0x7efd3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.523+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7efd480acce0 con 0x7efd5806cc70 2024-03-18T00:27:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.523+0000 7efd55d9b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 0x7efd3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.523+0000 7efd55d9b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 0x7efd3806e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd580cf360 tx=0x7efd4c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.527+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7efd5815d1a0 con 0x7efd5806cc70 2024-03-18T00:27:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.766+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7efd5809d860 con 0x7efd5806cc70 2024-03-18T00:27:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.766+0000 7efd46ffd640 1 -- 172.21.15.81:0/2516589204 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1285 (secure 0 0 0) 0x7efd581542a0 con 0x7efd5806cc70 2024-03-18T00:27:11.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:27:11.767 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":1,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","modified":"2024-03-18T00:24:24.472958Z","created":"2024-03-18T00:24:24.472958Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:3300","nonce":0},{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3301","nonce":0},{"type":"v1","addr":"172.21.15.136:6790","nonce":0}]},"addr":"172.21.15.136:6790/0","public_addr":"172.21.15.136:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-18T00:27:11.767 INFO:teuthology.orchestra.run.smithi081.stderr:dumped monmap epoch 1 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 msgr2=0x7efd3806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 0x7efd3806e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efd580cf360 tx=0x7efd4c009190 comp rx=0 tx=0).stop 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 msgr2=0x7efd5815e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efd48000c00 tx=0x7efd480046c0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 shutdown_connections 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7efd58159cc0 0x7efd5809c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7efd581598e0 0x7efd58150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7efd3806bbd0 0x7efd3806e090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 --2- 172.21.15.81:0/2516589204 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd5806cc70 0x7efd5815e1e0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 >> 172.21.15.81:0/2516589204 conn(0x7efd5806b5e0 msgr2=0x7efd5815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:27:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 shutdown_connections 2024-03-18T00:27:11.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.768+0000 7efd5ca4b640 1 -- 172.21.15.81:0/2516589204 wait complete. 2024-03-18T00:27:11.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-18T00:27:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.881+0000 7f0a39f74640 1 Processor -- start 2024-03-18T00:27:11.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.881+0000 7f0a39f74640 1 -- start start 2024-03-18T00:27:11.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a39f74640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0a340ad800 0x7f0a340d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a39f74640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a39f74640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a3415ee60 con 0x7f0a3415ad40 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a39f74640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0a340d0a80 con 0x7f0a340ad800 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a39f74640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0a340b3b10 con 0x7f0a340d0620 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a337fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0a3415ad40 0x7f0a340b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37134/0 (socket says 172.21.15.81:37134) 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a337fe640 1 -- 172.21.15.81:0/3965631673 learned_addr learned my addr 172.21.15.81:0/3965631673 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/3965631673 >> v2:172.21.15.136:3300/0 conn(0x7f0a340ad800 0x7f0a340d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a33fff640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a327fc640 1 -- 172.21.15.81:0/3965631673 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1146647214 0 0) 0x7f0a3415ee60 con 0x7f0a3415ad40 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.882+0000 7f0a327fc640 1 -- 172.21.15.81:0/3965631673 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a1c003520 con 0x7f0a3415ad40 2024-03-18T00:27:11.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a32ffd640 1 -- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 msgr2=0x7f0a340722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a32ffd640 1 -- 172.21.15.81:0/3965631673 >> v1:172.21.15.81:6789/0 conn(0x7f0a3415ad40 legacy=0x7f0a340b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a32ffd640 1 -- 172.21.15.81:0/3965631673 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a3415f140 con 0x7f0a340ad800 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a33fff640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.883+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a340ad800 0x7f0a340d00e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097d0 tx=0x7f0a2802b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eea8b54a518d4dfa server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a327fc640 1 -- 172.21.15.81:0/3965631673 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28031770 con 0x7f0a340ad800 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a327fc640 1 -- 172.21.15.81:0/3965631673 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a28037070 con 0x7f0a340ad800 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a327fc640 1 -- 172.21.15.81:0/3965631673 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a28031b10 con 0x7f0a340ad800 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 -- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a340ad800 msgr2=0x7f0a340d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a340ad800 0x7f0a340d00e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a280097d0 tx=0x7f0a2802b810 comp rx=0 tx=0).stop 2024-03-18T00:27:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 -- 172.21.15.81:0/3965631673 shutdown_connections 2024-03-18T00:27:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 --2- 172.21.15.81:0/3965631673 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a340ad800 0x7f0a340d00e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 -- 172.21.15.81:0/3965631673 >> 172.21.15.81:0/3965631673 conn(0x7f0a3406b5e0 msgr2=0x7f0a3406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:27:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 -- 172.21.15.81:0/3965631673 shutdown_connections 2024-03-18T00:27:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.884+0000 7f0a39f74640 1 -- 172.21.15.81:0/3965631673 wait complete. 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.885+0000 7f0a39f74640 1 Processor -- start 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.885+0000 7f0a39f74640 1 -- start start 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a3415ad40 0x7f0a340b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3415b120 con 0x7f0a340ad800 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0a3415f700 con 0x7f0a3415ad40 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a39f74640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0a3415b2a0 con 0x7f0a340d0620 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54154/0 (socket says 172.21.15.81:54154) 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a337fe640 1 -- 172.21.15.81:0/4215857646 learned_addr learned my addr 172.21.15.81:0/4215857646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.886+0000 7f0a33fff640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a3415ad40 0x7f0a340b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 -- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 msgr2=0x7f0a340b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 -- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a3415ad40 msgr2=0x7f0a340b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a3415ad40 0x7f0a340b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 -- 172.21.15.81:0/4215857646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a34145c70 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a337fe640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a240010e0 tx=0x7f0a2400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24017070 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a24005d00 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a3409def0 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a24007310 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.887+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a341575a0 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.888+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a3404f5b0 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.888+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0a2401a070 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.889+0000 7f0a1bfff640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 0x7f0a2006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.889+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f0a24089cb0 con 0x7f0a340ad800 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.889+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 0x7f0a2006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T00:27:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.889+0000 7f0a32ffd640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 0x7f0a2006e0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a28036000 tx=0x7f0a2803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T00:27:11.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:11.893+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0a34145c70 con 0x7f0a340ad800 2024-03-18T00:27:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.132+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f0a34071ad0 con 0x7f0a340ad800 2024-03-18T00:27:12.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.132+0000 7f0a1bfff640 1 -- 172.21.15.81:0/4215857646 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) ==== 92+0+63 (secure 0 0 0) 0x7f0a240581e0 con 0x7f0a340ad800 2024-03-18T00:27:12.133 INFO:teuthology.orchestra.run.smithi081.stdout:[client.admin] 2024-03-18T00:27:12.133 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.134+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 msgr2=0x7f0a2006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.134+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 0x7f0a2006e0c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0a28036000 tx=0x7f0a2803d040 comp rx=0 tx=0).stop 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.134+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 msgr2=0x7f0a34145730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.134+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0a240010e0 tx=0x7f0a2400c8a0 comp rx=0 tx=0).stop 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 shutdown_connections 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0a3415ad40 0x7f0a340b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:12.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0a340d0620 0x7f0a340b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0a2006bc00 0x7f0a2006e0c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 --2- 172.21.15.81:0/4215857646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a340ad800 0x7f0a34145730 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T00:27:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 >> 172.21.15.81:0/4215857646 conn(0x7f0a3406b5e0 msgr2=0x7f0a34159fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T00:27:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 shutdown_connections 2024-03-18T00:27:12.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T00:27:12.135+0000 7f0a39f74640 1 -- 172.21.15.81:0/4215857646 wait complete. 2024-03-18T00:27:12.147 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:27:12.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/tmp/tmp.MYwjXdaX5wxfstests-dev/local.config 2024-03-18T00:27:12.174 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.81:6789:/test export TEST_DIR=/tmp/tmp.9eDfu8RZ3Ntest export SCRATCH_DEV=172.21.15.81:6789:/scratch export SCRATCH_MNT=/tmp/tmp.PuVtZgZAHXscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw==" 2024-03-18T00:27:12.174 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T00:27:12.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/tmp/tmp.MYwjXdaX5wxfstests-dev/ceph.exclude 2024-03-18T00:27:12.241 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo make) 2024-03-18T00:27:12.312 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize -cfi 2024-03-18T00:27:12.715 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-18T00:27:12.715 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.guess' 2024-03-18T00:27:12.719 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './config.sub' 2024-03-18T00:27:12.722 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './install-sh' 2024-03-18T00:27:12.726 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file './ltmain.sh' 2024-03-18T00:27:12.748 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-18T00:27:12.748 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-18T00:27:12.752 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-18T00:27:12.756 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-18T00:27:12.760 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-18T00:27:12.765 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-18T00:27:12.771 INFO:teuthology.orchestra.run.smithi081.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-18T00:27:12.772 INFO:teuthology.orchestra.run.smithi081.stdout:cp include/install-sh . 2024-03-18T00:27:12.773 INFO:teuthology.orchestra.run.smithi081.stdout:aclocal -I m4 2024-03-18T00:27:13.772 INFO:teuthology.orchestra.run.smithi081.stdout:autoheader 2024-03-18T00:27:14.056 INFO:teuthology.orchestra.run.smithi081.stdout:autoconf 2024-03-18T00:27:14.221 INFO:teuthology.orchestra.run.smithi081.stdout:./configure \ 2024-03-18T00:27:14.221 INFO:teuthology.orchestra.run.smithi081.stdout: --libexecdir=/usr/lib \ 2024-03-18T00:27:14.221 INFO:teuthology.orchestra.run.smithi081.stdout: --exec_prefix=/var/lib 2024-03-18T00:27:14.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-18T00:27:14.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-18T00:27:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to print strings... printf 2024-03-18T00:27:14.450 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... gcc 2024-03-18T00:27:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the C compiler works... yes 2024-03-18T00:27:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:checking for C compiler default output file name... a.out 2024-03-18T00:27:14.533 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of executables... 2024-03-18T00:27:14.581 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are cross compiling... no 2024-03-18T00:27:14.598 INFO:teuthology.orchestra.run.smithi081.stdout:checking for suffix of object files... o 2024-03-18T00:27:14.613 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... yes 2024-03-18T00:27:14.628 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... yes 2024-03-18T00:27:14.654 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-18T00:27:14.656 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-18T00:27:14.659 INFO:teuthology.orchestra.run.smithi081.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-18T00:27:14.660 INFO:teuthology.orchestra.run.smithi081.stdout:checking for egrep... /bin/grep -E 2024-03-18T00:27:14.661 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fgrep... /bin/grep -F 2024-03-18T00:27:14.664 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ld used by gcc... /bin/ld 2024-03-18T00:27:14.666 INFO:teuthology.orchestra.run.smithi081.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-18T00:27:14.673 INFO:teuthology.orchestra.run.smithi081.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-18T00:27:15.571 INFO:teuthology.orchestra.run.smithi081.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-18T00:27:15.571 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2024-03-18T00:27:15.583 INFO:teuthology.orchestra.run.smithi081.stdout:checking the maximum length of command line arguments... 1572864 2024-03-18T00:27:15.587 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-18T00:27:15.587 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking for /bin/ld option to reload object files... -r 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdump... objdump 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to recognize dependent libraries... pass_all 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlltool... no 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-18T00:27:15.588 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ar... ar 2024-03-18T00:27:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:checking for archiver @FILE support... @ 2024-03-18T00:27:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strip... strip 2024-03-18T00:27:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ranlib... ranlib 2024-03-18T00:27:15.636 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gawk... gawk 2024-03-18T00:27:15.700 INFO:teuthology.orchestra.run.smithi081.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-18T00:27:15.701 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sysroot... no 2024-03-18T00:27:15.704 INFO:teuthology.orchestra.run.smithi081.stdout:checking for a working dd... /bin/dd 2024-03-18T00:27:15.707 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-18T00:27:15.719 INFO:teuthology.orchestra.run.smithi081.stdout:checking for mt... no 2024-03-18T00:27:15.722 INFO:teuthology.orchestra.run.smithi081.stdout:checking if : is a manifest tool... no 2024-03-18T00:27:15.773 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to run the C preprocessor... gcc -E 2024-03-18T00:27:15.948 INFO:teuthology.orchestra.run.smithi081.stdout:checking for ANSI C header files... yes 2024-03-18T00:27:15.968 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/types.h... yes 2024-03-18T00:27:15.995 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/stat.h... yes 2024-03-18T00:27:16.018 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdlib.h... yes 2024-03-18T00:27:16.043 INFO:teuthology.orchestra.run.smithi081.stdout:checking for string.h... yes 2024-03-18T00:27:16.076 INFO:teuthology.orchestra.run.smithi081.stdout:checking for memory.h... yes 2024-03-18T00:27:16.101 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strings.h... yes 2024-03-18T00:27:16.138 INFO:teuthology.orchestra.run.smithi081.stdout:checking for inttypes.h... yes 2024-03-18T00:27:16.162 INFO:teuthology.orchestra.run.smithi081.stdout:checking for stdint.h... yes 2024-03-18T00:27:16.197 INFO:teuthology.orchestra.run.smithi081.stdout:checking for unistd.h... yes 2024-03-18T00:27:16.223 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dlfcn.h... yes 2024-03-18T00:27:16.226 INFO:teuthology.orchestra.run.smithi081.stdout:checking for objdir... .libs 2024-03-18T00:27:16.286 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-18T00:27:16.287 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-18T00:27:16.301 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-18T00:27:16.318 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc static flag -static works... no 2024-03-18T00:27:16.338 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... yes 2024-03-18T00:27:16.338 INFO:teuthology.orchestra.run.smithi081.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-18T00:27:16.345 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-18T00:27:16.370 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether -lc should be explicitly linked in... no 2024-03-18T00:27:16.427 INFO:teuthology.orchestra.run.smithi081.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-18T00:27:16.427 INFO:teuthology.orchestra.run.smithi081.stdout:checking how to hardcode library paths into programs... immediate 2024-03-18T00:27:16.428 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether stripping libraries is possible... yes 2024-03-18T00:27:16.428 INFO:teuthology.orchestra.run.smithi081.stdout:checking if libtool supports shared libraries... yes 2024-03-18T00:27:16.428 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build shared libraries... yes 2024-03-18T00:27:16.428 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether to build static libraries... yes 2024-03-18T00:27:16.434 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc... (cached) gcc 2024-03-18T00:27:16.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-18T00:27:16.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-18T00:27:16.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-18T00:27:16.449 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gmake... /usr/bin/gmake 2024-03-18T00:27:16.450 INFO:teuthology.orchestra.run.smithi081.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-18T00:27:16.450 INFO:teuthology.orchestra.run.smithi081.stdout:checking for tar... /bin/tar 2024-03-18T00:27:16.450 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gzip... /bin/gzip 2024-03-18T00:27:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether gcc -MM is supported... yes 2024-03-18T00:27:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sort... /bin/sort 2024-03-18T00:27:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether ln -s works... yes 2024-03-18T00:27:16.459 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpm... /bin/rpm 2024-03-18T00:27:16.462 INFO:teuthology.orchestra.run.smithi081.stdout:checking for rpmbuild... no 2024-03-18T00:27:16.486 INFO:teuthology.orchestra.run.smithi081.stdout:checking assert.h usability... yes 2024-03-18T00:27:16.495 INFO:teuthology.orchestra.run.smithi081.stdout:checking assert.h presence... yes 2024-03-18T00:27:16.495 INFO:teuthology.orchestra.run.smithi081.stdout:checking for assert.h... yes 2024-03-18T00:27:16.521 INFO:teuthology.orchestra.run.smithi081.stdout:checking bstring.h usability... no 2024-03-18T00:27:16.531 INFO:teuthology.orchestra.run.smithi081.stdout:checking bstring.h presence... no 2024-03-18T00:27:16.531 INFO:teuthology.orchestra.run.smithi081.stdout:checking for bstring.h... no 2024-03-18T00:27:16.556 INFO:teuthology.orchestra.run.smithi081.stdout:checking libgen.h usability... yes 2024-03-18T00:27:16.564 INFO:teuthology.orchestra.run.smithi081.stdout:checking libgen.h presence... yes 2024-03-18T00:27:16.564 INFO:teuthology.orchestra.run.smithi081.stdout:checking for libgen.h... yes 2024-03-18T00:27:16.598 INFO:teuthology.orchestra.run.smithi081.stdout:checking dirent.h usability... yes 2024-03-18T00:27:16.607 INFO:teuthology.orchestra.run.smithi081.stdout:checking dirent.h presence... yes 2024-03-18T00:27:16.607 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dirent.h... yes 2024-03-18T00:27:16.659 INFO:teuthology.orchestra.run.smithi081.stdout:checking errno.h usability... yes 2024-03-18T00:27:16.667 INFO:teuthology.orchestra.run.smithi081.stdout:checking errno.h presence... yes 2024-03-18T00:27:16.667 INFO:teuthology.orchestra.run.smithi081.stdout:checking for errno.h... yes 2024-03-18T00:27:16.697 INFO:teuthology.orchestra.run.smithi081.stdout:checking malloc.h usability... yes 2024-03-18T00:27:16.707 INFO:teuthology.orchestra.run.smithi081.stdout:checking malloc.h presence... yes 2024-03-18T00:27:16.707 INFO:teuthology.orchestra.run.smithi081.stdout:checking for malloc.h... yes 2024-03-18T00:27:16.734 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h usability... no 2024-03-18T00:27:16.744 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid.h presence... no 2024-03-18T00:27:16.744 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid.h... no 2024-03-18T00:27:16.778 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h usability... yes 2024-03-18T00:27:16.790 INFO:teuthology.orchestra.run.smithi081.stdout:checking uuid/uuid.h presence... yes 2024-03-18T00:27:16.790 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid/uuid.h... yes 2024-03-18T00:27:16.819 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h usability... no 2024-03-18T00:27:16.830 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/uuid.h presence... no 2024-03-18T00:27:16.830 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/uuid.h... no 2024-03-18T00:27:16.861 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/file.h usability... yes 2024-03-18T00:27:16.870 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/file.h presence... yes 2024-03-18T00:27:16.871 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/file.h... yes 2024-03-18T00:27:16.906 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fcntl.h usability... yes 2024-03-18T00:27:16.914 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fcntl.h presence... yes 2024-03-18T00:27:16.914 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fcntl.h... yes 2024-03-18T00:27:16.940 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/syssgi.h usability... no 2024-03-18T00:27:16.951 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/syssgi.h presence... no 2024-03-18T00:27:16.951 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/syssgi.h... no 2024-03-18T00:27:16.989 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/param.h usability... yes 2024-03-18T00:27:17.000 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/param.h presence... yes 2024-03-18T00:27:17.000 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/param.h... yes 2024-03-18T00:27:17.005 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/stat.h... (cached) yes 2024-03-18T00:27:17.041 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/statvfs.h usability... yes 2024-03-18T00:27:17.049 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/statvfs.h presence... yes 2024-03-18T00:27:17.049 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/statvfs.h... yes 2024-03-18T00:27:17.076 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/time.h usability... yes 2024-03-18T00:27:17.085 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/time.h presence... yes 2024-03-18T00:27:17.085 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/time.h... yes 2024-03-18T00:27:17.123 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/ioctl.h usability... yes 2024-03-18T00:27:17.132 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/ioctl.h presence... yes 2024-03-18T00:27:17.132 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/ioctl.h... yes 2024-03-18T00:27:17.163 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/wait.h usability... yes 2024-03-18T00:27:17.173 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/wait.h presence... yes 2024-03-18T00:27:17.173 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/wait.h... yes 2024-03-18T00:27:17.178 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/types.h... (cached) yes 2024-03-18T00:27:17.182 INFO:teuthology.orchestra.run.smithi081.stdout:checking for strings.h... (cached) yes 2024-03-18T00:27:17.210 INFO:teuthology.orchestra.run.smithi081.stdout:checking err.h usability... yes 2024-03-18T00:27:17.218 INFO:teuthology.orchestra.run.smithi081.stdout:checking err.h presence... yes 2024-03-18T00:27:17.219 INFO:teuthology.orchestra.run.smithi081.stdout:checking for err.h... yes 2024-03-18T00:27:17.245 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/falloc.h usability... yes 2024-03-18T00:27:17.253 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/falloc.h presence... yes 2024-03-18T00:27:17.253 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/falloc.h... yes 2024-03-18T00:27:17.279 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-18T00:27:17.290 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-18T00:27:17.290 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-18T00:27:17.314 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-18T00:27:17.324 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-18T00:27:17.324 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-18T00:27:17.348 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/platform_defs.h usability... no 2024-03-18T00:27:17.359 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/platform_defs.h presence... no 2024-03-18T00:27:17.359 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/platform_defs.h... no 2024-03-18T00:27:17.383 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfs/ioctl.h usability... no 2024-03-18T00:27:17.394 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfs/ioctl.h presence... no 2024-03-18T00:27:17.394 INFO:teuthology.orchestra.run.smithi081.stdout:checking for btrfs/ioctl.h... no 2024-03-18T00:27:17.418 INFO:teuthology.orchestra.run.smithi081.stdout:checking cifs/ioctl.h usability... no 2024-03-18T00:27:17.428 INFO:teuthology.orchestra.run.smithi081.stdout:checking cifs/ioctl.h presence... no 2024-03-18T00:27:17.429 INFO:teuthology.orchestra.run.smithi081.stdout:checking for cifs/ioctl.h... no 2024-03-18T00:27:17.454 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/mman.h usability... yes 2024-03-18T00:27:17.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/mman.h presence... yes 2024-03-18T00:27:17.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/mman.h... yes 2024-03-18T00:27:17.477 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xfs_log_format.h... no 2024-03-18T00:27:17.512 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare... no 2024-03-18T00:27:17.542 INFO:teuthology.orchestra.run.smithi081.stdout:checking for uuid_compare in -luuid... yes 2024-03-18T00:27:17.615 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xfs.h... yes 2024-03-18T00:27:17.628 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/libxfs.h... no 2024-03-18T00:27:17.643 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-18T00:27:17.672 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/xqm.h... yes 2024-03-18T00:27:17.719 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-18T00:27:17.742 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/handle.h usability... yes 2024-03-18T00:27:17.750 INFO:teuthology.orchestra.run.smithi081.stdout:checking xfs/handle.h presence... yes 2024-03-18T00:27:17.750 INFO:teuthology.orchestra.run.smithi081.stdout:checking for xfs/handle.h... yes 2024-03-18T00:27:17.781 INFO:teuthology.orchestra.run.smithi081.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-18T00:27:17.804 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/acl.h usability... yes 2024-03-18T00:27:17.813 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/acl.h presence... yes 2024-03-18T00:27:17.813 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/acl.h... yes 2024-03-18T00:27:17.836 INFO:teuthology.orchestra.run.smithi081.stdout:checking acl/libacl.h usability... yes 2024-03-18T00:27:17.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking acl/libacl.h presence... yes 2024-03-18T00:27:17.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking for acl/libacl.h... yes 2024-03-18T00:27:17.877 INFO:teuthology.orchestra.run.smithi081.stdout:checking for acl_init in -lacl... yes 2024-03-18T00:27:17.900 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm-ndbm.h usability... no 2024-03-18T00:27:17.910 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm-ndbm.h presence... no 2024-03-18T00:27:17.910 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gdbm-ndbm.h... no 2024-03-18T00:27:17.932 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm/ndbm.h usability... yes 2024-03-18T00:27:17.942 INFO:teuthology.orchestra.run.smithi081.stdout:checking gdbm/ndbm.h presence... yes 2024-03-18T00:27:17.942 INFO:teuthology.orchestra.run.smithi081.stdout:checking for gdbm/ndbm.h... yes 2024-03-18T00:27:17.976 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_open in -lgdbm... no 2024-03-18T00:27:18.010 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-18T00:27:18.044 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_store in -lgdbm... no 2024-03-18T00:27:18.077 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_close in -lgdbm... no 2024-03-18T00:27:18.129 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-18T00:27:18.161 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-18T00:27:18.192 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-18T00:27:18.224 INFO:teuthology.orchestra.run.smithi081.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-18T00:27:18.248 INFO:teuthology.orchestra.run.smithi081.stdout:checking libaio.h usability... yes 2024-03-18T00:27:18.258 INFO:teuthology.orchestra.run.smithi081.stdout:checking libaio.h presence... yes 2024-03-18T00:27:18.258 INFO:teuthology.orchestra.run.smithi081.stdout:checking for libaio.h... yes 2024-03-18T00:27:18.282 INFO:teuthology.orchestra.run.smithi081.stdout:checking liburing.h usability... no 2024-03-18T00:27:18.292 INFO:teuthology.orchestra.run.smithi081.stdout:checking liburing.h presence... no 2024-03-18T00:27:18.292 INFO:teuthology.orchestra.run.smithi081.stdout:checking for liburing.h... no 2024-03-18T00:27:18.321 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/capability.h usability... yes 2024-03-18T00:27:18.332 INFO:teuthology.orchestra.run.smithi081.stdout:checking sys/capability.h presence... yes 2024-03-18T00:27:18.332 INFO:teuthology.orchestra.run.smithi081.stdout:checking for sys/capability.h... yes 2024-03-18T00:27:18.356 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fiemap.h usability... yes 2024-03-18T00:27:18.364 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fiemap.h presence... yes 2024-03-18T00:27:18.364 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/fiemap.h... yes 2024-03-18T00:27:18.397 INFO:teuthology.orchestra.run.smithi081.stdout:checking for fallocate... yes 2024-03-18T00:27:18.431 INFO:teuthology.orchestra.run.smithi081.stdout:checking for open_by_handle_at... yes 2024-03-18T00:27:18.454 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fs.h usability... yes 2024-03-18T00:27:18.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/fs.h presence... yes 2024-03-18T00:27:18.463 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/fs.h... yes 2024-03-18T00:27:18.484 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfsutil.h usability... no 2024-03-18T00:27:18.495 INFO:teuthology.orchestra.run.smithi081.stdout:checking btrfsutil.h presence... no 2024-03-18T00:27:18.495 INFO:teuthology.orchestra.run.smithi081.stdout:checking for btrfsutil.h... no 2024-03-18T00:27:18.531 INFO:teuthology.orchestra.run.smithi081.stdout:checking for copy_file_range... yes 2024-03-18T00:27:18.567 INFO:teuthology.orchestra.run.smithi081.stdout:checking for SEEK_DATA... yes 2024-03-18T00:27:18.615 INFO:teuthology.orchestra.run.smithi081.stdout:checking for BMV_OF_SHARED... yes 2024-03-18T00:27:18.651 INFO:teuthology.orchestra.run.smithi081.stdout:checking for nftw... yes 2024-03-18T00:27:18.685 INFO:teuthology.orchestra.run.smithi081.stdout:checking for RLIMIT_NOFILE... yes 2024-03-18T00:27:18.717 INFO:teuthology.orchestra.run.smithi081.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-18T00:27:18.750 INFO:teuthology.orchestra.run.smithi081.stdout:checking for FICLONE... yes 2024-03-18T00:27:18.783 INFO:teuthology.orchestra.run.smithi081.stdout:checking for renameat2... yes 2024-03-18T00:27:18.816 INFO:teuthology.orchestra.run.smithi081.stdout:checking for reallocarray... yes 2024-03-18T00:27:18.846 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct mount_attr... yes 2024-03-18T00:27:18.878 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-18T00:27:18.909 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-18T00:27:18.941 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-18T00:27:18.973 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-18T00:27:19.005 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-18T00:27:19.037 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-18T00:27:19.068 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-18T00:27:19.094 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs.h usability... yes 2024-03-18T00:27:19.102 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs.h presence... yes 2024-03-18T00:27:19.103 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/btrfs.h... yes 2024-03-18T00:27:19.132 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-18T00:27:19.140 INFO:teuthology.orchestra.run.smithi081.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-18T00:27:19.140 INFO:teuthology.orchestra.run.smithi081.stdout:checking for linux/btrfs_tree.h... yes 2024-03-18T00:27:19.161 INFO:teuthology.orchestra.run.smithi081.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-18T00:27:19.182 INFO:teuthology.orchestra.run.smithi081.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-18T00:27:19.198 INFO:teuthology.orchestra.run.smithi081.stdout:configure: creating ./config.status 2024-03-18T00:27:19.495 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/builddefs 2024-03-18T00:27:19.505 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: creating include/config.h 2024-03-18T00:27:19.512 INFO:teuthology.orchestra.run.smithi081.stdout:config.status: executing libtool commands 2024-03-18T00:27:19.549 INFO:teuthology.orchestra.run.smithi081.stdout:Building include 2024-03-18T00:27:19.552 INFO:teuthology.orchestra.run.smithi081.stdout:Building lib 2024-03-18T00:27:19.555 INFO:teuthology.orchestra.run.smithi081.stdout: [LTDEP] 2024-03-18T00:27:19.687 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dataascii.lo 2024-03-18T00:27:19.793 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] databin.lo 2024-03-18T00:27:19.924 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] datapid.lo 2024-03-18T00:27:20.017 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] file_lock.lo 2024-03-18T00:27:20.148 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] forker.lo 2024-03-18T00:27:20.266 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pattern.lo 2024-03-18T00:27:20.377 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] open_flags.lo 2024-03-18T00:27:20.503 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] random_range.lo 2024-03-18T00:27:20.706 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] string_to_tokens.lo 2024-03-18T00:27:20.797 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] str_to_bytes.lo 2024-03-18T00:27:20.916 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] tlibio.lo 2024-03-18T00:27:21.131 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] write_log.lo 2024-03-18T00:27:21.344 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] random.lo 2024-03-18T00:27:21.439 INFO:teuthology.orchestra.run.smithi081.stdout: [LD] 2024-03-18T00:27:21.517 INFO:teuthology.orchestra.run.smithi081.stdout:Building ltp 2024-03-18T00:27:21.520 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:21.645 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] doio 2024-03-18T00:27:22.249 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsstress 2024-03-18T00:27:23.035 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:27:23.037 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:27:23.577 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsx 2024-03-18T00:27:24.266 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] growfiles 2024-03-18T00:27:24.729 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] iogen 2024-03-18T00:27:25.065 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-stress 2024-03-18T00:27:25.444 INFO:teuthology.orchestra.run.smithi081.stdout:Building src 2024-03-18T00:27:25.450 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:27.150 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:27.179 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:27.186 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:27.395 INFO:teuthology.orchestra.run.smithi081.stdout: [DEP] 2024-03-18T00:27:27.416 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirstress 2024-03-18T00:27:27.620 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fill 2024-03-18T00:27:27.751 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fill2 2024-03-18T00:27:27.949 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] getpagesize 2024-03-18T00:27:28.062 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] holes 2024-03-18T00:27:28.229 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] lstat64 2024-03-18T00:27:28.386 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] nametest 2024-03-18T00:27:28.594 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] permname 2024-03-18T00:27:28.764 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] randholes 2024-03-18T00:27:28.978 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] runas 2024-03-18T00:27:29.127 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] truncfile 2024-03-18T00:27:29.280 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] usemem 2024-03-18T00:27:29.410 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmapcat 2024-03-18T00:27:29.533 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] append_reader 2024-03-18T00:27:29.661 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] append_writer 2024-03-18T00:27:29.788 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirperf 2024-03-18T00:27:29.980 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] metaperf 2024-03-18T00:27:30.218 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] devzero 2024-03-18T00:27:30.367 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] feature 2024-03-18T00:27:30.553 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] alloc 2024-03-18T00:27:30.730 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fault 2024-03-18T00:27:30.867 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fstest 2024-03-18T00:27:31.073 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_access_root 2024-03-18T00:27:31.203 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] godown 2024-03-18T00:27:31.346 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] resvtest 2024-03-18T00:27:31.505 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] writemod 2024-03-18T00:27:31.626 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] writev_on_pagefault 2024-03-18T00:27:31.760 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] makeextents 2024-03-18T00:27:31.911 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] itrash 2024-03-18T00:27:32.038 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rename 2024-03-18T00:27:32.155 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] multi_open_unlink 2024-03-18T00:27:32.296 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] unwritten_sync 2024-03-18T00:27:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] genhashnames 2024-03-18T00:27:32.613 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_holes 2024-03-18T00:27:32.737 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_writev 2024-03-18T00:27:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_truncate_cmtime 2024-03-18T00:27:32.996 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dirhash_collide 2024-03-18T00:27:33.151 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_rename_overwrite 2024-03-18T00:27:33.269 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] holetest 2024-03-18T00:27:33.467 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_truncate_self 2024-03-18T00:27:33.586 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] af_unix 2024-03-18T00:27:33.713 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_stale_pmd 2024-03-18T00:27:33.841 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_cow_race 2024-03-18T00:27:33.982 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_fallocate 2024-03-18T00:27:34.111 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsync-err 2024-03-18T00:27:34.269 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_write_ro 2024-03-18T00:27:34.399 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-18T00:27:34.534 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-18T00:27:34.668 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_ofd_locks 2024-03-18T00:27:34.835 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_collision 2024-03-18T00:27:35.005 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmap-write-concurrent 2024-03-18T00:27:35.148 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_get_file_time 2024-03-18T00:27:35.272 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_create_short_dirs 2024-03-18T00:27:35.419 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_create_long_dirs 2024-03-18T00:27:35.560 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_enospc 2024-03-18T00:27:35.726 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_writev_overlap 2024-03-18T00:27:35.870 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] checkpoint_journal 2024-03-18T00:27:36.000 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mmap-rw-fault 2024-03-18T00:27:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] allocstale 2024-03-18T00:27:36.301 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_cow_memory_failure 2024-03-18T00:27:36.445 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fake-dump-rootino 2024-03-18T00:27:36.572 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-buf-fault 2024-03-18T00:27:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] rewinddir-test 2024-03-18T00:27:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] readdir-while-renames 2024-03-18T00:27:36.985 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfsctl 2024-03-18T00:27:37.147 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bstat 2024-03-18T00:27:37.326 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mtab 2024-03-18T00:27:37.484 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] getdevicesize 2024-03-18T00:27:37.605 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] preallo_rw_pattern_reader 2024-03-18T00:27:37.740 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] preallo_rw_pattern_writer 2024-03-18T00:27:37.873 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] ftrunc 2024-03-18T00:27:37.998 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] trunc 2024-03-18T00:27:38.135 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fs_perms 2024-03-18T00:27:38.274 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] testx 2024-03-18T00:27:38.385 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] looptest 2024-03-18T00:27:38.552 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] locktest 2024-03-18T00:27:38.830 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] unwritten_mmap 2024-03-18T00:27:38.968 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_unlink_test 2024-03-18T00:27:39.141 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] deduperace 2024-03-18T00:27:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_unlink_test_modified 2024-03-18T00:27:39.478 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_offset 2024-03-18T00:27:39.603 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_futimens 2024-03-18T00:27:39.721 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_immutable 2024-03-18T00:27:40.275 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] stale_handle 2024-03-18T00:27:40.420 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] pwrite_mmap_blocked 2024-03-18T00:27:40.549 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_offset2 2024-03-18T00:27:40.714 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] seek_sanity_test 2024-03-18T00:27:41.112 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] seek_copy_test 2024-03-18T00:27:41.262 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_1 2024-03-18T00:27:41.387 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_2 2024-03-18T00:27:41.515 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fsync-tester 2024-03-18T00:27:41.735 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] nsexec 2024-03-18T00:27:41.886 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] cloner 2024-03-18T00:27:42.038 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] renameat2 2024-03-18T00:27:42.179 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_getcwd 2024-03-18T00:27:42.315 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] e4compact 2024-03-18T00:27:42.488 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] test-nextquota 2024-03-18T00:27:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] punch-alternating 2024-03-18T00:27:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-18T00:27:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] listxattr 2024-03-18T00:27:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-interleaved 2024-03-18T00:27:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_dir_type 2024-03-18T00:27:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dio-invalidate-cache 2024-03-18T00:27:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] stat_test 2024-03-18T00:27:43.751 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_encrypted_d_revalidate 2024-03-18T00:27:43.891 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] attr_replace_test 2024-03-18T00:27:44.029 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] swapon 2024-03-18T00:27:44.168 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mkswap 2024-03-18T00:27:44.297 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_attr_corruption 2024-03-18T00:27:44.424 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_open_tmpfiles 2024-03-18T00:27:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fscrypt-crypt-util 2024-03-18T00:27:45.163 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] bulkstat_null_ocount 2024-03-18T00:27:45.298 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] splice-test 2024-03-18T00:27:45.452 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] chprojid_fail 2024-03-18T00:27:45.589 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] detached_mounts_propagation 2024-03-18T00:27:45.746 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] ext4_resize 2024-03-18T00:27:45.872 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_readdir_3 2024-03-18T00:27:46.040 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] splice2pipe 2024-03-18T00:27:46.178 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] uuid_ioctl 2024-03-18T00:27:46.309 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-18T00:27:46.448 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fiemap-tester 2024-03-18T00:27:46.679 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_stripealign 2024-03-18T00:27:46.810 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] open_by_handle 2024-03-18T00:27:47.030 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] dbtest 2024-03-18T00:27:47.245 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_mmap_dio 2024-03-18T00:27:47.381 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] xfsfind 2024-03-18T00:27:47.549 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] t_reflink_read_race 2024-03-18T00:27:47.713 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] fssum 2024-03-18T00:27:48.111 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2024-03-18T00:27:48.116 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] replay-log 2024-03-18T00:27:48.395 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2024-03-18T00:27:48.398 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2024-03-18T00:27:48.404 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aiocp 2024-03-18T00:27:48.603 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-18T00:27:48.745 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-append-write-read-race 2024-03-18T00:27:48.895 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-cow-race 2024-03-18T00:27:49.025 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-cycle-write 2024-03-18T00:27:49.183 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-eof-race 2024-03-18T00:27:49.339 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-extend-stat 2024-03-18T00:27:49.479 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-fcntl-race 2024-03-18T00:27:49.619 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-hole-filling-race 2024-03-18T00:27:49.744 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-invalidate-failure 2024-03-18T00:27:49.880 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-invalidate-readahead 2024-03-18T00:27:50.022 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aiodio_sparse2 2024-03-18T00:27:50.210 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-subblock-eof-read 2024-03-18T00:27:50.330 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-dio-write-verify 2024-03-18T00:27:50.498 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-18T00:27:50.611 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-18T00:27:50.722 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] aio-last-ref-held-by-io 2024-03-18T00:27:50.870 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2024-03-18T00:27:50.875 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] vfstest 2024-03-18T00:27:53.171 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:27:53.174 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:27:54.185 INFO:teuthology.orchestra.run.smithi081.stdout: [CC] mount-idmapped 2024-03-18T00:27:54.522 INFO:teuthology.orchestra.run.smithi081.stdout:Building m4 2024-03-18T00:27:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:Building common 2024-03-18T00:27:54.528 INFO:teuthology.orchestra.run.smithi081.stdout:Building tests 2024-03-18T00:27:54.533 INFO:teuthology.orchestra.run.smithi081.stdout:Building btrfs 2024-03-18T00:27:54.539 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/btrfs/group.list 2024-03-18T00:27:54.599 INFO:teuthology.orchestra.run.smithi081.stdout:Building ceph 2024-03-18T00:27:54.604 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ceph/group.list 2024-03-18T00:27:54.617 INFO:teuthology.orchestra.run.smithi081.stdout:Building cifs 2024-03-18T00:27:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/cifs/group.list 2024-03-18T00:27:54.634 INFO:teuthology.orchestra.run.smithi081.stdout:Building ext4 2024-03-18T00:27:54.639 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ext4/group.list 2024-03-18T00:27:54.676 INFO:teuthology.orchestra.run.smithi081.stdout:Building f2fs 2024-03-18T00:27:54.681 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/f2fs/group.list 2024-03-18T00:27:54.697 INFO:teuthology.orchestra.run.smithi081.stdout:Building generic 2024-03-18T00:27:54.704 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/generic/group.list 2024-03-18T00:27:54.798 INFO:teuthology.orchestra.run.smithi081.stdout:Building nfs 2024-03-18T00:27:54.802 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/nfs/group.list 2024-03-18T00:27:54.816 INFO:teuthology.orchestra.run.smithi081.stdout:Building ocfs2 2024-03-18T00:27:54.821 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ocfs2/group.list 2024-03-18T00:27:54.834 INFO:teuthology.orchestra.run.smithi081.stdout:Building overlay 2024-03-18T00:27:54.839 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/overlay/group.list 2024-03-18T00:27:54.878 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2024-03-18T00:27:54.883 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/perf/group.list 2024-03-18T00:27:54.894 INFO:teuthology.orchestra.run.smithi081.stdout:Building selftest 2024-03-18T00:27:54.899 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/selftest/group.list 2024-03-18T00:27:54.911 INFO:teuthology.orchestra.run.smithi081.stdout:Building shared 2024-03-18T00:27:54.916 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/shared/group.list 2024-03-18T00:27:54.933 INFO:teuthology.orchestra.run.smithi081.stdout:Building tmpfs 2024-03-18T00:27:54.938 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/tmpfs/group.list 2024-03-18T00:27:54.950 INFO:teuthology.orchestra.run.smithi081.stdout:Building udf 2024-03-18T00:27:54.955 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/udf/group.list 2024-03-18T00:27:54.966 INFO:teuthology.orchestra.run.smithi081.stdout:Building xfs 2024-03-18T00:27:54.972 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/xfs/group.list 2024-03-18T00:27:55.068 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo make install) 2024-03-18T00:27:55.105 INFO:teuthology.orchestra.run.smithi081.stdout:Building include 2024-03-18T00:27:55.108 INFO:teuthology.orchestra.run.smithi081.stdout:Building lib 2024-03-18T00:27:55.112 INFO:teuthology.orchestra.run.smithi081.stdout:Building ltp 2024-03-18T00:27:55.116 INFO:teuthology.orchestra.run.smithi081.stdout:Building src 2024-03-18T00:27:55.149 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2024-03-18T00:27:55.152 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2024-03-18T00:27:55.156 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2024-03-18T00:27:55.159 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2024-03-18T00:27:55.163 INFO:teuthology.orchestra.run.smithi081.stdout:Building m4 2024-03-18T00:27:55.166 INFO:teuthology.orchestra.run.smithi081.stdout:Building common 2024-03-18T00:27:55.170 INFO:teuthology.orchestra.run.smithi081.stdout:Building tests 2024-03-18T00:27:55.175 INFO:teuthology.orchestra.run.smithi081.stdout:Building btrfs 2024-03-18T00:27:55.180 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/btrfs/group.list 2024-03-18T00:27:55.239 INFO:teuthology.orchestra.run.smithi081.stdout:Building ceph 2024-03-18T00:27:55.244 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ceph/group.list 2024-03-18T00:27:55.258 INFO:teuthology.orchestra.run.smithi081.stdout:Building cifs 2024-03-18T00:27:55.263 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/cifs/group.list 2024-03-18T00:27:55.274 INFO:teuthology.orchestra.run.smithi081.stdout:Building ext4 2024-03-18T00:27:55.279 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ext4/group.list 2024-03-18T00:27:55.316 INFO:teuthology.orchestra.run.smithi081.stdout:Building f2fs 2024-03-18T00:27:55.321 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/f2fs/group.list 2024-03-18T00:27:55.337 INFO:teuthology.orchestra.run.smithi081.stdout:Building generic 2024-03-18T00:27:55.343 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/generic/group.list 2024-03-18T00:27:55.436 INFO:teuthology.orchestra.run.smithi081.stdout:Building nfs 2024-03-18T00:27:55.440 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/nfs/group.list 2024-03-18T00:27:55.454 INFO:teuthology.orchestra.run.smithi081.stdout:Building ocfs2 2024-03-18T00:27:55.459 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ocfs2/group.list 2024-03-18T00:27:55.471 INFO:teuthology.orchestra.run.smithi081.stdout:Building overlay 2024-03-18T00:27:55.476 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/overlay/group.list 2024-03-18T00:27:55.515 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2024-03-18T00:27:55.520 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/perf/group.list 2024-03-18T00:27:55.531 INFO:teuthology.orchestra.run.smithi081.stdout:Building selftest 2024-03-18T00:27:55.536 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/selftest/group.list 2024-03-18T00:27:55.548 INFO:teuthology.orchestra.run.smithi081.stdout:Building shared 2024-03-18T00:27:55.553 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/shared/group.list 2024-03-18T00:27:55.569 INFO:teuthology.orchestra.run.smithi081.stdout:Building tmpfs 2024-03-18T00:27:55.574 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/tmpfs/group.list 2024-03-18T00:27:55.587 INFO:teuthology.orchestra.run.smithi081.stdout:Building udf 2024-03-18T00:27:55.592 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/udf/group.list 2024-03-18T00:27:55.603 INFO:teuthology.orchestra.run.smithi081.stdout:Building xfs 2024-03-18T00:27:55.609 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/xfs/group.list 2024-03-18T00:27:55.701 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-18T00:27:55.703 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T00:27:55.703 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-18T00:27:55.705 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T00:27:55.705 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-18T00:27:55.707 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-18T00:27:55.716 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-18T00:27:55.782 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-18T00:27:55.790 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-18T00:27:55.806 INFO:teuthology.orchestra.run.smithi081.stdout:Building log-writes 2024-03-18T00:27:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:Building perf 2024-03-18T00:27:55.813 INFO:teuthology.orchestra.run.smithi081.stdout:Building aio-dio-regress 2024-03-18T00:27:55.817 INFO:teuthology.orchestra.run.smithi081.stdout:Building vfs 2024-03-18T00:27:55.820 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C log-writes install 2024-03-18T00:27:55.821 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-18T00:27:55.830 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-18T00:27:55.838 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C perf install 2024-03-18T00:27:55.839 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-18T00:27:55.847 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-18T00:27:55.868 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-18T00:27:55.870 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-18T00:27:55.878 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-18T00:27:55.925 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake -C vfs install 2024-03-18T00:27:55.926 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-18T00:27:55.935 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-18T00:27:55.946 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-18T00:27:55.954 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-18T00:27:57.062 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-18T00:27:57.153 INFO:teuthology.orchestra.run.smithi081.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-18T00:27:57.176 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-18T00:27:57.178 INFO:teuthology.orchestra.run.smithi081.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T00:27:57.178 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-18T00:27:57.180 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-18T00:27:57.188 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-18T00:27:57.313 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-18T00:27:57.314 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/btrfs/ install 2024-03-18T00:27:57.317 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/btrfs/group.list 2024-03-18T00:27:57.377 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-18T00:27:57.385 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-18T00:27:58.154 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-18T00:27:58.162 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-18T00:27:58.932 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ceph/ install 2024-03-18T00:27:58.934 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ceph/group.list 2024-03-18T00:27:58.947 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-18T00:27:58.955 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-18T00:27:58.973 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-18T00:27:58.981 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-18T00:27:58.999 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/cifs/ install 2024-03-18T00:27:59.001 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/cifs/group.list 2024-03-18T00:27:59.012 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-18T00:27:59.020 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-18T00:27:59.029 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-18T00:27:59.037 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-18T00:27:59.045 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ext4/ install 2024-03-18T00:27:59.048 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ext4/group.list 2024-03-18T00:27:59.084 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-18T00:27:59.092 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-18T00:27:59.258 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-18T00:27:59.266 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-18T00:27:59.442 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/f2fs/ install 2024-03-18T00:27:59.444 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/f2fs/group.list 2024-03-18T00:27:59.460 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-18T00:27:59.468 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-18T00:27:59.478 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-18T00:27:59.486 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-18T00:27:59.497 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/generic/ install 2024-03-18T00:27:59.500 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/generic/group.list 2024-03-18T00:27:59.594 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-18T00:27:59.603 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-18T00:28:01.388 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-18T00:28:01.396 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-18T00:28:03.207 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/nfs/ install 2024-03-18T00:28:03.209 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/nfs/group.list 2024-03-18T00:28:03.222 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-18T00:28:03.230 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-18T00:28:03.238 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-18T00:28:03.251 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-18T00:28:03.260 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ocfs2/ install 2024-03-18T00:28:03.262 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/ocfs2/group.list 2024-03-18T00:28:03.274 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-18T00:28:03.282 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-18T00:28:03.290 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-18T00:28:03.298 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-18T00:28:03.306 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/overlay/ install 2024-03-18T00:28:03.308 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/overlay/group.list 2024-03-18T00:28:03.347 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-18T00:28:03.355 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-18T00:28:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-18T00:28:03.618 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-18T00:28:03.875 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/perf/ install 2024-03-18T00:28:03.877 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/perf/group.list 2024-03-18T00:28:03.887 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-18T00:28:03.895 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-18T00:28:03.904 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-18T00:28:03.912 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-18T00:28:03.920 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/selftest/ install 2024-03-18T00:28:03.922 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/selftest/group.list 2024-03-18T00:28:03.934 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-18T00:28:03.942 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-18T00:28:03.961 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-18T00:28:03.970 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-18T00:28:03.990 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/shared/ install 2024-03-18T00:28:03.992 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/shared/group.list 2024-03-18T00:28:04.008 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-18T00:28:04.016 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-18T00:28:04.029 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-18T00:28:04.037 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-18T00:28:04.050 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/tmpfs/ install 2024-03-18T00:28:04.053 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/tmpfs/group.list 2024-03-18T00:28:04.065 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-18T00:28:04.073 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-18T00:28:04.081 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-18T00:28:04.089 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-18T00:28:04.097 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/udf/ install 2024-03-18T00:28:04.100 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/udf/group.list 2024-03-18T00:28:04.110 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-18T00:28:04.118 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-18T00:28:04.126 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-18T00:28:04.134 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-18T00:28:04.142 INFO:teuthology.orchestra.run.smithi081.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/xfs/ install 2024-03-18T00:28:04.145 INFO:teuthology.orchestra.run.smithi081.stdout: [GROUP] /tmp/tmp.MYwjXdaX5wxfstests-dev/tests/xfs/group.list 2024-03-18T00:28:04.241 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-18T00:28:04.249 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-18T00:28:05.950 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-18T00:28:05.955 INFO:teuthology.orchestra.run.smithi081.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-18T00:28:07.668 INFO:teuthology.orchestra.run.smithi081.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-18T00:28:07.676 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-18T00:28:07.685 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-18T00:28:07.692 INFO:teuthology.orchestra.run.smithi081.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-18T00:28:07.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T00:28:07.703 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec ls tests/generic) 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:001 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:001.out 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:002 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:002.out 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:003 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:003.out 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:004 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:004.out 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:005 2024-03-18T00:28:07.770 INFO:teuthology.orchestra.run.smithi081.stdout:005.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:006 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:006.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:007 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:007.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:008 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:008.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:009 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:009.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:010 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:010.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:011 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:011.out 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:012 2024-03-18T00:28:07.771 INFO:teuthology.orchestra.run.smithi081.stdout:012.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:013 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:013.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:014 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:014.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:015 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:015.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:016 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:016.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:017 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:017.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:018 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:018.out 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:019 2024-03-18T00:28:07.772 INFO:teuthology.orchestra.run.smithi081.stdout:019.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:020 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:020.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:021 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:021.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:022 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:022.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:023 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:023.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:024 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:024.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:025 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:025.out 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:026 2024-03-18T00:28:07.773 INFO:teuthology.orchestra.run.smithi081.stdout:026.out 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:027 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:027.out 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:028 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:028.out 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:029 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:029.out 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:030 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:030.out 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:031 2024-03-18T00:28:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:031.out 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:032 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:032.out 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:033 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:033.out 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:034 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:034.out 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:035 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:035.cfg 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:035.out.default 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:035.out.nfs 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:036 2024-03-18T00:28:07.775 INFO:teuthology.orchestra.run.smithi081.stdout:036.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:037 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:037.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:038 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:038.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:039 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:039.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:040 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:040.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:041 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:041.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:042 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:042.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:043 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:043.out 2024-03-18T00:28:07.776 INFO:teuthology.orchestra.run.smithi081.stdout:044 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:044.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:045 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:045.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:046 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:046.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:047 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:047.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:048 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:048.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:049 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:049.out 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:050 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:050.cfg 2024-03-18T00:28:07.777 INFO:teuthology.orchestra.run.smithi081.stdout:050.out.default 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:050.out.nojournal 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:050.out.xfsquota 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:051 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:051.out 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:052 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:052.out 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:053 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:053.out 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:054 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:054.out 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:055 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:055.out 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:056 2024-03-18T00:28:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:056.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:057 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:057.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:058 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:058.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:059 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:059.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:060 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:060.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:061 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:061.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:062 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:062.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:063 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:063.out 2024-03-18T00:28:07.779 INFO:teuthology.orchestra.run.smithi081.stdout:064 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:064.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:065 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:065.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:066 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:066.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:067 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:067.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:068 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:068.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:069 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:069.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:070 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:070.out 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:071 2024-03-18T00:28:07.780 INFO:teuthology.orchestra.run.smithi081.stdout:071.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:072 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:072.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:073 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:073.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:074 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:074.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:075 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:075.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:076 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:076.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:077 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:077.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:078 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:078.out 2024-03-18T00:28:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:079 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:079.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:080 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:080.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:081 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:081.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:082 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:082.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:083 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:083.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:084 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:084.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:085 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:085.out 2024-03-18T00:28:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:086 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:086.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:087 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:087.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:088 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:088.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:089 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:089.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:090 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:090.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:091 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:091.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:092 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:092.out 2024-03-18T00:28:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:093 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:093.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:094 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:094.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:095 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:095.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:096 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:096.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:097 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:097.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:098 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:098.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:099 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:099.out 2024-03-18T00:28:07.784 INFO:teuthology.orchestra.run.smithi081.stdout:100 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:100.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:101 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:101.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:102 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:102.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:103 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:103.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:104 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:104.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:105 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:105.out 2024-03-18T00:28:07.785 INFO:teuthology.orchestra.run.smithi081.stdout:106 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:106.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:107 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:107.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:108 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:108.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:109 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:109.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:110 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:110.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:111 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:111.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:112 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:112.out 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:113 2024-03-18T00:28:07.786 INFO:teuthology.orchestra.run.smithi081.stdout:113.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:114 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:114.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:115 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:115.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:116 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:116.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:117 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:117.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:118 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:118.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:119 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:119.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:120 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:120.out 2024-03-18T00:28:07.787 INFO:teuthology.orchestra.run.smithi081.stdout:121 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:121.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:122 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:122.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:123 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:123.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:124 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:124.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:125 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:125.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:126 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:126.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:127 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:127.out 2024-03-18T00:28:07.788 INFO:teuthology.orchestra.run.smithi081.stdout:128 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:128.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:129 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:129.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:130 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:130.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:131 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:131.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:132 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:132.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:133 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:133.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:134 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:134.out 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:135 2024-03-18T00:28:07.789 INFO:teuthology.orchestra.run.smithi081.stdout:135.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:136 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:136.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:137 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:137.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:138 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:138.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:139 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:139.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:140 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:140.out 2024-03-18T00:28:07.790 INFO:teuthology.orchestra.run.smithi081.stdout:141 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:141.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:142 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:142.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:143 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:143.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:144 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:144.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:145 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:145.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:146 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:146.out 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:147 2024-03-18T00:28:07.791 INFO:teuthology.orchestra.run.smithi081.stdout:147.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:148 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:148.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:149 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:149.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:150 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:150.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:151 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:151.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:152 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:152.out 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:153 2024-03-18T00:28:07.792 INFO:teuthology.orchestra.run.smithi081.stdout:153.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:154 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:154.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:155 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:155.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:156 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:156.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:157 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:157.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:158 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:158.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:159 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:159.out 2024-03-18T00:28:07.793 INFO:teuthology.orchestra.run.smithi081.stdout:160 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:160.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:161 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:161.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:162 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:162.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:163 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:163.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:164 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:164.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:165 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:165.out 2024-03-18T00:28:07.794 INFO:teuthology.orchestra.run.smithi081.stdout:166 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:166.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:167 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:167.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:168 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:168.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:169 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:169.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:170 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:170.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:171 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:171.out 2024-03-18T00:28:07.795 INFO:teuthology.orchestra.run.smithi081.stdout:172 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:172.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:173 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:173.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:174 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:174.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:175 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:175.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:176 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:176.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:177 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:177.out 2024-03-18T00:28:07.796 INFO:teuthology.orchestra.run.smithi081.stdout:178 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:178.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:179 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:179.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:180 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:180.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:181 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:181.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:182 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:182.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:183 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:183.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:184 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:184.out 2024-03-18T00:28:07.797 INFO:teuthology.orchestra.run.smithi081.stdout:185 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:185.out 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:186 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:186.out 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:187 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:187.out 2024-03-18T00:28:07.798 INFO:teuthology.orchestra.run.smithi081.stdout:188 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:188.out 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:189 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:189.out 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:190 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:190.out 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:191 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:191.out 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:192 2024-03-18T00:28:07.799 INFO:teuthology.orchestra.run.smithi081.stdout:192.out 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:193 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:193.out 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:194 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:194.out 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:195 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:195.out 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:196 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:196.out 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:197 2024-03-18T00:28:07.800 INFO:teuthology.orchestra.run.smithi081.stdout:197.out 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:198 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:198.out 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:199 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:199.out 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:200 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:200.out 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:201 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:201.out 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:202 2024-03-18T00:28:07.801 INFO:teuthology.orchestra.run.smithi081.stdout:202.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:203 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:203.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:204 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:204.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:205 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:205.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:206 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:206.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:207 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:207.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:208 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:208.out 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:209 2024-03-18T00:28:07.802 INFO:teuthology.orchestra.run.smithi081.stdout:209.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:210 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:210.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:211 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:211.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:212 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:212.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:213 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:213.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:214 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:214.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:215 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:215.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:216 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:216.out 2024-03-18T00:28:07.803 INFO:teuthology.orchestra.run.smithi081.stdout:217 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:217.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:218 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:218.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:219 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:219.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:220 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:220.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:221 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:221.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:222 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:222.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:223 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:223.out 2024-03-18T00:28:07.804 INFO:teuthology.orchestra.run.smithi081.stdout:224 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:224.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:225 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:225.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:226 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:226.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:227 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:227.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:228 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:228.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:229 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:229.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:230 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:230.out 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:231 2024-03-18T00:28:07.805 INFO:teuthology.orchestra.run.smithi081.stdout:231.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:232 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:232.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:233 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:233.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:234 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:234.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:235 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:235.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:236 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:236.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:237 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:237.out 2024-03-18T00:28:07.806 INFO:teuthology.orchestra.run.smithi081.stdout:238 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:238.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:239 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:239.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:240 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:240.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:241 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:241.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:242 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:242.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:243 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:243.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:244 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:244.out 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:245 2024-03-18T00:28:07.807 INFO:teuthology.orchestra.run.smithi081.stdout:245.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:246 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:246.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:247 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:247.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:248 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:248.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:249 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:249.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:250 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:250.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:251 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:251.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:252 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:252.out 2024-03-18T00:28:07.808 INFO:teuthology.orchestra.run.smithi081.stdout:253 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:253.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:254 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:254.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:255 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:255.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:256 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:256.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:257 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:257.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:258 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:258.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:259 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:259.out 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:260 2024-03-18T00:28:07.809 INFO:teuthology.orchestra.run.smithi081.stdout:260.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:261 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:261.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:262 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:262.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:263 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:263.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:264 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:264.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:265 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:265.out 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:266 2024-03-18T00:28:07.810 INFO:teuthology.orchestra.run.smithi081.stdout:266.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:267 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:267.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:268 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:268.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:269 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:269.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:270 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:270.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:271 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:271.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:272 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:272.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:273 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:273.out 2024-03-18T00:28:07.811 INFO:teuthology.orchestra.run.smithi081.stdout:274 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:274.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:275 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:275.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:276 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:276.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:277 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:277.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:278 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:278.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:279 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:279.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:280 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:280.out 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:281 2024-03-18T00:28:07.812 INFO:teuthology.orchestra.run.smithi081.stdout:281.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:282 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:282.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:283 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:283.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:284 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:284.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:285 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:285.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:286 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:286.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:287 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:287.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:288 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:288.out 2024-03-18T00:28:07.813 INFO:teuthology.orchestra.run.smithi081.stdout:289 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:289.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:290 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:290.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:291 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:291.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:292 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:292.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:293 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:293.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:294 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:294.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:295 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:295.out 2024-03-18T00:28:07.814 INFO:teuthology.orchestra.run.smithi081.stdout:296 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:296.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:297 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:297.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:298 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:298.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:299 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:299.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:300 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:300.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:301 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:301.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:302 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:302.out 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:303 2024-03-18T00:28:07.815 INFO:teuthology.orchestra.run.smithi081.stdout:303.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:304 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:304.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:305 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:305.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:306 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:306.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:307 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:307.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:308 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:308.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:309 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:309.out 2024-03-18T00:28:07.816 INFO:teuthology.orchestra.run.smithi081.stdout:310 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:310.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:311 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:311.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:312 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:312.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:313 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:313.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:314 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:314.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:315 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:315.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:316 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:316.out 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:317 2024-03-18T00:28:07.817 INFO:teuthology.orchestra.run.smithi081.stdout:317.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:318 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:318.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:319 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:319.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:320 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:320.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:321 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:321.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:322 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:322.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:323 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:323.out 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:324 2024-03-18T00:28:07.818 INFO:teuthology.orchestra.run.smithi081.stdout:324.out 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:325 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:325.out 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:326 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:326.out 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:327 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:327.out 2024-03-18T00:28:07.819 INFO:teuthology.orchestra.run.smithi081.stdout:328 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:328.out 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:329 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:329.out 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:330 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:330.out 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:331 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:331.out 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:332 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:332.out 2024-03-18T00:28:07.822 INFO:teuthology.orchestra.run.smithi081.stdout:333 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:333.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:334 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:334.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:335 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:335.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:336 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:336.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:337 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:337.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:338 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:338.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:339 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:339.out 2024-03-18T00:28:07.823 INFO:teuthology.orchestra.run.smithi081.stdout:340 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:340.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:341 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:341.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:342 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:342.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:343 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:343.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:344 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:344.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:345 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:345.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:346 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:346.out 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:347 2024-03-18T00:28:07.824 INFO:teuthology.orchestra.run.smithi081.stdout:347.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:348 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:348.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:349 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:349.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:350 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:350.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:351 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:351.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:352 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:352.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:353 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:353.out 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:354 2024-03-18T00:28:07.825 INFO:teuthology.orchestra.run.smithi081.stdout:354.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:355 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:355.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:356 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:356.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:357 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:357.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:358 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:358.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:359 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:359.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:360 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:360.out 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:361 2024-03-18T00:28:07.826 INFO:teuthology.orchestra.run.smithi081.stdout:361.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:362 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:362.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:363 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:363.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:364 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:364.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:365 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:365.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:366 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:366.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:367 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:367.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:368 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:368.out 2024-03-18T00:28:07.827 INFO:teuthology.orchestra.run.smithi081.stdout:369 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:369.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:370 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:370.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:371 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:371.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:372 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:372.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:373 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:373.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:374 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:374.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:375 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:375.out 2024-03-18T00:28:07.828 INFO:teuthology.orchestra.run.smithi081.stdout:376 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:376.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:377 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:377.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:378 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:378.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:379 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:379.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:380 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:380.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:381 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:381.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:382 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:382.out 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:383 2024-03-18T00:28:07.829 INFO:teuthology.orchestra.run.smithi081.stdout:383.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:384 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:384.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:385 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:385.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:386 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:386.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:387 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:387.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:388 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:388.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:389 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:389.out 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:390 2024-03-18T00:28:07.830 INFO:teuthology.orchestra.run.smithi081.stdout:390.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:391 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:391.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:392 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:392.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:393 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:393.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:394 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:394.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:395 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:395.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:396 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:396.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:397 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:397.out 2024-03-18T00:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:398 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:398.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:399 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:399.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:400 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:400.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:401 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:401.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:402 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:402.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:403 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:403.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:404 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:404.out 2024-03-18T00:28:07.832 INFO:teuthology.orchestra.run.smithi081.stdout:405 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:405.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:406 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:406.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:407 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:407.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:408 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:408.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:409 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:409.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:410 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:410.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:411 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:411.out 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:412 2024-03-18T00:28:07.833 INFO:teuthology.orchestra.run.smithi081.stdout:412.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:413 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:413.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:414 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:414.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:415 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:415.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:416 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:416.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:417 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:417.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:418 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:418.out 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:419 2024-03-18T00:28:07.834 INFO:teuthology.orchestra.run.smithi081.stdout:419.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:420 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:420.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:421 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:421.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:422 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:422.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:423 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:423.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:424 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:424.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:425 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:425.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:426 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:426.out 2024-03-18T00:28:07.835 INFO:teuthology.orchestra.run.smithi081.stdout:427 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:427.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:428 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:428.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:429 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:429.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:430 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:430.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:431 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:431.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:432 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:432.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:433 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:433.out 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:434 2024-03-18T00:28:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:434.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:435 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:435.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:436 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:436.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:437 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:437.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:438 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:438.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:439 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:439.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:440 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:440.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:441 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:441.out 2024-03-18T00:28:07.837 INFO:teuthology.orchestra.run.smithi081.stdout:442 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:442.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:443 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:443.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:444 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:444.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:445 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:445.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:446 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:446.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:447 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:447.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:448 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:448.out 2024-03-18T00:28:07.838 INFO:teuthology.orchestra.run.smithi081.stdout:449 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:449.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:450 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:450.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:451 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:451.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:452 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:452.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:453 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:453.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:454 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:454.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:455 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:455.out 2024-03-18T00:28:07.839 INFO:teuthology.orchestra.run.smithi081.stdout:456 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:456.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:457 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:457.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:458 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:458.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:459 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:459.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:460 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:460.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:461 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:461.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:462 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:462.out 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:463 2024-03-18T00:28:07.840 INFO:teuthology.orchestra.run.smithi081.stdout:463.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:464 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:464.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:465 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:465.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:466 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:466.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:467 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:467.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:468 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:468.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:469 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:469.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:470 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:470.out 2024-03-18T00:28:07.841 INFO:teuthology.orchestra.run.smithi081.stdout:471 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:471.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:472 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:472.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:473 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:473.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:474 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:474.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:475 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:475.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:476 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:476.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:477 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:477.out 2024-03-18T00:28:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:478 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:478.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:479 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:479.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:480 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:480.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:481 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:481.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:482 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:482.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:483 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:483.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:484 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:484.out 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:485 2024-03-18T00:28:07.843 INFO:teuthology.orchestra.run.smithi081.stdout:485.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:486 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:486.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:487 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:487.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:488 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:488.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:489 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:489.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:490 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:490.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:491 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:491.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:492 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:492.out 2024-03-18T00:28:07.844 INFO:teuthology.orchestra.run.smithi081.stdout:493 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:493.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:494 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:494.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:495 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:495.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:496 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:496.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:497 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:497.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:498 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:498.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:499 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:499.out 2024-03-18T00:28:07.845 INFO:teuthology.orchestra.run.smithi081.stdout:500 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:500.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:501 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:501.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:502 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:502.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:503 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:503.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:504 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:504.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:505 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:505.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:506 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:506.out 2024-03-18T00:28:07.846 INFO:teuthology.orchestra.run.smithi081.stdout:507 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:507.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:508 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:508.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:509 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:509.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:510 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:510.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:511 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:511.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:512 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:512.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:513 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:513.out 2024-03-18T00:28:07.847 INFO:teuthology.orchestra.run.smithi081.stdout:514 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:514.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:515 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:515.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:516 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:516.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:517 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:517.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:518 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:518.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:519 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:519.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:520 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:520.out 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:521 2024-03-18T00:28:07.848 INFO:teuthology.orchestra.run.smithi081.stdout:521.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:522 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:522.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:523 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:523.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:524 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:524.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:525 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:525.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:526 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:526.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:527 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:527.out 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:528 2024-03-18T00:28:07.849 INFO:teuthology.orchestra.run.smithi081.stdout:528.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:529 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:529.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:530 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:530.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:531 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:531.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:532 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:532.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:533 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:533.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:534 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:534.out 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:535 2024-03-18T00:28:07.850 INFO:teuthology.orchestra.run.smithi081.stdout:535.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:536 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:536.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:537 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:537.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:538 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:538.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:539 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:539.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:540 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:540.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:541 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:541.out 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:542 2024-03-18T00:28:07.851 INFO:teuthology.orchestra.run.smithi081.stdout:542.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:543 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:543.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:544 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:544.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:545 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:545.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:546 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:546.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:547 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:547.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:548 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:548.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:549 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:549.out 2024-03-18T00:28:07.852 INFO:teuthology.orchestra.run.smithi081.stdout:550 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:550.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:551 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:551.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:552 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:552.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:553 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:553.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:554 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:554.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:555 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:555.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:556 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:556.out 2024-03-18T00:28:07.853 INFO:teuthology.orchestra.run.smithi081.stdout:557 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:557.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:558 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:558.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:559 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:559.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:560 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:560.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:561 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:561.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:562 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:562.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:563 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:563.out 2024-03-18T00:28:07.854 INFO:teuthology.orchestra.run.smithi081.stdout:564 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:564.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:565 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:565.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:566 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:566.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:567 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:567.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:568 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:568.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:569 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:569.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:570 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:570.out 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:571 2024-03-18T00:28:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:571.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:572 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:572.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:573 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:573.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:574 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:574.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:575 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:575.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:576 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:576.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:577 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:577.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:578 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:578.out 2024-03-18T00:28:07.856 INFO:teuthology.orchestra.run.smithi081.stdout:579 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:579.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:580 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:580.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:581 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:581.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:582 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:582.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:583 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:583.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:584 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:584.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:585 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:585.out 2024-03-18T00:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:586 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:586.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:587 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:587.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:588 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:588.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:589 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:589.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:590 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:590.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:591 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:591.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:592 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:592.out 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:593 2024-03-18T00:28:07.858 INFO:teuthology.orchestra.run.smithi081.stdout:593.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:594 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:594.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:595 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:595.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:596 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:596.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:597 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:597.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:598 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:598.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:599 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:599.out 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:600 2024-03-18T00:28:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:600.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:601 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:601.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:602 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:602.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:603 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:603.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:604 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:604.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:605 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:605.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:606 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:606.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:607 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:607.out 2024-03-18T00:28:07.860 INFO:teuthology.orchestra.run.smithi081.stdout:608 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:608.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:609 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:609.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:610 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:610.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:611 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:611.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:612 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:612.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:613 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:613.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:614 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:614.out 2024-03-18T00:28:07.861 INFO:teuthology.orchestra.run.smithi081.stdout:615 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:615.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:616 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:616.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:617 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:617.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:618 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:618.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:619 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:619.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:620 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:620.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:621 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:621.out 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:622 2024-03-18T00:28:07.862 INFO:teuthology.orchestra.run.smithi081.stdout:622.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:623 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:623.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:624 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:624.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:625 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:625.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:626 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:626.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:627 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:627.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:628 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:628.out 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:629 2024-03-18T00:28:07.863 INFO:teuthology.orchestra.run.smithi081.stdout:629.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:630 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:630.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:631 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:631.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:632 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:632.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:633 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:633.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:634 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:634.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:635 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:635.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:636 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:636.out 2024-03-18T00:28:07.864 INFO:teuthology.orchestra.run.smithi081.stdout:637 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:637.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:638 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:638.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:639 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:639.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:640 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:640.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:641 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:641.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:642 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:642.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:643 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:643.out 2024-03-18T00:28:07.865 INFO:teuthology.orchestra.run.smithi081.stdout:644 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:644.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:645 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:645.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:646 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:646.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:647 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:647.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:648 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:648.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:649 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:649.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:650 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:650.out 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:651 2024-03-18T00:28:07.866 INFO:teuthology.orchestra.run.smithi081.stdout:651.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:652 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:652.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:653 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:653.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:654 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:654.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:655 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:655.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:656 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:656.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:657 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:657.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:658 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:658.out 2024-03-18T00:28:07.867 INFO:teuthology.orchestra.run.smithi081.stdout:659 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:659.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:660 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:660.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:661 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:661.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:662 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:662.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:663 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:663.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:664 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:664.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:665 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:665.out 2024-03-18T00:28:07.868 INFO:teuthology.orchestra.run.smithi081.stdout:666 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:666.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:667 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:667.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:668 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:668.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:669 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:669.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:670 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:670.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:671 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:671.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:672 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:672.out 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:673 2024-03-18T00:28:07.869 INFO:teuthology.orchestra.run.smithi081.stdout:673.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:674 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:674.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:675 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:675.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:676 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:676.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:677 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:677.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:678 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:678.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:679 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:679.out 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:680 2024-03-18T00:28:07.870 INFO:teuthology.orchestra.run.smithi081.stdout:680.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:681 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:681.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:682 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:682.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:683 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:683.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:684 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:684.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:685 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:685.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:686 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:686.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:687 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:687.out 2024-03-18T00:28:07.871 INFO:teuthology.orchestra.run.smithi081.stdout:688 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:688.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:689 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:689.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:690 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:690.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:691 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:691.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:692 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:692.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:693 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:693.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:694 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:694.out 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:695 2024-03-18T00:28:07.872 INFO:teuthology.orchestra.run.smithi081.stdout:695.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:696 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:696.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:697 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:697.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:698 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:698.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:699 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:699.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:700 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:700.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:701 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:701.out 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:702 2024-03-18T00:28:07.873 INFO:teuthology.orchestra.run.smithi081.stdout:702.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:703 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:703.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:704 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:704.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:705 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:705.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:706 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:706.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:707 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:707.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:708 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:708.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:709 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:709.out 2024-03-18T00:28:07.874 INFO:teuthology.orchestra.run.smithi081.stdout:710 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:710.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:711 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:711.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:712 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:712.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:713 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:713.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:714 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:714.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:715 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:715.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:716 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:716.out 2024-03-18T00:28:07.875 INFO:teuthology.orchestra.run.smithi081.stdout:717 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:717.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:718 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:718.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:719 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:719.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:720 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:720.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:721 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:721.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:722 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:722.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:723 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:723.out 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:724 2024-03-18T00:28:07.876 INFO:teuthology.orchestra.run.smithi081.stdout:724.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:725 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:725.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:726 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:726.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:727 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:727.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:728 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:728.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:729 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:729.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:730 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:730.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:731 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:731.out 2024-03-18T00:28:07.877 INFO:teuthology.orchestra.run.smithi081.stdout:732 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:732.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:733 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:733.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:734 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:734.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:735 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:735.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:736 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:736.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:737 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:737.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:738 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:738.out 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:739 2024-03-18T00:28:07.878 INFO:teuthology.orchestra.run.smithi081.stdout:739.out 2024-03-18T00:28:07.879 INFO:teuthology.orchestra.run.smithi081.stdout:group.list 2024-03-18T00:28:07.879 INFO:teuthology.orchestra.run.smithi081.stdout:Makefile 2024-03-18T00:28:07.879 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-18T00:28:08.063 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:08.067 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:08.067 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:08.068 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:08.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:13.531 INFO:teuthology.orchestra.run.smithi081.stdout:generic/001 5s 2024-03-18T00:28:13.536 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/001 2024-03-18T00:28:13.536 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:13.538 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:13.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:13.874 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-18T00:28:14.046 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:14.050 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:14.050 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:14.051 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:14.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:14.486 INFO:teuthology.orchestra.run.smithi081.stdout:generic/002 0s 2024-03-18T00:28:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/002 2024-03-18T00:28:14.493 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:14.496 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:14.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:14.628 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-18T00:28:14.822 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:14.907 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:14.908 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:15.032 INFO:teuthology.orchestra.run.smithi081.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-18T00:28:15.036 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/003 2024-03-18T00:28:15.036 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/003 2024-03-18T00:28:15.036 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:15.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:15.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:15.048 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-18T00:28:15.220 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:15.223 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:15.224 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:15.225 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:15.225 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:15.429 INFO:teuthology.orchestra.run.smithi081.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-18T00:28:15.433 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/004 2024-03-18T00:28:15.433 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/004 2024-03-18T00:28:15.433 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:15.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:15.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:15.446 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-18T00:28:15.646 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:15.649 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:15.650 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:15.651 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:15.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:16.018 INFO:teuthology.orchestra.run.smithi081.stdout:generic/005 1s 2024-03-18T00:28:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/005 2024-03-18T00:28:16.023 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:16.025 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:16.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:16.053 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-18T00:28:16.234 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:16.237 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:16.238 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:16.239 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:16.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:23.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:28:23.336 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:28:43.296 INFO:teuthology.orchestra.run.smithi081.stdout:generic/006 27s 2024-03-18T00:28:43.302 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/006 2024-03-18T00:28:43.302 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:28:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:43.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:28:43.457 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-18T00:28:43.634 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:28:43.638 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:28:43.638 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:28:43.639 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:28:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:28:53.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:28:53.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:29:23.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:29:23.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:29:38.166 INFO:teuthology.orchestra.run.smithi081.stdout:generic/007 55s 2024-03-18T00:29:38.172 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/007 2024-03-18T00:29:38.172 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:29:38.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:38.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:29:38.231 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-18T00:29:38.460 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:29:38.466 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:29:38.466 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:29:38.467 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:29:38.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:38.746 INFO:teuthology.orchestra.run.smithi081.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T00:29:38.750 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/008 2024-03-18T00:29:38.750 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/008 2024-03-18T00:29:38.750 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:29:38.753 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:38.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:29:38.766 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-18T00:29:38.943 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:29:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:29:38.947 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:29:38.948 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:29:38.948 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:39.199 INFO:teuthology.orchestra.run.smithi081.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T00:29:39.203 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/009 2024-03-18T00:29:39.203 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/009 2024-03-18T00:29:39.203 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:29:39.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:39.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:29:39.218 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-18T00:29:39.400 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:29:39.403 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:29:39.404 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:29:39.405 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:29:39.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:39.916 INFO:teuthology.orchestra.run.smithi081.stdout:generic/010 0s 2024-03-18T00:29:39.922 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/010 2024-03-18T00:29:39.922 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:29:39.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:39.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:29:39.966 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-18T00:29:40.151 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:29:40.154 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:29:40.155 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:29:40.156 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:29:40.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:29:54.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:29:54.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:30:12.130 INFO:teuthology.orchestra.run.smithi081.stdout:generic/011 32s 2024-03-18T00:30:12.135 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/011 2024-03-18T00:30:12.135 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:30:12.137 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:30:12.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:30:12.185 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-18T00:30:12.362 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:30:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:30:12.366 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:30:12.367 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:30:12.367 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:30:12.636 INFO:teuthology.orchestra.run.smithi081.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:30:12.640 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/012 2024-03-18T00:30:12.640 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/012 2024-03-18T00:30:12.640 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:30:12.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:30:12.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:30:12.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-18T00:30:12.883 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:30:12.886 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:30:12.887 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:30:12.888 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:30:12.888 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:30:24.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:30:24.268 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:30:54.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:30:54.423 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:31:00.166 INFO:teuthology.orchestra.run.smithi081.stdout:generic/013 48s 2024-03-18T00:31:00.172 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/013 2024-03-18T00:31:00.172 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:00.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:00.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:00.195 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-18T00:31:00.434 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:00.439 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:00.440 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:00.441 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:00.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:00.744 INFO:teuthology.orchestra.run.smithi081.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-18T00:31:00.748 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/014 2024-03-18T00:31:00.749 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/014 2024-03-18T00:31:00.749 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:00.752 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:00.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:00.770 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-18T00:31:01.004 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:01.009 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:01.010 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:01.011 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:01.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:01.291 INFO:teuthology.orchestra.run.smithi081.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T00:31:01.296 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/015 2024-03-18T00:31:01.296 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/015 2024-03-18T00:31:01.296 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:01.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:01.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:01.315 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-18T00:31:01.552 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:01.558 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:01.559 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:01.561 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:01.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:01.931 INFO:teuthology.orchestra.run.smithi081.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:01.936 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/016 2024-03-18T00:31:01.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/016 2024-03-18T00:31:01.937 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:01.940 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:01.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:01.977 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-18T00:31:02.236 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:02.241 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:02.241 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:02.242 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:02.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:02.525 INFO:teuthology.orchestra.run.smithi081.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T00:31:02.530 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/017 2024-03-18T00:31:02.530 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/017 2024-03-18T00:31:02.530 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:02.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:02.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:02.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-18T00:31:02.799 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:02.804 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:02.804 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:02.805 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:02.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:03.207 INFO:teuthology.orchestra.run.smithi081.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-18T00:31:03.216 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/018 2024-03-18T00:31:03.216 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/018 2024-03-18T00:31:03.216 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:03.219 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:03.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:03.233 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-18T00:31:03.473 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:03.478 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:03.478 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:03.480 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:03.480 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:03.742 INFO:teuthology.orchestra.run.smithi081.stdout:generic/019 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:03.747 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/019 2024-03-18T00:31:03.747 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/019 2024-03-18T00:31:03.747 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:03.750 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:03.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:03.764 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-18T00:31:03.991 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:03.996 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:03.996 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:03.998 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:03.998 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:07.445 INFO:teuthology.orchestra.run.smithi081.stdout:generic/020 3s 2024-03-18T00:31:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/020 2024-03-18T00:31:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:07.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:07.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:07.496 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-18T00:31:07.756 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:07.761 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:07.762 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:07.762 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:08.130 INFO:teuthology.orchestra.run.smithi081.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:08.136 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/021 2024-03-18T00:31:08.136 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/021 2024-03-18T00:31:08.136 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:08.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:08.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:08.174 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-18T00:31:08.429 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:08.434 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:08.435 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:08.436 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:08.436 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:08.830 INFO:teuthology.orchestra.run.smithi081.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:08.836 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/022 2024-03-18T00:31:08.836 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/022 2024-03-18T00:31:08.836 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:08.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:08.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:08.879 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-18T00:31:09.153 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:09.158 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:09.159 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:09.160 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:09.160 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:10.438 INFO:teuthology.orchestra.run.smithi081.stdout:generic/023 1s 2024-03-18T00:31:10.445 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/023 2024-03-18T00:31:10.445 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:10.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:10.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:10.516 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-18T00:31:10.771 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:10.776 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:10.777 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:10.778 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:11.054 INFO:teuthology.orchestra.run.smithi081.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-18T00:31:11.059 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/024 2024-03-18T00:31:11.059 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/024 2024-03-18T00:31:11.059 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:11.062 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:11.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:11.094 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-18T00:31:11.356 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:11.361 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:11.361 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:11.364 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:11.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:11.657 INFO:teuthology.orchestra.run.smithi081.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-18T00:31:11.662 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/025 2024-03-18T00:31:11.662 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/025 2024-03-18T00:31:11.662 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:11.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:11.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:11.718 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-18T00:31:11.983 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:11.985 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:11.986 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:11.987 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:11.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:12.278 INFO:teuthology.orchestra.run.smithi081.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-18T00:31:12.283 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/026 2024-03-18T00:31:12.284 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/026 2024-03-18T00:31:12.284 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:12.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:12.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:12.308 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-18T00:31:12.539 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:12.545 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:12.545 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:12.546 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:12.546 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:12.815 INFO:teuthology.orchestra.run.smithi081.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T00:31:12.820 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/027 2024-03-18T00:31:12.820 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/027 2024-03-18T00:31:12.820 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:12.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:12.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:12.838 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-18T00:31:13.066 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:13.071 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:13.072 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:13.073 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:13.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:18.347 INFO:teuthology.orchestra.run.smithi081.stdout:generic/028 5s 2024-03-18T00:31:18.354 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/028 2024-03-18T00:31:18.354 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:18.357 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:18.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:18.377 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-18T00:31:18.616 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:18.621 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:18.622 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:18.622 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:18.623 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:22.132 INFO:teuthology.orchestra.run.smithi081.stdout:generic/029 4s 2024-03-18T00:31:22.145 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/029 2024-03-18T00:31:22.145 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:22.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:22.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:22.159 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-18T00:31:22.391 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:22.397 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:22.398 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:22.399 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:22.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:23.574 INFO:teuthology.orchestra.run.smithi081.stdout:generic/030 1s 2024-03-18T00:31:23.582 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/030 2024-03-18T00:31:23.582 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:23.585 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:23.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:23.597 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-18T00:31:23.834 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:23.839 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:23.841 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:23.841 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:24.172 INFO:teuthology.orchestra.run.smithi081.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T00:31:24.177 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/031 2024-03-18T00:31:24.177 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/031 2024-03-18T00:31:24.177 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:24.180 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:24.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:24.199 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-18T00:31:24.433 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:24.438 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:24.438 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:24.440 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:24.700 INFO:teuthology.orchestra.run.smithi081.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:24.705 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/032 2024-03-18T00:31:24.705 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/032 2024-03-18T00:31:24.705 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:24.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:24.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:24.724 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-18T00:31:24.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:31:24.868 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:31:24.963 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:24.969 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:24.969 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:24.970 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:24.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:25.314 INFO:teuthology.orchestra.run.smithi081.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T00:31:25.319 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/033 2024-03-18T00:31:25.319 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/033 2024-03-18T00:31:25.319 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:25.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:25.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:25.340 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-18T00:31:25.608 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:25.612 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:25.613 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:25.614 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:25.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:25.883 INFO:teuthology.orchestra.run.smithi081.stdout:generic/034 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:25.888 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/034 2024-03-18T00:31:25.888 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/034 2024-03-18T00:31:25.888 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:25.891 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:25.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:25.906 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-18T00:31:26.150 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:26.155 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:26.156 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:26.157 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:26.157 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:26.482 INFO:teuthology.orchestra.run.smithi081.stdout:generic/035 0s 2024-03-18T00:31:26.489 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/035 2024-03-18T00:31:26.489 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:26.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:26.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:26.524 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-18T00:31:26.788 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:26.793 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:26.793 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:26.794 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:26.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:37.162 INFO:teuthology.orchestra.run.smithi081.stdout:generic/036 11s 2024-03-18T00:31:37.168 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/036 2024-03-18T00:31:37.169 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:37.173 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:37.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:37.208 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-18T00:31:37.478 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:37.483 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:37.483 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:37.484 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:37.484 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:41.988 INFO:teuthology.orchestra.run.smithi081.stdout:generic/037 4s 2024-03-18T00:31:41.996 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/037 2024-03-18T00:31:41.996 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:41.999 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:42.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:42.009 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-18T00:31:42.242 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:42.247 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:42.247 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:42.248 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:42.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:42.521 INFO:teuthology.orchestra.run.smithi081.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/038 2024-03-18T00:31:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/038 2024-03-18T00:31:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:42.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:42.547 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-18T00:31:42.775 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:42.779 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:42.779 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:42.780 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:43.073 INFO:teuthology.orchestra.run.smithi081.stdout:generic/039 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:43.078 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/039 2024-03-18T00:31:43.078 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/039 2024-03-18T00:31:43.078 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:43.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:43.102 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-18T00:31:43.344 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:43.348 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:43.349 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:43.350 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:43.647 INFO:teuthology.orchestra.run.smithi081.stdout:generic/040 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:43.652 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/040 2024-03-18T00:31:43.653 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/040 2024-03-18T00:31:43.653 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:43.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:43.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:43.677 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-18T00:31:43.910 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:43.915 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:43.915 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:43.916 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:43.917 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:44.196 INFO:teuthology.orchestra.run.smithi081.stdout:generic/041 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:44.202 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/041 2024-03-18T00:31:44.202 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/041 2024-03-18T00:31:44.202 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:44.205 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:44.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:44.223 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-18T00:31:44.461 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:44.466 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:44.466 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:44.467 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:44.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:44.817 INFO:teuthology.orchestra.run.smithi081.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/042 2024-03-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/042 2024-03-18T00:31:44.824 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:44.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:44.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:44.842 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-18T00:31:45.072 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:45.078 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:45.079 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:45.080 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:45.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:45.408 INFO:teuthology.orchestra.run.smithi081.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-18T00:31:45.416 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/043 2024-03-18T00:31:45.416 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/043 2024-03-18T00:31:45.416 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:45.419 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:45.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:45.434 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-18T00:31:45.667 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:45.672 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:45.672 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:45.674 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:45.674 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:46.030 INFO:teuthology.orchestra.run.smithi081.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-18T00:31:46.040 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/044 2024-03-18T00:31:46.040 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/044 2024-03-18T00:31:46.040 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:46.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:46.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:46.056 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-18T00:31:46.289 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:46.294 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:46.295 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:46.296 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:46.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:46.656 INFO:teuthology.orchestra.run.smithi081.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-18T00:31:46.664 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/045 2024-03-18T00:31:46.664 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/045 2024-03-18T00:31:46.664 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:46.666 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:46.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:46.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-18T00:31:46.926 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:46.931 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:46.931 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:46.932 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:46.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:47.285 INFO:teuthology.orchestra.run.smithi081.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-18T00:31:47.293 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/046 2024-03-18T00:31:47.293 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/046 2024-03-18T00:31:47.293 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:47.298 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:47.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:47.309 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-18T00:31:47.544 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:47.549 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:47.549 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:47.550 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:47.550 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:47.891 INFO:teuthology.orchestra.run.smithi081.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-18T00:31:47.908 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/047 2024-03-18T00:31:47.908 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/047 2024-03-18T00:31:47.908 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:47.911 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:47.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:47.927 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-18T00:31:48.174 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:48.178 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:48.179 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:48.180 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:48.531 INFO:teuthology.orchestra.run.smithi081.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-18T00:31:48.540 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/048 2024-03-18T00:31:48.540 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/048 2024-03-18T00:31:48.540 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:48.543 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:48.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:48.556 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-18T00:31:48.794 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:48.799 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:48.799 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:48.800 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:48.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:49.148 INFO:teuthology.orchestra.run.smithi081.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-18T00:31:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/049 2024-03-18T00:31:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/049 2024-03-18T00:31:49.170 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:49.174 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:49.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:49.190 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-18T00:31:49.426 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:49.431 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:49.432 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:49.434 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:49.434 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:49.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-18T00:31:49.783 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/050 2024-03-18T00:31:49.783 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/050 2024-03-18T00:31:49.783 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:49.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:49.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:49.800 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-18T00:31:50.038 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:50.043 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:50.043 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:50.044 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:50.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:50.389 INFO:teuthology.orchestra.run.smithi081.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-18T00:31:50.394 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/051 2024-03-18T00:31:50.394 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/051 2024-03-18T00:31:50.394 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:50.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:50.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:50.414 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-18T00:31:50.650 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:50.655 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:50.655 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:50.656 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-18T00:31:51.017 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/052 2024-03-18T00:31:51.017 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/052 2024-03-18T00:31:51.017 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:51.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:51.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:51.032 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-18T00:31:51.263 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:51.269 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:51.269 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:51.270 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:51.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:51.875 INFO:teuthology.orchestra.run.smithi081.stdout:generic/053 0s 2024-03-18T00:31:51.927 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/053 2024-03-18T00:31:51.927 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:51.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:51.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:51.952 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-18T00:31:52.212 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:52.217 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:52.218 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:52.219 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:52.219 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:52.604 INFO:teuthology.orchestra.run.smithi081.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-18T00:31:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/054 2024-03-18T00:31:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/054 2024-03-18T00:31:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:52.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:52.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:52.629 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-18T00:31:52.868 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:52.872 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:52.873 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:52.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:53.226 INFO:teuthology.orchestra.run.smithi081.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-18T00:31:53.235 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/055 2024-03-18T00:31:53.235 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/055 2024-03-18T00:31:53.235 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:53.237 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:53.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:53.255 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-18T00:31:53.499 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:53.504 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:53.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:53.782 INFO:teuthology.orchestra.run.smithi081.stdout:generic/056 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:53.787 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/056 2024-03-18T00:31:53.787 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/056 2024-03-18T00:31:53.787 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:53.790 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:53.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:53.808 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-18T00:31:54.054 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:54.059 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:54.059 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:54.061 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:54.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:54.342 INFO:teuthology.orchestra.run.smithi081.stdout:generic/057 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:54.347 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/057 2024-03-18T00:31:54.347 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/057 2024-03-18T00:31:54.347 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:54.350 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:54.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:54.369 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-18T00:31:54.611 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:54.617 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:54.617 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:54.618 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:54.618 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:54.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:31:54.947 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:31:54.988 INFO:teuthology.orchestra.run.smithi081.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:54.993 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/058 2024-03-18T00:31:54.994 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/058 2024-03-18T00:31:54.994 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:54.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:55.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:55.025 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-18T00:31:55.115 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T00:31:55.114+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44495) UID: 0 2024-03-18T00:31:55.115 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T00:31:55.114+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44495) UID: 0 2024-03-18T00:31:55.322 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:55.326 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:55.327 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:55.328 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:55.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:55.585 INFO:teuthology.orchestra.run.smithi081.stdout:generic/059 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:31:55.590 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/059 2024-03-18T00:31:55.590 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/059 2024-03-18T00:31:55.590 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:55.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:55.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:55.610 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-18T00:31:55.843 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:55.848 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:55.849 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:55.850 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:55.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:56.219 INFO:teuthology.orchestra.run.smithi081.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:56.224 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/060 2024-03-18T00:31:56.224 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/060 2024-03-18T00:31:56.224 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:56.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:56.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:56.254 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-18T00:31:56.545 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:56.551 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:56.551 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:56.551 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:56.916 INFO:teuthology.orchestra.run.smithi081.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:56.921 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/061 2024-03-18T00:31:56.921 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/061 2024-03-18T00:31:56.921 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:56.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:56.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:56.958 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-18T00:31:57.250 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:57.255 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:57.256 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:57.257 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:57.257 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:58.947 INFO:teuthology.orchestra.run.smithi081.stdout:generic/062 1s 2024-03-18T00:31:58.961 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/062 2024-03-18T00:31:58.962 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:58.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:58.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:58.980 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-18T00:31:59.212 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:59.216 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:59.217 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:59.217 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:59.218 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:59.640 INFO:teuthology.orchestra.run.smithi081.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:31:59.645 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/063 2024-03-18T00:31:59.645 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/063 2024-03-18T00:31:59.645 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:31:59.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:31:59.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:31:59.679 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-18T00:31:59.948 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:31:59.953 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:31:59.953 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:31:59.954 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:31:59.954 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:00.230 INFO:teuthology.orchestra.run.smithi081.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T00:32:00.234 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/064 2024-03-18T00:32:00.235 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/064 2024-03-18T00:32:00.235 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:00.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:00.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:00.256 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-18T00:32:00.494 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:00.499 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:00.499 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:00.500 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:00.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:00.787 INFO:teuthology.orchestra.run.smithi081.stdout:generic/065 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:32:00.793 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/065 2024-03-18T00:32:00.793 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/065 2024-03-18T00:32:00.793 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:00.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:00.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:00.819 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-18T00:32:01.046 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:01.050 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:01.051 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:01.052 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:01.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:01.314 INFO:teuthology.orchestra.run.smithi081.stdout:generic/066 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:32:01.318 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/066 2024-03-18T00:32:01.319 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/066 2024-03-18T00:32:01.319 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:01.322 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:01.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:01.336 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-18T00:32:01.565 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:01.571 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:01.573 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:01.573 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:01.872 INFO:teuthology.orchestra.run.smithi081.stdout:generic/067 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:32:01.876 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/067 2024-03-18T00:32:01.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/067 2024-03-18T00:32:01.877 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:01.880 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:01.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:01.899 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-18T00:32:02.145 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:02.151 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:02.152 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:02.153 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:02.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:02.418 INFO:teuthology.orchestra.run.smithi081.stdout:generic/068 [not run] ceph does not support freezing 2024-03-18T00:32:02.423 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/068 2024-03-18T00:32:02.423 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/068 2024-03-18T00:32:02.423 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:02.426 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:02.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:02.439 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-18T00:32:02.667 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:02.672 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:02.672 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:02.674 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:02.674 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:09.382 INFO:teuthology.orchestra.run.smithi081.stdout:generic/069 7s 2024-03-18T00:32:09.420 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/069 2024-03-18T00:32:09.420 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:09.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:09.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:09.437 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-18T00:32:09.652 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:09.657 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:09.657 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:09.658 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:09.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:38.495 INFO:teuthology.orchestra.run.smithi081.stdout:generic/070 29s 2024-03-18T00:32:38.500 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/070 2024-03-18T00:32:38.500 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:38.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:38.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:38.570 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-18T00:32:38.844 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:38.849 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:38.850 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:38.851 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:38.851 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:39.125 INFO:teuthology.orchestra.run.smithi081.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T00:32:39.129 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/071 2024-03-18T00:32:39.130 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/071 2024-03-18T00:32:39.130 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:39.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:39.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:39.150 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-18T00:32:39.380 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:39.388 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:39.388 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:39.390 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:39.390 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:39.736 INFO:teuthology.orchestra.run.smithi081.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T00:32:39.740 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/072 2024-03-18T00:32:39.740 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/072 2024-03-18T00:32:39.740 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:39.743 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:39.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:39.764 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-18T00:32:39.991 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:39.995 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:39.996 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:39.997 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:40.258 INFO:teuthology.orchestra.run.smithi081.stdout:generic/073 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:32:40.263 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/073 2024-03-18T00:32:40.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/073 2024-03-18T00:32:40.263 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:40.265 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:40.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:40.281 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-18T00:32:40.514 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:40.519 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:40.520 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:40.521 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:40.521 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:54.642 INFO:teuthology.orchestra.run.smithi081.stdout:generic/074 14s 2024-03-18T00:32:54.648 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/074 2024-03-18T00:32:54.648 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:32:54.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:32:55.757 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:32:55.758 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-18T00:32:56.022 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:32:56.025 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:32:56.026 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:32:56.027 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:32:56.027 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:18.826 INFO:teuthology.orchestra.run.smithi081.stdout:generic/075 22s 2024-03-18T00:33:18.831 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/075 2024-03-18T00:33:18.831 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:18.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:18.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:18.885 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-18T00:33:19.290 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:19.294 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:19.295 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:19.296 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:19.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:19.547 INFO:teuthology.orchestra.run.smithi081.stdout:generic/076 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T00:33:19.552 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/076 2024-03-18T00:33:19.552 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/076 2024-03-18T00:33:19.552 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:19.556 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:19.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:19.569 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-18T00:33:19.813 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:19.817 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:19.818 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:19.819 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:19.819 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:24.357 INFO:teuthology.orchestra.run.smithi081.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T00:33:24.362 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/077 2024-03-18T00:33:24.362 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/077 2024-03-18T00:33:24.362 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:24.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:24.429 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-18T00:33:24.744 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:24.748 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:24.749 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:24.750 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:24.750 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:25.047 INFO:teuthology.orchestra.run.smithi081.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-18T00:33:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/078 2024-03-18T00:33:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/078 2024-03-18T00:33:25.052 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:25.055 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:25.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:25.099 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-18T00:33:25.492 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:25.497 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:25.497 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:25.497 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:25.498 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:25.791 INFO:teuthology.orchestra.run.smithi081.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-18T00:33:25.796 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/079 2024-03-18T00:33:25.796 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/079 2024-03-18T00:33:25.796 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:25.798 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:25.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:25.823 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-18T00:33:26.061 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:26.065 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:26.065 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:26.066 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:26.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:28.374 INFO:teuthology.orchestra.run.smithi081.stdout:generic/080 2s 2024-03-18T00:33:28.380 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/080 2024-03-18T00:33:28.380 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:28.382 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:28.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:28.406 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-18T00:33:28.639 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:28.643 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:28.644 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:28.645 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:28.645 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:28.945 INFO:teuthology.orchestra.run.smithi081.stdout:generic/081 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:33:28.950 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/081 2024-03-18T00:33:28.950 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/081 2024-03-18T00:33:28.950 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:28.952 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:28.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:28.968 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-18T00:33:29.188 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:29.192 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:29.193 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:29.194 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:29.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:29.441 INFO:teuthology.orchestra.run.smithi081.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T00:33:29.448 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/082 2024-03-18T00:33:29.448 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/082 2024-03-18T00:33:29.448 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:29.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:29.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:29.470 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-18T00:33:29.700 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:29.705 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:29.705 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:29.707 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:29.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:29.979 INFO:teuthology.orchestra.run.smithi081.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T00:33:29.985 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/083 2024-03-18T00:33:29.985 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/083 2024-03-18T00:33:29.985 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:29.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:30.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:30.004 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-18T00:33:30.232 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:30.236 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:30.236 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:30.238 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:30.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:35.778 INFO:teuthology.orchestra.run.smithi081.stdout:generic/084 5s 2024-03-18T00:33:35.788 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/084 2024-03-18T00:33:35.788 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:35.791 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:35.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:35.803 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-18T00:33:36.060 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:36.064 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:36.065 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:36.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:36.317 INFO:teuthology.orchestra.run.smithi081.stdout:generic/085 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:33:36.322 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/085 2024-03-18T00:33:36.322 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/085 2024-03-18T00:33:36.322 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:36.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:36.340 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-18T00:33:36.565 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:36.567 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:36.567 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:36.569 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:36.570 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:36.836 INFO:teuthology.orchestra.run.smithi081.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:33:36.841 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/086 2024-03-18T00:33:36.841 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/086 2024-03-18T00:33:36.841 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:36.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:36.865 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-18T00:33:37.098 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:37.103 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:37.103 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:37.104 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:37.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:37.466 INFO:teuthology.orchestra.run.smithi081.stdout:generic/087 0s 2024-03-18T00:33:37.472 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/087 2024-03-18T00:33:37.472 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:37.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:37.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:37.558 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-18T00:33:37.966 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:37.970 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:37.970 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:37.972 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:37.972 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:38.262 INFO:teuthology.orchestra.run.smithi081.stdout:generic/088 0s 2024-03-18T00:33:38.269 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/088 2024-03-18T00:33:38.269 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:33:38.272 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:33:38.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:33:38.306 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-18T00:33:38.709 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:33:38.712 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:33:38.713 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:33:38.714 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:33:38.714 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:35:09.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:35:09.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:35:40.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:35:40.332 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:36:10.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:36:10.804 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:36:40.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:36:40.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:37:11.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:37:11.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:37:41.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:37:41.357 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:38:11.715 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:38:11.718 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:38:11.752 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T00:38:11.752+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44641) UID: 0 2024-03-18T00:38:11.753 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T00:38:11.752+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44641) UID: 0 2024-03-18T00:41:20.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:41:20.642 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:41:51.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:41:51.012 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:41:51.664 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T00:41:51.664+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44685) UID: 0 2024-03-18T00:41:51.664 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T00:41:51.664+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44685) UID: 0 2024-03-18T00:42:58.488 INFO:teuthology.orchestra.run.smithi081.stdout:generic/089 560s 2024-03-18T00:42:58.494 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/089 2024-03-18T00:42:58.494 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:42:58.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:42:58.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:42:58.967 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-18T00:42:59.452 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:42:59.456 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:42:59.456 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:42:59.457 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:42:59.457 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:42:59.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/090 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/090 2024-03-18T00:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/090 2024-03-18T00:42:59.855 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:42:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:42:59.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:42:59.872 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-18T00:43:00.046 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:43:00.050 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:43:00.050 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:43:00.051 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:43:00.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:31.276 INFO:teuthology.orchestra.run.smithi081.stdout:generic/091 91s 2024-03-18T00:44:31.282 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/091 2024-03-18T00:44:31.282 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:31.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:31.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:31.336 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-18T00:44:31.713 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:31.717 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:31.717 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:31.718 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:31.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:31.925 INFO:teuthology.orchestra.run.smithi081.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:44:31.929 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/092 2024-03-18T00:44:31.929 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/092 2024-03-18T00:44:31.929 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:31.931 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:31.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:31.945 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-18T00:44:32.117 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:32.120 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:32.121 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:32.121 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:32.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:32.588 INFO:teuthology.orchestra.run.smithi081.stdout:generic/093 0s 2024-03-18T00:44:32.593 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/093 2024-03-18T00:44:32.593 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:32.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:32.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:32.647 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-18T00:44:33.027 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:33.031 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:33.031 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:33.032 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:33.286 INFO:teuthology.orchestra.run.smithi081.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T00:44:33.288 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/094 2024-03-18T00:44:33.289 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/094 2024-03-18T00:44:33.289 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:33.291 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:33.333 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:33.333 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-18T00:44:33.711 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:33.715 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:33.715 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:33.716 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:33.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:43.589 INFO:teuthology.orchestra.run.smithi081.stdout:generic/095 10s 2024-03-18T00:44:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/095 2024-03-18T00:44:43.597 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:43.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:43.619 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-18T00:44:43.834 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:43.838 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:43.839 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:43.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:44.115 INFO:teuthology.orchestra.run.smithi081.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T00:44:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/096 2024-03-18T00:44:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/096 2024-03-18T00:44:44.119 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:44.121 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:44.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:44.136 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-18T00:44:44.315 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:44.318 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:44.319 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:44.320 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:44.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:45.023 INFO:teuthology.orchestra.run.smithi081.stdout:generic/097 1s 2024-03-18T00:44:45.028 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/097 2024-03-18T00:44:45.029 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:45.031 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:45.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:45.043 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-18T00:44:45.211 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:45.215 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:45.215 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:45.216 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:45.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:47.091 INFO:teuthology.orchestra.run.smithi081.stdout:generic/098 2s 2024-03-18T00:44:47.096 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/098 2024-03-18T00:44:47.097 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:47.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:47.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:47.108 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-18T00:44:47.301 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:47.305 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:47.305 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:47.306 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:47.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:48.082 INFO:teuthology.orchestra.run.smithi081.stdout:generic/099 1s 2024-03-18T00:44:48.087 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/099 2024-03-18T00:44:48.088 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:48.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:48.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:44:48.151 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-18T00:44:48.548 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:44:48.551 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:44:48.552 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:44:48.553 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:44:48.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:44:50.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:44:50.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:44:59.787 INFO:teuthology.orchestra.run.smithi081.stdout:generic/100 11s 2024-03-18T00:44:59.792 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/100 2024-03-18T00:44:59.792 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:44:59.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:03.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:03.205 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-18T00:45:03.574 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:03.578 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:03.578 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:03.579 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:03.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:03.790 INFO:teuthology.orchestra.run.smithi081.stdout:generic/101 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:45:03.793 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/101 2024-03-18T00:45:03.793 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/101 2024-03-18T00:45:03.794 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:03.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:03.807 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:03.807 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-18T00:45:03.991 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:03.995 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:03.995 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:03.996 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:03.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:04.201 INFO:teuthology.orchestra.run.smithi081.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T00:45:04.208 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/102 2024-03-18T00:45:04.208 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/102 2024-03-18T00:45:04.208 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:04.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:04.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:04.222 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-18T00:45:04.410 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:04.414 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:04.415 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:04.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:04.628 INFO:teuthology.orchestra.run.smithi081.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T00:45:04.632 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/103 2024-03-18T00:45:04.632 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/103 2024-03-18T00:45:04.632 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:04.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:04.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:04.694 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-18T00:45:05.077 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:05.080 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:05.081 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:05.082 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:05.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:05.297 INFO:teuthology.orchestra.run.smithi081.stdout:generic/104 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:45:05.301 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/104 2024-03-18T00:45:05.301 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/104 2024-03-18T00:45:05.302 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:05.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:05.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:05.318 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-18T00:45:05.495 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:05.499 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:05.499 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:05.500 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:05.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:05.907 INFO:teuthology.orchestra.run.smithi081.stdout:generic/105 0s 2024-03-18T00:45:05.918 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/105 2024-03-18T00:45:05.918 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:05.921 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:05.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:05.933 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-18T00:45:06.275 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:06.279 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:06.279 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:06.280 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:06.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:06.516 INFO:teuthology.orchestra.run.smithi081.stdout:generic/106 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:45:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/106 2024-03-18T00:45:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/106 2024-03-18T00:45:06.520 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:06.522 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:06.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:06.537 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-18T00:45:06.712 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:06.716 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:06.717 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:06.717 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:06.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:06.937 INFO:teuthology.orchestra.run.smithi081.stdout:generic/107 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:45:06.941 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/107 2024-03-18T00:45:06.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/107 2024-03-18T00:45:06.941 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:06.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:06.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:06.957 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-18T00:45:07.136 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:07.140 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:07.140 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:07.141 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:07.141 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:07.448 INFO:teuthology.orchestra.run.smithi081.stdout:generic/108 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T00:45:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/108 2024-03-18T00:45:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/108 2024-03-18T00:45:07.452 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:07.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:07.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:07.466 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-18T00:45:07.639 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:07.643 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:07.643 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:07.644 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:07.644 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:18.817 INFO:teuthology.orchestra.run.smithi081.stdout:generic/109 11s 2024-03-18T00:45:18.824 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/109 2024-03-18T00:45:18.824 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:18.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:18.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:18.835 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-18T00:45:19.648 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:19.652 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:19.653 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:19.654 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:19.654 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:20.169 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:45:20.172 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:45:39.216 INFO:teuthology.orchestra.run.smithi081.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:45:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/110 2024-03-18T00:45:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/110 2024-03-18T00:45:39.222 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:39.225 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:39.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:39.328 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-18T00:45:39.724 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:39.728 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:39.728 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:39.729 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:39.730 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:40.188 INFO:teuthology.orchestra.run.smithi081.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:45:40.192 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/111 2024-03-18T00:45:40.192 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/111 2024-03-18T00:45:40.192 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:40.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:40.245 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-18T00:45:40.575 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:40.579 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:40.579 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:40.580 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:40.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:50.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:45:50.409 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:45:56.003 INFO:teuthology.orchestra.run.smithi081.stdout:generic/112 16s 2024-03-18T00:45:56.008 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/112 2024-03-18T00:45:56.008 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:45:56.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:45:56.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:45:56.072 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-18T00:45:56.411 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:45:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:45:56.415 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:45:56.416 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:45:56.416 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:12.202 INFO:teuthology.orchestra.run.smithi081.stdout:generic/113 16s 2024-03-18T00:46:12.284 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/113 2024-03-18T00:46:12.284 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:12.286 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:12.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:12.341 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-18T00:46:12.707 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:12.711 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:12.712 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:12.712 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:12.936 INFO:teuthology.orchestra.run.smithi081.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-18T00:46:12.940 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/114 2024-03-18T00:46:12.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/114 2024-03-18T00:46:12.940 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:12.942 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:12.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:12.963 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-18T00:46:13.232 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:13.237 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:13.238 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:13.239 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:13.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:13.482 INFO:teuthology.orchestra.run.smithi081.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:46:13.486 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/115 2024-03-18T00:46:13.486 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/115 2024-03-18T00:46:13.486 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:13.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:13.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:13.537 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-18T00:46:13.867 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:13.871 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:13.872 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:13.873 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:13.873 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:14.121 INFO:teuthology.orchestra.run.smithi081.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:46:14.124 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/116 2024-03-18T00:46:14.124 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/116 2024-03-18T00:46:14.125 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:14.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:14.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:14.180 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-18T00:46:14.522 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:14.526 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:14.526 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:14.527 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:20.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:46:20.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:46:24.516 INFO:teuthology.orchestra.run.smithi081.stdout:generic/117 10s 2024-03-18T00:46:24.526 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/117 2024-03-18T00:46:24.526 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:24.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:24.546 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-18T00:46:24.735 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:24.739 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:24.739 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:24.740 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:24.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:25.308 INFO:teuthology.orchestra.run.smithi081.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:46:25.312 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/118 2024-03-18T00:46:25.312 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/118 2024-03-18T00:46:25.312 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:25.314 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:25.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:25.372 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-18T00:46:25.712 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:25.716 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:25.716 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:25.717 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:25.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:25.944 INFO:teuthology.orchestra.run.smithi081.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:46:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/119 2024-03-18T00:46:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/119 2024-03-18T00:46:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:25.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:26.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:26.002 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-18T00:46:26.340 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:26.345 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:26.346 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:26.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:26.586 INFO:teuthology.orchestra.run.smithi081.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-18T00:46:26.590 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/120 2024-03-18T00:46:26.590 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/120 2024-03-18T00:46:26.590 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:26.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:26.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:26.603 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-18T00:46:26.777 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:26.781 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:26.781 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:26.782 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:26.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:27.012 INFO:teuthology.orchestra.run.smithi081.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T00:46:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/121 2024-03-18T00:46:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/121 2024-03-18T00:46:27.018 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:27.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:27.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:27.080 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-18T00:46:27.415 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:27.418 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:27.419 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:27.420 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:27.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:27.662 INFO:teuthology.orchestra.run.smithi081.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T00:46:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/122 2024-03-18T00:46:27.665 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/122 2024-03-18T00:46:27.666 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:27.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:27.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:27.725 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-18T00:46:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:28.073 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:28.074 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:28.074 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:generic/123 0s 2024-03-18T00:46:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/123 2024-03-18T00:46:28.595 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:28.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:28.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:28.649 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-18T00:46:28.986 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:28.990 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:28.991 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:28.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:30.852 INFO:teuthology.orchestra.run.smithi081.stdout:generic/124 1s 2024-03-18T00:46:30.867 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/124 2024-03-18T00:46:30.867 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:46:30.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:31.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:46:31.461 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-18T00:46:31.810 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:46:31.814 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:46:31.814 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:46:31.815 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:46:31.815 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:46:50.945 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:46:50.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:47:21.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:47:21.171 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:47:33.255 INFO:teuthology.orchestra.run.smithi081.stdout:generic/125 62s 2024-03-18T00:47:33.261 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/125 2024-03-18T00:47:33.261 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:47:33.264 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:47:33.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:47:33.300 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-18T00:47:33.647 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:47:33.652 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:47:33.652 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:47:33.653 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:47:33.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:47:34.023 INFO:teuthology.orchestra.run.smithi081.stdout:generic/126 1s 2024-03-18T00:47:34.028 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/126 2024-03-18T00:47:34.029 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:47:34.031 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:47:34.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:47:34.112 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-18T00:47:34.467 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:47:34.471 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:47:34.472 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:47:34.474 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:47:34.474 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:47:51.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:47:51.241 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:48:21.383 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:48:21.387 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:48:51.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:48:51.606 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:49:21.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:49:21.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:49:51.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:49:51.735 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:50:21.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:50:21.793 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:50:51.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:50:51.881 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:51:22.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:51:22.289 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:51:52.359 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:51:52.362 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:52:22.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:52:22.476 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:52:52.863 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:52:52.866 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:53:22.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:53:22.923 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:53:53.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:53:53.062 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:54:23.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:54:23.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:54:53.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:54:53.434 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:55:23.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:55:23.537 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:55:53.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:55:53.640 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:56:06.921 INFO:teuthology.orchestra.run.smithi081.stdout:generic/127 512s 2024-03-18T00:56:06.926 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/127 2024-03-18T00:56:06.927 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:06.929 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:06.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:06.969 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-18T00:56:07.306 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:07.310 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:07.310 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:07.311 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:07.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:08.110 INFO:teuthology.orchestra.run.smithi081.stdout:generic/128 1s 2024-03-18T00:56:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/128 2024-03-18T00:56:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:08.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:08.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:08.136 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-18T00:56:08.364 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:08.368 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:08.368 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:08.369 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:08.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:08.586 INFO:teuthology.orchestra.run.smithi081.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-18T00:56:08.590 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/129 2024-03-18T00:56:08.590 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/129 2024-03-18T00:56:08.590 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:08.592 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:08.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:08.610 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-18T00:56:08.786 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:08.789 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:08.790 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:08.791 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:08.791 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:09.006 INFO:teuthology.orchestra.run.smithi081.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-18T00:56:09.009 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/130 2024-03-18T00:56:09.010 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/130 2024-03-18T00:56:09.010 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:09.012 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:09.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:09.031 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-18T00:56:09.205 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:09.209 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:09.209 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:09.210 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:09.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:10.493 INFO:teuthology.orchestra.run.smithi081.stdout:generic/131 1s 2024-03-18T00:56:10.499 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/131 2024-03-18T00:56:10.499 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:10.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:10.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:10.558 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-18T00:56:10.895 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:10.899 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:10.900 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:10.901 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:10.901 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:22.438 INFO:teuthology.orchestra.run.smithi081.stdout:generic/132 12s 2024-03-18T00:56:22.443 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/132 2024-03-18T00:56:22.443 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:56:22.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:22.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:56:22.454 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-18T00:56:22.631 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:56:22.635 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:56:22.635 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:56:22.636 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:56:22.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:56:23.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:56:23.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:56:53.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:56:53.831 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:57:23.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:57:23.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:57:54.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:57:54.030 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:58:24.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:58:24.144 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:58:54.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:58:54.335 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:59:24.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:59:24.392 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:59:54.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:59:54.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T00:59:58.361 INFO:teuthology.orchestra.run.smithi081.stdout:generic/133 216s 2024-03-18T00:59:58.366 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/133 2024-03-18T00:59:58.366 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:59:58.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:59:58.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:59:58.411 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-18T00:59:58.779 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:59:58.783 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:59:58.784 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:59:58.785 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:59:58.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:59:59.101 INFO:teuthology.orchestra.run.smithi081.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T00:59:59.104 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/134 2024-03-18T00:59:59.104 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/134 2024-03-18T00:59:59.104 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T00:59:59.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T00:59:59.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T00:59:59.159 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-18T00:59:59.528 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T00:59:59.531 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T00:59:59.532 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T00:59:59.532 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T00:59:59.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:00.335 INFO:teuthology.orchestra.run.smithi081.stdout:generic/135 1s 2024-03-18T01:00:00.340 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/135 2024-03-18T01:00:00.340 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:00.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:00.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:00.351 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-18T01:00:00.527 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:00.531 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:00.531 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:00.532 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:00.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:00.772 INFO:teuthology.orchestra.run.smithi081.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T01:00:00.775 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/136 2024-03-18T01:00:00.776 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/136 2024-03-18T01:00:00.776 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:00.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:00.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:00.842 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-18T01:00:01.173 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:01.176 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:01.177 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:01.178 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:01.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:01.427 INFO:teuthology.orchestra.run.smithi081.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/137 2024-03-18T01:00:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/137 2024-03-18T01:00:01.430 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:01.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:01.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:01.483 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-18T01:00:01.823 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:01.827 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:01.828 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:01.829 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:01.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:02.058 INFO:teuthology.orchestra.run.smithi081.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:02.062 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/138 2024-03-18T01:00:02.062 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/138 2024-03-18T01:00:02.062 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:02.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:02.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:02.118 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-18T01:00:02.458 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:02.462 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:02.462 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:02.463 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:02.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:02.699 INFO:teuthology.orchestra.run.smithi081.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:02.703 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/139 2024-03-18T01:00:02.703 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/139 2024-03-18T01:00:02.703 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:02.705 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:02.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:02.752 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-18T01:00:03.093 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:03.097 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:03.098 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:03.099 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:03.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:03.325 INFO:teuthology.orchestra.run.smithi081.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:03.328 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/140 2024-03-18T01:00:03.329 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/140 2024-03-18T01:00:03.329 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:03.331 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:03.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:03.399 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-18T01:00:03.741 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:03.745 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:03.745 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:03.746 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:03.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:04.040 INFO:teuthology.orchestra.run.smithi081.stdout:generic/141 1s 2024-03-18T01:00:04.045 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/141 2024-03-18T01:00:04.045 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:04.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:04.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:04.056 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-18T01:00:04.228 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:04.232 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:04.232 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:04.233 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:04.233 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:04.463 INFO:teuthology.orchestra.run.smithi081.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:04.466 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/142 2024-03-18T01:00:04.467 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/142 2024-03-18T01:00:04.467 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:04.468 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:04.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:04.532 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-18T01:00:04.867 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:04.871 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:04.871 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:04.872 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:04.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:05.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:05.117 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/143 2024-03-18T01:00:05.117 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/143 2024-03-18T01:00:05.117 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:05.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:05.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:05.172 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-18T01:00:05.495 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:05.499 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:05.500 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:05.501 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:05.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:05.740 INFO:teuthology.orchestra.run.smithi081.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:05.744 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/144 2024-03-18T01:00:05.744 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/144 2024-03-18T01:00:05.744 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:05.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:05.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:05.795 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-18T01:00:06.135 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:06.139 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:06.139 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:06.141 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:06.141 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:06.380 INFO:teuthology.orchestra.run.smithi081.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:06.384 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/145 2024-03-18T01:00:06.384 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/145 2024-03-18T01:00:06.384 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:06.386 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:06.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:06.440 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-18T01:00:06.788 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:06.791 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:06.792 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:06.792 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:06.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:07.031 INFO:teuthology.orchestra.run.smithi081.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:07.034 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/146 2024-03-18T01:00:07.034 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/146 2024-03-18T01:00:07.035 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:07.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:07.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:07.087 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-18T01:00:07.410 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:07.415 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:07.415 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:07.416 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:07.416 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:07.651 INFO:teuthology.orchestra.run.smithi081.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:07.655 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/147 2024-03-18T01:00:07.655 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/147 2024-03-18T01:00:07.655 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:07.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:07.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:07.705 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-18T01:00:08.031 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:08.035 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:08.035 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:08.036 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:08.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:08.274 INFO:teuthology.orchestra.run.smithi081.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:08.278 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/148 2024-03-18T01:00:08.279 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/148 2024-03-18T01:00:08.279 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:08.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:08.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:08.334 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-18T01:00:08.697 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:08.701 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:08.701 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:08.702 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:08.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:08.949 INFO:teuthology.orchestra.run.smithi081.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:08.953 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/149 2024-03-18T01:00:08.953 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/149 2024-03-18T01:00:08.953 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:08.956 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:08.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:08.998 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-18T01:00:09.356 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:09.360 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:09.361 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:09.362 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:09.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:09.597 INFO:teuthology.orchestra.run.smithi081.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:09.600 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/150 2024-03-18T01:00:09.600 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/150 2024-03-18T01:00:09.600 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:09.603 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:09.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:09.661 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-18T01:00:10.004 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:10.008 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:10.008 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:10.009 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:10.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:10.238 INFO:teuthology.orchestra.run.smithi081.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:10.242 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/151 2024-03-18T01:00:10.242 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/151 2024-03-18T01:00:10.242 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:10.245 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:10.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:10.291 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-18T01:00:10.647 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:10.651 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:10.651 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:10.652 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:10.652 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:10.875 INFO:teuthology.orchestra.run.smithi081.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:10.878 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/152 2024-03-18T01:00:10.878 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/152 2024-03-18T01:00:10.878 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:10.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:10.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:10.934 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-18T01:00:11.282 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:11.286 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:11.287 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:11.288 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:11.288 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:11.512 INFO:teuthology.orchestra.run.smithi081.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:11.515 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/153 2024-03-18T01:00:11.515 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/153 2024-03-18T01:00:11.516 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:11.518 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:11.561 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:11.562 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-18T01:00:11.889 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:11.893 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:11.893 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:11.894 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:11.894 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:12.141 INFO:teuthology.orchestra.run.smithi081.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:12.144 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/154 2024-03-18T01:00:12.144 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/154 2024-03-18T01:00:12.145 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:12.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:12.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:12.207 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-18T01:00:12.566 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:12.569 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:12.570 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:12.571 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:12.571 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:12.808 INFO:teuthology.orchestra.run.smithi081.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:12.812 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/155 2024-03-18T01:00:12.812 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/155 2024-03-18T01:00:12.812 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:12.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:12.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:12.875 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-18T01:00:13.215 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:13.219 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:13.219 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:13.220 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:13.220 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:13.455 INFO:teuthology.orchestra.run.smithi081.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:13.459 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/156 2024-03-18T01:00:13.459 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/156 2024-03-18T01:00:13.459 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:13.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:13.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:13.509 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-18T01:00:13.845 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:13.848 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:13.849 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:13.850 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:13.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:14.094 INFO:teuthology.orchestra.run.smithi081.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:14.098 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/157 2024-03-18T01:00:14.098 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/157 2024-03-18T01:00:14.098 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:14.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:14.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:14.160 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-18T01:00:14.501 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:14.505 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:14.506 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:14.507 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:14.738 INFO:teuthology.orchestra.run.smithi081.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T01:00:14.742 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/158 2024-03-18T01:00:14.742 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/158 2024-03-18T01:00:14.742 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:14.744 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:14.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:14.791 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-18T01:00:15.110 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:15.113 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:15.114 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:15.115 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:15.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:15.334 INFO:teuthology.orchestra.run.smithi081.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-18T01:00:15.338 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/159 2024-03-18T01:00:15.338 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/159 2024-03-18T01:00:15.338 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:15.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:15.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:15.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-18T01:00:15.553 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:15.557 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:15.557 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:15.558 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:15.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:15.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-18T01:00:15.779 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/160 2024-03-18T01:00:15.779 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/160 2024-03-18T01:00:15.779 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:15.781 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:15.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:15.798 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-18T01:00:15.978 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:15.982 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:15.982 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:15.983 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:15.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:16.306 INFO:teuthology.orchestra.run.smithi081.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:16.313 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/161 2024-03-18T01:00:16.313 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/161 2024-03-18T01:00:16.313 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:16.317 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:16.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:16.521 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-18T01:00:16.727 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:16.730 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:16.731 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:16.732 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:16.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:17.030 INFO:teuthology.orchestra.run.smithi081.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T01:00:17.067 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/162 2024-03-18T01:00:17.067 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/162 2024-03-18T01:00:17.067 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:17.074 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:17.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:17.284 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-18T01:00:17.495 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:17.499 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:17.499 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:17.500 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:17.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:17.798 INFO:teuthology.orchestra.run.smithi081.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T01:00:17.850 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/163 2024-03-18T01:00:17.850 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/163 2024-03-18T01:00:17.850 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:17.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:18.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:18.047 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-18T01:00:18.266 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:18.270 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:18.270 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:18.271 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:18.271 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:18.602 INFO:teuthology.orchestra.run.smithi081.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:18.607 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/164 2024-03-18T01:00:18.607 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/164 2024-03-18T01:00:18.607 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:18.611 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:18.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:18.806 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-18T01:00:19.025 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:19.029 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:19.029 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:19.030 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:19.030 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:19.362 INFO:teuthology.orchestra.run.smithi081.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:19.369 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/165 2024-03-18T01:00:19.369 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/165 2024-03-18T01:00:19.370 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:19.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:19.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:19.595 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-18T01:00:19.802 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:19.805 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:19.806 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:19.807 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:19.807 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:20.160 INFO:teuthology.orchestra.run.smithi081.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:20.167 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/166 2024-03-18T01:00:20.167 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/166 2024-03-18T01:00:20.167 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:20.169 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:20.322 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:20.322 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-18T01:00:20.552 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:20.556 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:20.556 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:20.557 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:20.557 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:20.909 INFO:teuthology.orchestra.run.smithi081.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:20.915 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/167 2024-03-18T01:00:20.915 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/167 2024-03-18T01:00:20.915 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:20.917 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:21.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:21.087 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-18T01:00:21.309 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:21.313 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:21.314 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:21.315 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:21.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:21.664 INFO:teuthology.orchestra.run.smithi081.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:21.670 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/168 2024-03-18T01:00:21.670 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/168 2024-03-18T01:00:21.670 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:21.674 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:21.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:21.893 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-18T01:00:22.085 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:22.089 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:22.089 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:22.090 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:22.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:22.525 INFO:teuthology.orchestra.run.smithi081.stdout:generic/169 0s 2024-03-18T01:00:22.530 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/169 2024-03-18T01:00:22.530 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:22.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:22.541 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-18T01:00:22.714 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:22.718 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:22.718 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:22.719 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:23.062 INFO:teuthology.orchestra.run.smithi081.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:23.069 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/170 2024-03-18T01:00:23.069 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/170 2024-03-18T01:00:23.069 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:23.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:23.269 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-18T01:00:23.473 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:23.477 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:23.477 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:23.478 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:23.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:23.817 INFO:teuthology.orchestra.run.smithi081.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:23.822 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/171 2024-03-18T01:00:23.822 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/171 2024-03-18T01:00:23.822 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:23.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:24.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:24.092 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-18T01:00:24.267 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:24.270 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:24.271 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:24.272 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:24.272 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:24.545 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:00:24.547 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:00:24.627 INFO:teuthology.orchestra.run.smithi081.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/172 2024-03-18T01:00:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/172 2024-03-18T01:00:24.633 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:24.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:24.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:24.899 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-18T01:00:25.146 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:25.150 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:25.150 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:25.151 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:25.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:25.505 INFO:teuthology.orchestra.run.smithi081.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:25.511 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/173 2024-03-18T01:00:25.512 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/173 2024-03-18T01:00:25.512 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:25.515 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:25.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:25.735 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-18T01:00:25.982 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:25.985 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:25.986 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:25.986 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:25.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:26.330 INFO:teuthology.orchestra.run.smithi081.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:26.336 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/174 2024-03-18T01:00:26.336 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/174 2024-03-18T01:00:26.336 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:26.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:26.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:26.534 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-18T01:00:26.761 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:26.765 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:26.765 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:26.766 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:26.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:27.107 INFO:teuthology.orchestra.run.smithi081.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:27.114 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/175 2024-03-18T01:00:27.114 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/175 2024-03-18T01:00:27.114 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:27.116 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:27.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:27.324 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-18T01:00:27.529 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:27.533 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:27.533 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:27.534 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:27.534 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:27.877 INFO:teuthology.orchestra.run.smithi081.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/176 2024-03-18T01:00:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/176 2024-03-18T01:00:27.884 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:27.890 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:28.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:28.109 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-18T01:00:28.316 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:28.320 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:28.321 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:28.322 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:28.322 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:28.649 INFO:teuthology.orchestra.run.smithi081.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T01:00:28.653 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/177 2024-03-18T01:00:28.653 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/177 2024-03-18T01:00:28.653 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:28.655 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:28.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:28.704 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-18T01:00:29.054 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:29.058 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:29.058 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:29.059 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:29.059 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:29.295 INFO:teuthology.orchestra.run.smithi081.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:29.299 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/178 2024-03-18T01:00:29.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/178 2024-03-18T01:00:29.299 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:29.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:29.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:29.358 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-18T01:00:29.697 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:29.701 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:29.701 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:29.702 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:29.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:29.933 INFO:teuthology.orchestra.run.smithi081.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:29.937 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/179 2024-03-18T01:00:29.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/179 2024-03-18T01:00:29.937 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:30.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:30.001 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-18T01:00:30.411 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:30.414 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:30.415 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:30.416 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:30.416 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:30.640 INFO:teuthology.orchestra.run.smithi081.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:30.644 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/180 2024-03-18T01:00:30.644 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/180 2024-03-18T01:00:30.644 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:30.646 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:30.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:30.728 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-18T01:00:31.062 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:31.066 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:31.066 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:31.067 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:31.067 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:31.291 INFO:teuthology.orchestra.run.smithi081.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/181 2024-03-18T01:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/181 2024-03-18T01:00:31.295 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:31.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:31.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:31.348 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-18T01:00:31.702 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:31.706 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:31.706 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:31.707 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:31.707 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:31.937 INFO:teuthology.orchestra.run.smithi081.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T01:00:31.941 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/182 2024-03-18T01:00:31.941 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/182 2024-03-18T01:00:31.941 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:31.943 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:31.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:31.989 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-18T01:00:32.341 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:32.345 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:32.345 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:32.346 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:32.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:32.706 INFO:teuthology.orchestra.run.smithi081.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:32.717 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/183 2024-03-18T01:00:32.717 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/183 2024-03-18T01:00:32.718 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:32.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:33.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:33.082 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-18T01:00:33.265 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:33.268 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:33.269 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:33.270 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:33.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:33.514 INFO:teuthology.orchestra.run.smithi081.stdout:generic/184 0s 2024-03-18T01:00:33.519 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/184 2024-03-18T01:00:33.519 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:33.521 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:33.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:33.535 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-18T01:00:33.712 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:33.716 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:33.716 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:33.717 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:33.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:34.035 INFO:teuthology.orchestra.run.smithi081.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:34.048 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/185 2024-03-18T01:00:34.048 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/185 2024-03-18T01:00:34.049 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:34.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:34.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:34.220 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-18T01:00:34.473 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:34.477 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:34.477 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:34.478 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:34.478 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:34.800 INFO:teuthology.orchestra.run.smithi081.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:34.805 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/186 2024-03-18T01:00:34.805 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/186 2024-03-18T01:00:34.805 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:34.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:34.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:34.953 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-18T01:00:35.216 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:35.221 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:35.221 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:35.222 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:35.222 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:35.581 INFO:teuthology.orchestra.run.smithi081.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:35.587 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/187 2024-03-18T01:00:35.587 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/187 2024-03-18T01:00:35.587 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:35.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:35.718 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-18T01:00:35.972 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:35.976 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:35.976 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:35.977 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:36.322 INFO:teuthology.orchestra.run.smithi081.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:36.327 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/188 2024-03-18T01:00:36.327 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/188 2024-03-18T01:00:36.327 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:36.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:36.593 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-18T01:00:36.781 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:36.785 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:36.785 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:36.786 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:36.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:37.123 INFO:teuthology.orchestra.run.smithi081.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:37.129 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/189 2024-03-18T01:00:37.129 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/189 2024-03-18T01:00:37.129 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:37.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:37.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:37.329 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-18T01:00:37.548 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:37.552 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:37.552 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:37.553 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:37.554 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:37.906 INFO:teuthology.orchestra.run.smithi081.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:37.911 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/190 2024-03-18T01:00:37.912 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/190 2024-03-18T01:00:37.912 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:37.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:38.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:38.099 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-18T01:00:38.303 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:38.307 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:38.307 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:38.308 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:38.308 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:38.652 INFO:teuthology.orchestra.run.smithi081.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:38.658 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/191 2024-03-18T01:00:38.658 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/191 2024-03-18T01:00:38.658 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:38.662 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:38.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:38.806 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-18T01:00:39.064 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:39.068 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:39.068 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:39.069 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:39.283 INFO:teuthology.orchestra.run.smithi081.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-18T01:00:39.287 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/192 2024-03-18T01:00:39.287 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/192 2024-03-18T01:00:39.287 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:39.289 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:39.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:39.318 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-18T01:00:39.505 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:39.508 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:39.509 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:39.510 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:39.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:40.468 INFO:teuthology.orchestra.run.smithi081.stdout:generic/193 1s 2024-03-18T01:00:40.473 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/193 2024-03-18T01:00:40.473 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:40.475 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:40.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:40.532 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-18T01:00:40.876 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:40.880 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:40.880 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:40.881 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:40.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:41.204 INFO:teuthology.orchestra.run.smithi081.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:41.209 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/194 2024-03-18T01:00:41.210 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/194 2024-03-18T01:00:41.210 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:41.213 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:41.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:41.408 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-18T01:00:41.636 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:41.640 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:41.641 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:41.641 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:41.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:41.979 INFO:teuthology.orchestra.run.smithi081.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/195 2024-03-18T01:00:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/195 2024-03-18T01:00:41.986 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:41.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:42.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:42.181 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-18T01:00:42.405 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:42.409 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:42.409 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:42.410 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:42.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:42.754 INFO:teuthology.orchestra.run.smithi081.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:42.763 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/196 2024-03-18T01:00:42.763 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/196 2024-03-18T01:00:42.763 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:42.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:42.885 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-18T01:00:43.153 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:43.157 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:43.158 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:43.515 INFO:teuthology.orchestra.run.smithi081.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:43.522 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/197 2024-03-18T01:00:43.522 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/197 2024-03-18T01:00:43.522 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:43.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:43.746 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-18T01:00:43.955 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:43.959 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:43.959 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:43.960 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:43.960 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:44.570 INFO:teuthology.orchestra.run.smithi081.stdout:generic/198 0s 2024-03-18T01:00:44.575 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/198 2024-03-18T01:00:44.575 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:44.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:44.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:44.623 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-18T01:00:44.954 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:44.959 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:44.960 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:44.960 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:45.288 INFO:teuthology.orchestra.run.smithi081.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:45.295 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/199 2024-03-18T01:00:45.295 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/199 2024-03-18T01:00:45.295 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:45.297 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:45.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:45.523 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-18T01:00:45.738 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:45.742 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:45.742 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:45.743 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:45.743 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:46.118 INFO:teuthology.orchestra.run.smithi081.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/200 2024-03-18T01:00:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/200 2024-03-18T01:00:46.125 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:46.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:46.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:46.295 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-18T01:00:46.511 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:46.515 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:46.516 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:46.517 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:46.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:46.846 INFO:teuthology.orchestra.run.smithi081.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:46.853 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/201 2024-03-18T01:00:46.853 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/201 2024-03-18T01:00:46.853 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:46.855 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:47.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:47.002 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-18T01:00:47.254 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:47.258 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:47.258 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:47.259 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:47.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:47.615 INFO:teuthology.orchestra.run.smithi081.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:47.621 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/202 2024-03-18T01:00:47.621 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/202 2024-03-18T01:00:47.621 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:47.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:47.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:47.813 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-18T01:00:48.041 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:48.045 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:48.045 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:48.046 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:48.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:48.389 INFO:teuthology.orchestra.run.smithi081.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:48.394 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/203 2024-03-18T01:00:48.394 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/203 2024-03-18T01:00:48.394 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:48.397 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:48.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:48.555 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-18T01:00:48.799 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:48.803 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:48.803 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:48.804 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:48.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:50.057 INFO:teuthology.orchestra.run.smithi081.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:00:50.061 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/204 2024-03-18T01:00:50.061 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/204 2024-03-18T01:00:50.061 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:50.064 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:50.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:50.088 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-18T01:00:50.274 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:50.278 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:50.279 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:50.280 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:50.280 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:50.638 INFO:teuthology.orchestra.run.smithi081.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:50.645 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/205 2024-03-18T01:00:50.645 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/205 2024-03-18T01:00:50.645 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:50.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:50.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:50.814 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-18T01:00:51.048 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:51.052 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:51.053 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:51.054 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:51.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:51.372 INFO:teuthology.orchestra.run.smithi081.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:00:51.379 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/206 2024-03-18T01:00:51.380 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/206 2024-03-18T01:00:51.380 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:51.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:51.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:51.551 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-18T01:00:51.786 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:00:51.790 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:00:51.790 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:00:51.791 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:00:51.791 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:54.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:00:54.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:00:59.739 INFO:teuthology.orchestra.run.smithi081.stdout:generic/207 8s 2024-03-18T01:00:59.744 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/207 2024-03-18T01:00:59.744 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:00:59.746 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:00:59.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:00:59.784 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-18T01:01:00.128 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:01:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:01:00.132 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:01:00.133 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:01:00.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:01:24.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:01:24.847 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:01:54.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:01:54.909 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:02:24.980 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:02:24.983 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:02:55.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:02:55.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:03:25.323 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:03:25.326 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:03:55.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:03:55.481 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:04:20.471 INFO:teuthology.orchestra.run.smithi081.stdout:generic/208 200s 2024-03-18T01:04:20.476 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/208 2024-03-18T01:04:20.476 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:04:20.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:04:20.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:04:20.539 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-18T01:04:20.902 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:04:20.902 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:04:20.902 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:04:20.902 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:04:20.902 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:04:25.544 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:04:25.547 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:04:55.876 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:04:55.879 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:05:01.061 INFO:teuthology.orchestra.run.smithi081.stdout:generic/209 41s 2024-03-18T01:05:01.067 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/209 2024-03-18T01:05:01.067 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:01.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:01.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:01.122 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-18T01:05:01.490 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:01.494 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:01.494 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:01.495 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:01.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:01.805 INFO:teuthology.orchestra.run.smithi081.stdout:generic/210 0s 2024-03-18T01:05:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/210 2024-03-18T01:05:01.810 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:01.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:01.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:01.859 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-18T01:05:02.226 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:02.230 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:02.230 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:02.231 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:02.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:02.595 INFO:teuthology.orchestra.run.smithi081.stdout:generic/211 0s 2024-03-18T01:05:02.600 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/211 2024-03-18T01:05:02.600 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:02.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:02.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:02.619 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-18T01:05:02.792 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:02.795 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:02.796 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:02.796 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:02.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.077 INFO:teuthology.orchestra.run.smithi081.stdout:generic/212 1s 2024-03-18T01:05:03.082 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/212 2024-03-18T01:05:03.082 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:03.085 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:03.099 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-18T01:05:03.286 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:03.290 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:03.290 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:03.291 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:03.291 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.513 INFO:teuthology.orchestra.run.smithi081.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:05:03.517 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/213 2024-03-18T01:05:03.517 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/213 2024-03-18T01:05:03.517 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:03.519 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:03.530 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-18T01:05:03.713 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:03.716 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:03.717 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:03.718 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:03.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.928 INFO:teuthology.orchestra.run.smithi081.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:05:03.932 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/214 2024-03-18T01:05:03.932 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/214 2024-03-18T01:05:03.933 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:03.935 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:03.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:03.946 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-18T01:05:04.120 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:04.124 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:04.124 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:04.125 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:04.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:06.384 INFO:teuthology.orchestra.run.smithi081.stdout:generic/215 2s 2024-03-18T01:05:06.389 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/215 2024-03-18T01:05:06.389 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:06.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:06.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:06.420 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-18T01:05:06.606 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:06.609 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:06.610 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:06.611 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:06.611 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:06.950 INFO:teuthology.orchestra.run.smithi081.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:06.957 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/216 2024-03-18T01:05:06.957 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/216 2024-03-18T01:05:06.957 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:06.960 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:07.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:07.107 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-18T01:05:07.360 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:07.363 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:07.364 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:07.364 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:07.365 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:07.699 INFO:teuthology.orchestra.run.smithi081.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/217 2024-03-18T01:05:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/217 2024-03-18T01:05:07.706 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:07.709 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:07.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:07.906 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-18T01:05:08.128 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:08.242 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:08.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:08.472 INFO:teuthology.orchestra.run.smithi081.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:08.478 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/218 2024-03-18T01:05:08.479 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/218 2024-03-18T01:05:08.479 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:08.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:08.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:08.660 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-18T01:05:08.904 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:08.908 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:08.908 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:08.909 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:08.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:09.108 INFO:teuthology.orchestra.run.smithi081.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:09.111 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/219 2024-03-18T01:05:09.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/219 2024-03-18T01:05:09.111 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:09.114 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:09.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:09.135 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-18T01:05:09.311 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:09.314 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:09.315 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:09.316 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:09.316 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:09.657 INFO:teuthology.orchestra.run.smithi081.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:09.662 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/220 2024-03-18T01:05:09.662 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/220 2024-03-18T01:05:09.662 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:09.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:09.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:09.803 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-18T01:05:10.075 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:10.079 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:10.079 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:10.080 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:10.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:11.315 INFO:teuthology.orchestra.run.smithi081.stdout:generic/221 1s 2024-03-18T01:05:11.321 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/221 2024-03-18T01:05:11.321 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:11.324 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:11.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:11.340 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-18T01:05:11.519 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:11.522 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:11.523 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:11.524 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:11.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:11.872 INFO:teuthology.orchestra.run.smithi081.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:11.877 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/222 2024-03-18T01:05:11.877 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/222 2024-03-18T01:05:11.877 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:11.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:12.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:12.072 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-18T01:05:12.299 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:12.303 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:12.303 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:12.304 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:12.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:12.518 INFO:teuthology.orchestra.run.smithi081.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:05:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/223 2024-03-18T01:05:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/223 2024-03-18T01:05:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:12.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:12.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:12.537 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-18T01:05:12.727 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:12.731 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:12.732 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:12.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:12.930 INFO:teuthology.orchestra.run.smithi081.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:05:12.934 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/224 2024-03-18T01:05:12.934 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/224 2024-03-18T01:05:12.934 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:12.936 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:12.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:12.948 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-18T01:05:13.128 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:13.131 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:13.131 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:13.132 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:13.388 INFO:teuthology.orchestra.run.smithi081.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T01:05:13.392 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/225 2024-03-18T01:05:13.392 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/225 2024-03-18T01:05:13.392 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:13.394 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:13.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:13.444 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-18T01:05:13.795 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:13.799 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:13.800 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:13.801 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:13.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:14.042 INFO:teuthology.orchestra.run.smithi081.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:05:14.046 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/226 2024-03-18T01:05:14.046 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/226 2024-03-18T01:05:14.046 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:14.048 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:14.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:14.061 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-18T01:05:14.239 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:14.243 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:14.243 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:14.244 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:14.244 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:14.608 INFO:teuthology.orchestra.run.smithi081.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:14.616 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/227 2024-03-18T01:05:14.616 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/227 2024-03-18T01:05:14.616 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:14.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:14.728 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-18T01:05:15.003 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:15.008 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:15.009 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:15.009 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:15.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:15.226 INFO:teuthology.orchestra.run.smithi081.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:05:15.231 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/228 2024-03-18T01:05:15.231 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/228 2024-03-18T01:05:15.232 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:15.233 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:15.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:15.244 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-18T01:05:15.425 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:15.429 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:15.429 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:15.430 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:15.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:15.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/229 2024-03-18T01:05:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/229 2024-03-18T01:05:15.780 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:15.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:16.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:16.042 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-18T01:05:16.228 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:16.232 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:16.232 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:16.233 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:16.233 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:16.435 INFO:teuthology.orchestra.run.smithi081.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:16.439 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/230 2024-03-18T01:05:16.439 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/230 2024-03-18T01:05:16.439 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:16.441 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:16.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:16.452 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-18T01:05:16.630 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:16.633 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:16.634 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:16.634 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:16.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:16.834 INFO:teuthology.orchestra.run.smithi081.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:16.837 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/231 2024-03-18T01:05:16.838 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/231 2024-03-18T01:05:16.838 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:16.840 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:16.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:16.866 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-18T01:05:17.044 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:17.047 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:17.048 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:17.049 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:17.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:17.247 INFO:teuthology.orchestra.run.smithi081.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:17.251 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/232 2024-03-18T01:05:17.251 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/232 2024-03-18T01:05:17.251 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:17.253 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:17.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:17.264 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-18T01:05:17.450 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:17.453 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:17.454 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:17.455 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:17.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:17.652 INFO:teuthology.orchestra.run.smithi081.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:17.655 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/233 2024-03-18T01:05:17.655 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/233 2024-03-18T01:05:17.655 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:17.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:17.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:17.669 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-18T01:05:17.839 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:17.842 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:17.843 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:17.844 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:17.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:18.046 INFO:teuthology.orchestra.run.smithi081.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:18.050 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/234 2024-03-18T01:05:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/234 2024-03-18T01:05:18.051 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:18.052 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:18.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:18.064 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-18T01:05:18.248 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:18.252 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:18.252 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:18.253 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:18.253 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:18.455 INFO:teuthology.orchestra.run.smithi081.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:05:18.459 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/235 2024-03-18T01:05:18.459 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/235 2024-03-18T01:05:18.459 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:18.461 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:18.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:18.472 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-18T01:05:18.660 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:18.663 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:18.664 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:18.665 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:19.919 INFO:teuthology.orchestra.run.smithi081.stdout:generic/236 1s 2024-03-18T01:05:19.924 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/236 2024-03-18T01:05:19.924 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:19.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:19.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:19.962 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-18T01:05:20.319 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:20.323 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:20.323 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:20.324 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:20.324 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:20.604 INFO:teuthology.orchestra.run.smithi081.stdout:generic/237 0s 2024-03-18T01:05:20.609 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/237 2024-03-18T01:05:20.610 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:20.612 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:20.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:20.662 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-18T01:05:21.007 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:21.012 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:21.012 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:21.013 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:21.013 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:21.347 INFO:teuthology.orchestra.run.smithi081.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:05:21.355 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/238 2024-03-18T01:05:21.355 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/238 2024-03-18T01:05:21.355 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:21.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:21.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:21.558 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-18T01:05:21.791 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:21.794 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:21.795 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:21.795 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:21.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:22.031 INFO:teuthology.orchestra.run.smithi081.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-18T01:05:22.035 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/239 2024-03-18T01:05:22.035 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/239 2024-03-18T01:05:22.035 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:22.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:22.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:22.056 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-18T01:05:22.243 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:22.246 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:22.247 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:22.247 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:22.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:22.466 INFO:teuthology.orchestra.run.smithi081.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-18T01:05:22.470 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/240 2024-03-18T01:05:22.470 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/240 2024-03-18T01:05:22.470 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:05:22.472 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:22.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:05:22.493 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-18T01:05:22.675 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:05:22.678 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:05:22.679 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:05:22.680 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:05:22.680 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:05:25.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:05:25.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:05:25.977 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T01:05:25.977+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45558) UID: 0 2024-03-18T01:05:25.977 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T01:05:25.977+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45558) UID: 0 2024-03-18T01:06:35.899 INFO:teuthology.orchestra.run.smithi081.stdout:generic/241 73s 2024-03-18T01:06:35.904 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/241 2024-03-18T01:06:35.904 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:35.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:38.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:38.399 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-18T01:06:38.711 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:38.714 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:38.715 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:38.716 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:38.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:39.723 INFO:teuthology.orchestra.run.smithi081.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:39.728 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/242 2024-03-18T01:06:39.729 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/242 2024-03-18T01:06:39.729 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:39.732 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:39.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:39.924 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-18T01:06:40.213 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:40.217 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:40.219 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:40.219 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:40.931 INFO:teuthology.orchestra.run.smithi081.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:40.940 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/243 2024-03-18T01:06:40.940 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/243 2024-03-18T01:06:40.941 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:40.945 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:41.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:41.107 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-18T01:06:41.379 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:41.383 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:41.383 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:41.384 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:41.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:41.681 INFO:teuthology.orchestra.run.smithi081.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:06:41.685 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/244 2024-03-18T01:06:41.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/244 2024-03-18T01:06:41.685 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:41.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:41.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:41.711 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-18T01:06:41.914 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:41.918 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:41.918 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:41.919 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:41.919 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:42.201 INFO:teuthology.orchestra.run.smithi081.stdout:generic/245 0s 2024-03-18T01:06:42.206 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/245 2024-03-18T01:06:42.206 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:42.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:42.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:42.278 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-18T01:06:42.764 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:42.768 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:42.769 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:43.054 INFO:teuthology.orchestra.run.smithi081.stdout:generic/246 1s 2024-03-18T01:06:43.123 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/246 2024-03-18T01:06:43.124 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:43.215 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:43.215 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-18T01:06:43.589 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:43.593 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:43.593 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:43.594 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:48.611 INFO:teuthology.orchestra.run.smithi081.stdout:generic/247 5s 2024-03-18T01:06:48.616 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/247 2024-03-18T01:06:48.616 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:48.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:48.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:48.627 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-18T01:06:48.808 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:48.811 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:48.812 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:48.813 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:48.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:49.060 INFO:teuthology.orchestra.run.smithi081.stdout:generic/248 1s 2024-03-18T01:06:49.066 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/248 2024-03-18T01:06:49.066 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:49.068 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:49.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:49.093 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-18T01:06:49.269 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:49.273 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:49.273 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:49.274 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:49.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:49.707 INFO:teuthology.orchestra.run.smithi081.stdout:generic/249 0s 2024-03-18T01:06:49.712 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/249 2024-03-18T01:06:49.712 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:49.714 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:49.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:49.767 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-18T01:06:50.146 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:50.150 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:50.150 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:50.151 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:50.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:50.389 INFO:teuthology.orchestra.run.smithi081.stdout:generic/250 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:06:50.392 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/250 2024-03-18T01:06:50.393 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/250 2024-03-18T01:06:50.393 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:50.395 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:50.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:50.408 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-18T01:06:50.594 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:50.598 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:50.598 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:50.599 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:50.599 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:50.881 INFO:teuthology.orchestra.run.smithi081.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:50.889 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/251 2024-03-18T01:06:50.889 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/251 2024-03-18T01:06:50.889 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:50.891 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:50.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:50.904 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-18T01:06:51.079 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:51.082 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:51.082 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:51.083 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:51.083 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:51.301 INFO:teuthology.orchestra.run.smithi081.stdout:generic/252 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:06:51.305 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/252 2024-03-18T01:06:51.305 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/252 2024-03-18T01:06:51.305 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:51.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:51.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:51.320 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-18T01:06:51.492 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:51.496 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:51.497 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:51.497 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:51.864 INFO:teuthology.orchestra.run.smithi081.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:51.871 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/253 2024-03-18T01:06:51.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/253 2024-03-18T01:06:51.872 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:51.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:52.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:52.021 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-18T01:06:52.325 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:52.329 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:52.329 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:52.330 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:52.330 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:52.700 INFO:teuthology.orchestra.run.smithi081.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:52.706 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/254 2024-03-18T01:06:52.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/254 2024-03-18T01:06:52.707 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:52.708 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:52.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:52.935 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-18T01:06:53.146 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:53.149 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:53.150 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:53.151 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:53.462 INFO:teuthology.orchestra.run.smithi081.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:06:53.466 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/255 2024-03-18T01:06:53.466 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/255 2024-03-18T01:06:53.466 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:53.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:53.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:53.523 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-18T01:06:53.876 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:53.880 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:53.881 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:53.882 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:53.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:54.406 INFO:teuthology.orchestra.run.smithi081.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:06:54.409 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/256 2024-03-18T01:06:54.410 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/256 2024-03-18T01:06:54.410 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:54.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:54.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:54.432 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-18T01:06:54.617 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:54.620 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:54.621 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:54.622 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:54.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:55.626 INFO:teuthology.orchestra.run.smithi081.stdout:generic/257 1s 2024-03-18T01:06:55.631 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/257 2024-03-18T01:06:55.632 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:55.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:55.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:55.717 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-18T01:06:56.066 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:56.070 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:56.071 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:56.072 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:56.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:56.356 INFO:teuthology.orchestra.run.smithi081.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-18T01:06:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/258 2024-03-18T01:06:56.360 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/258 2024-03-18T01:06:56.361 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:56.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:56.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:56.376 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-18T01:06:56.562 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:56.566 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:56.566 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:56.567 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:56.567 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:56.923 INFO:teuthology.orchestra.run.smithi081.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:56.932 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/259 2024-03-18T01:06:56.933 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/259 2024-03-18T01:06:56.933 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:57.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:57.065 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-18T01:06:57.341 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:57.345 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:57.346 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:57.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:57.630 INFO:teuthology.orchestra.run.smithi081.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:57.639 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/260 2024-03-18T01:06:57.640 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/260 2024-03-18T01:06:57.640 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:57.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:57.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:57.667 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-18T01:06:57.856 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:57.860 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:57.860 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:57.861 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:57.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:58.235 INFO:teuthology.orchestra.run.smithi081.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:58.241 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/261 2024-03-18T01:06:58.241 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/261 2024-03-18T01:06:58.241 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:58.243 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:58.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:58.396 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-18T01:06:58.635 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:58.639 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:58.640 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:58.641 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:58.641 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:59.014 INFO:teuthology.orchestra.run.smithi081.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:06:59.021 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/262 2024-03-18T01:06:59.022 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/262 2024-03-18T01:06:59.022 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:06:59.025 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:06:59.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:06:59.221 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-18T01:06:59.434 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:06:59.438 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:06:59.438 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:06:59.439 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:06:59.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:46.570 INFO:teuthology.orchestra.run.smithi081.stdout:generic/263 47s 2024-03-18T01:07:46.576 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/263 2024-03-18T01:07:46.576 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:46.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:46.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:46.641 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-18T01:07:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:47.035 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:47.035 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:47.036 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:47.036 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:47.402 INFO:teuthology.orchestra.run.smithi081.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/264 2024-03-18T01:07:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/264 2024-03-18T01:07:47.409 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:47.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:47.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:47.626 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-18T01:07:47.881 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:47.884 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:47.885 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:47.886 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:47.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:48.297 INFO:teuthology.orchestra.run.smithi081.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:48.302 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/265 2024-03-18T01:07:48.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/265 2024-03-18T01:07:48.303 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:48.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:48.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:48.435 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-18T01:07:48.692 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:48.695 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:48.696 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:48.697 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:48.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:49.072 INFO:teuthology.orchestra.run.smithi081.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:49.080 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/266 2024-03-18T01:07:49.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/266 2024-03-18T01:07:49.080 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:49.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:49.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:49.337 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-18T01:07:49.527 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:49.531 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:49.531 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:49.532 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:49.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:49.914 INFO:teuthology.orchestra.run.smithi081.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:49.919 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/267 2024-03-18T01:07:49.919 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/267 2024-03-18T01:07:49.919 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:49.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:50.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:50.126 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-18T01:07:50.345 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:50.349 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:50.349 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:50.350 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:50.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:50.725 INFO:teuthology.orchestra.run.smithi081.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:50.731 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/268 2024-03-18T01:07:50.731 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/268 2024-03-18T01:07:50.731 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:50.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:50.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:50.974 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-18T01:07:51.163 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:51.167 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:51.167 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:51.168 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:51.168 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:51.383 INFO:teuthology.orchestra.run.smithi081.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:07:51.386 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/269 2024-03-18T01:07:51.387 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/269 2024-03-18T01:07:51.387 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:51.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:51.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:51.402 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-18T01:07:51.579 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:51.583 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:51.583 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:51.584 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:51.584 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:51.798 INFO:teuthology.orchestra.run.smithi081.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:07:51.801 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/270 2024-03-18T01:07:51.802 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/270 2024-03-18T01:07:51.802 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:51.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:51.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:51.829 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-18T01:07:52.012 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:52.016 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:52.016 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:52.017 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:52.017 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:52.393 INFO:teuthology.orchestra.run.smithi081.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:52.402 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/271 2024-03-18T01:07:52.402 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/271 2024-03-18T01:07:52.402 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:52.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:52.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:52.580 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-18T01:07:52.819 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:52.823 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:52.823 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:52.824 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:52.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:53.205 INFO:teuthology.orchestra.run.smithi081.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:53.212 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/272 2024-03-18T01:07:53.212 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/272 2024-03-18T01:07:53.212 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:53.215 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:53.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:53.389 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-18T01:07:53.622 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:53.626 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:53.626 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:53.627 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:53.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:53.839 INFO:teuthology.orchestra.run.smithi081.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:07:53.843 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/273 2024-03-18T01:07:53.843 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/273 2024-03-18T01:07:53.843 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:53.845 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:53.883 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:53.884 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-18T01:07:54.067 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:54.071 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:54.071 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:54.072 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:54.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:54.299 INFO:teuthology.orchestra.run.smithi081.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T01:07:54.303 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/274 2024-03-18T01:07:54.303 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/274 2024-03-18T01:07:54.303 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:54.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:54.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:54.324 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-18T01:07:54.503 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:54.507 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:54.507 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:54.508 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:54.508 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:54.719 INFO:teuthology.orchestra.run.smithi081.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:07:54.723 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/275 2024-03-18T01:07:54.723 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/275 2024-03-18T01:07:54.723 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:54.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:54.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:54.739 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-18T01:07:54.931 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:54.935 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:54.935 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:54.936 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:54.936 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:55.309 INFO:teuthology.orchestra.run.smithi081.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:55.319 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/276 2024-03-18T01:07:55.319 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/276 2024-03-18T01:07:55.319 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:55.323 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:55.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:55.515 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-18T01:07:55.734 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:55.737 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:55.738 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:55.739 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:55.739 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:55.978 INFO:teuthology.orchestra.run.smithi081.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-18T01:07:55.982 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/277 2024-03-18T01:07:55.982 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/277 2024-03-18T01:07:55.982 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:55.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:56.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:56.012 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-18T01:07:56.190 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:56.194 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:56.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:56.588 INFO:teuthology.orchestra.run.smithi081.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:56.595 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/278 2024-03-18T01:07:56.595 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/278 2024-03-18T01:07:56.596 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:56.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:56.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:56.797 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-18T01:07:57.023 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:57.026 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:57.027 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:57.027 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:57.027 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:57.423 INFO:teuthology.orchestra.run.smithi081.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/279 2024-03-18T01:07:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/279 2024-03-18T01:07:57.428 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:57.431 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:57.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:57.666 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-18T01:07:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:57.870 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:57.871 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:57.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:58.079 INFO:teuthology.orchestra.run.smithi081.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:07:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/280 2024-03-18T01:07:58.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/280 2024-03-18T01:07:58.084 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:58.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:58.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:58.103 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-18T01:07:58.280 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:58.283 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:58.284 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:58.285 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:58.285 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:58.681 INFO:teuthology.orchestra.run.smithi081.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:58.686 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/281 2024-03-18T01:07:58.686 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/281 2024-03-18T01:07:58.687 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:58.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:58.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:58.956 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-18T01:07:59.145 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:59.149 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:59.149 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:59.150 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:59.150 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:59.543 INFO:teuthology.orchestra.run.smithi081.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:07:59.549 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/282 2024-03-18T01:07:59.549 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/282 2024-03-18T01:07:59.549 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:07:59.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:07:59.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:07:59.761 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-18T01:07:59.961 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:07:59.964 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:07:59.965 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:07:59.965 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:07:59.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:00.335 INFO:teuthology.orchestra.run.smithi081.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:00.341 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/283 2024-03-18T01:08:00.341 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/283 2024-03-18T01:08:00.341 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:00.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:00.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:00.637 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-18T01:08:00.830 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:00.834 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:00.834 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:00.835 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:00.835 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:01.215 INFO:teuthology.orchestra.run.smithi081.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/284 2024-03-18T01:08:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/284 2024-03-18T01:08:01.221 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:01.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:01.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:01.498 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-18T01:08:01.682 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:01.686 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:01.686 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:01.687 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:01.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:02.905 INFO:teuthology.orchestra.run.smithi081.stdout:generic/285 1s 2024-03-18T01:08:02.910 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/285 2024-03-18T01:08:02.910 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:02.913 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:03.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:03.253 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-18T01:08:03.637 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:03.641 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:03.641 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:03.642 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:03.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:03.851 INFO:teuthology.orchestra.run.smithi081.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:08:03.855 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/286 2024-03-18T01:08:03.855 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/286 2024-03-18T01:08:03.855 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:03.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:03.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:03.869 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-18T01:08:04.052 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:04.055 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:04.056 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:04.057 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:04.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:04.530 INFO:teuthology.orchestra.run.smithi081.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:04.539 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/287 2024-03-18T01:08:04.539 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/287 2024-03-18T01:08:04.540 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:04.541 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:04.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:04.919 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-18T01:08:05.153 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:05.158 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:05.158 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:05.159 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:05.159 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:05.503 INFO:teuthology.orchestra.run.smithi081.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:05.514 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/288 2024-03-18T01:08:05.514 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/288 2024-03-18T01:08:05.514 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:05.516 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:05.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:05.533 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-18T01:08:05.763 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:05.768 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:05.768 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:05.769 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:05.769 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:06.210 INFO:teuthology.orchestra.run.smithi081.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:06.220 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/289 2024-03-18T01:08:06.220 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/289 2024-03-18T01:08:06.220 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:06.224 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:06.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:06.547 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-18T01:08:06.771 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:06.775 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:06.775 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:06.776 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:07.212 INFO:teuthology.orchestra.run.smithi081.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:07.218 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/290 2024-03-18T01:08:07.219 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/290 2024-03-18T01:08:07.219 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:07.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:07.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:07.477 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-18T01:08:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:07.708 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:07.709 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:07.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:08.167 INFO:teuthology.orchestra.run.smithi081.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:08.174 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/291 2024-03-18T01:08:08.174 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/291 2024-03-18T01:08:08.174 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:08.176 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:08.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:08.506 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-18T01:08:08.713 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:08.718 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:08.719 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:08.720 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:08.720 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:09.192 INFO:teuthology.orchestra.run.smithi081.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:09.198 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/292 2024-03-18T01:08:09.199 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/292 2024-03-18T01:08:09.199 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:09.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:09.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:09.497 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-18T01:08:09.710 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:09.718 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:09.718 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:09.719 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:09.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:10.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:10.120 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/293 2024-03-18T01:08:10.120 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/293 2024-03-18T01:08:10.120 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:10.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:10.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:10.494 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-18T01:08:10.683 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:10.687 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:10.687 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:10.688 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:10.688 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:11.148 INFO:teuthology.orchestra.run.smithi081.stdout:generic/294 1s 2024-03-18T01:08:11.158 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/294 2024-03-18T01:08:11.158 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:11.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:11.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:11.181 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-18T01:08:11.487 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:11.491 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:11.492 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:11.492 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:11.493 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:11.882 INFO:teuthology.orchestra.run.smithi081.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:11.888 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/295 2024-03-18T01:08:11.888 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/295 2024-03-18T01:08:11.888 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:11.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:12.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:12.118 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-18T01:08:12.322 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:12.326 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:12.326 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:12.327 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:12.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:12.673 INFO:teuthology.orchestra.run.smithi081.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:12.678 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/296 2024-03-18T01:08:12.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/296 2024-03-18T01:08:12.678 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:12.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:12.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:12.943 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-18T01:08:13.139 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:13.142 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:13.143 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:13.144 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:13.510 INFO:teuthology.orchestra.run.smithi081.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:13.517 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/297 2024-03-18T01:08:13.517 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/297 2024-03-18T01:08:13.517 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:13.519 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:13.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:08:13.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:13.794 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-18T01:08:13.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:08:14.016 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:14.020 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:14.020 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:14.021 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:14.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:14.383 INFO:teuthology.orchestra.run.smithi081.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:14.390 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/298 2024-03-18T01:08:14.390 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/298 2024-03-18T01:08:14.390 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:14.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:14.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:14.663 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-18T01:08:14.860 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:14.862 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:14.865 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:14.866 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:15.133 INFO:teuthology.orchestra.run.smithi081.stdout:generic/299 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:08:15.137 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/299 2024-03-18T01:08:15.137 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/299 2024-03-18T01:08:15.138 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:15.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:15.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:15.154 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-18T01:08:15.323 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:15.327 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:15.327 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:15.328 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:15.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:15.590 INFO:teuthology.orchestra.run.smithi081.stdout:generic/300 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:08:15.594 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/300 2024-03-18T01:08:15.594 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/300 2024-03-18T01:08:15.594 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:15.596 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:15.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:15.623 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-18T01:08:15.798 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:15.802 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:15.802 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:15.803 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:15.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:16.140 INFO:teuthology.orchestra.run.smithi081.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/301 2024-03-18T01:08:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/301 2024-03-18T01:08:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:16.149 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:16.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:16.443 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-18T01:08:16.643 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:16.647 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:16.647 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:16.648 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:16.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:17.004 INFO:teuthology.orchestra.run.smithi081.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:17.012 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/302 2024-03-18T01:08:17.012 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/302 2024-03-18T01:08:17.012 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:17.014 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:17.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:17.323 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-18T01:08:17.509 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:17.513 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:17.513 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:17.514 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:17.514 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:17.750 INFO:teuthology.orchestra.run.smithi081.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:08:17.754 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/303 2024-03-18T01:08:17.754 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/303 2024-03-18T01:08:17.754 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:17.756 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:17.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:17.816 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-18T01:08:18.157 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:18.161 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:18.162 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:18.163 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:18.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:18.398 INFO:teuthology.orchestra.run.smithi081.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T01:08:18.401 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/304 2024-03-18T01:08:18.402 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/304 2024-03-18T01:08:18.402 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:18.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:18.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:18.464 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-18T01:08:18.853 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:18.857 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:18.857 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:18.858 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:18.858 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:19.212 INFO:teuthology.orchestra.run.smithi081.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:08:19.219 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/305 2024-03-18T01:08:19.219 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/305 2024-03-18T01:08:19.219 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:19.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:19.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:19.507 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-18T01:08:19.686 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:19.690 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:19.690 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:19.691 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:19.691 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:20.166 INFO:teuthology.orchestra.run.smithi081.stdout:generic/306 1s 2024-03-18T01:08:20.178 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/306 2024-03-18T01:08:20.178 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:20.180 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:20.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:20.463 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-18T01:08:20.877 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:20.881 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:20.881 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:20.882 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:20.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:22.321 INFO:teuthology.orchestra.run.smithi081.stdout:generic/307 2s 2024-03-18T01:08:22.327 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/307 2024-03-18T01:08:22.327 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:22.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:22.338 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-18T01:08:22.512 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:22.516 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:22.516 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:22.517 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:22.517 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:22.755 INFO:teuthology.orchestra.run.smithi081.stdout:generic/308 0s 2024-03-18T01:08:22.761 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/308 2024-03-18T01:08:22.761 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:22.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:22.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:22.778 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-18T01:08:22.963 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:22.967 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:22.967 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:22.968 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:22.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:24.231 INFO:teuthology.orchestra.run.smithi081.stdout:generic/309 1s 2024-03-18T01:08:24.237 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/309 2024-03-18T01:08:24.237 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:08:24.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:24.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:08:24.290 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-18T01:08:24.672 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:08:24.676 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:08:24.676 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:08:24.677 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:08:24.677 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:08:43.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:08:43.905 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:09:14.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:09:14.049 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:09:41.800 INFO:teuthology.orchestra.run.smithi081.stdout:generic/310 77s 2024-03-18T01:09:41.805 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/310 2024-03-18T01:09:41.806 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:41.808 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:41.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:41.949 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-18T01:09:42.261 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:42.267 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:42.268 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:42.270 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:42.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:42.678 INFO:teuthology.orchestra.run.smithi081.stdout:generic/311 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:09:42.681 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/311 2024-03-18T01:09:42.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/311 2024-03-18T01:09:42.682 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:42.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:42.697 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-18T01:09:42.879 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:42.883 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:42.884 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:42.884 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:43.091 INFO:teuthology.orchestra.run.smithi081.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:09:43.095 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/312 2024-03-18T01:09:43.095 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/312 2024-03-18T01:09:43.095 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:43.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:43.110 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-18T01:09:43.291 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:43.295 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:43.295 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:43.296 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:44.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:09:44.195 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:09:47.541 INFO:teuthology.orchestra.run.smithi081.stdout:generic/313 4s 2024-03-18T01:09:47.547 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/313 2024-03-18T01:09:47.547 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:47.550 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:47.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:47.565 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-18T01:09:47.746 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:47.749 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:47.750 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:47.751 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:47.751 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:48.175 INFO:teuthology.orchestra.run.smithi081.stdout:generic/314 1s 2024-03-18T01:09:48.180 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/314 2024-03-18T01:09:48.180 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:48.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:48.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:48.197 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-18T01:09:48.381 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:48.385 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:48.385 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:48.386 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:48.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:48.598 INFO:teuthology.orchestra.run.smithi081.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T01:09:48.602 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/315 2024-03-18T01:09:48.602 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/315 2024-03-18T01:09:48.602 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:48.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:48.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:48.617 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-18T01:09:48.789 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:48.792 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:48.793 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:48.794 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:48.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:49.104 INFO:teuthology.orchestra.run.smithi081.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T01:09:49.107 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/316 2024-03-18T01:09:49.107 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/316 2024-03-18T01:09:49.108 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:49.110 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:49.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:49.167 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-18T01:09:49.544 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:49.548 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:49.549 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:49.549 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:49.549 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:50.647 INFO:teuthology.orchestra.run.smithi081.stdout:generic/317 1s 2024-03-18T01:09:50.653 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/317 2024-03-18T01:09:50.653 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:50.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:50.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:50.665 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-18T01:09:50.856 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:50.860 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:50.860 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:50.861 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:50.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:51.326 INFO:teuthology.orchestra.run.smithi081.stdout:generic/318 1s 2024-03-18T01:09:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/318 2024-03-18T01:09:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:51.334 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:51.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:51.342 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-18T01:09:51.521 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:51.525 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:51.526 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:51.526 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:51.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:51.853 INFO:teuthology.orchestra.run.smithi081.stdout:generic/319 0s 2024-03-18T01:09:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/319 2024-03-18T01:09:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:51.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:51.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:51.869 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-18T01:09:52.047 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:52.051 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:52.051 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:52.053 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:52.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:52.252 INFO:teuthology.orchestra.run.smithi081.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:09:52.256 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/320 2024-03-18T01:09:52.256 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/320 2024-03-18T01:09:52.256 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:52.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:52.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:52.271 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-18T01:09:52.443 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:52.446 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:52.447 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:52.448 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:52.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:52.661 INFO:teuthology.orchestra.run.smithi081.stdout:generic/321 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:09:52.665 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/321 2024-03-18T01:09:52.665 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/321 2024-03-18T01:09:52.665 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:52.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:52.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:52.678 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-18T01:09:52.859 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:52.862 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:52.863 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:52.864 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:52.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:53.075 INFO:teuthology.orchestra.run.smithi081.stdout:generic/322 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:09:53.079 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/322 2024-03-18T01:09:53.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/322 2024-03-18T01:09:53.079 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:09:53.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:09:53.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:09:53.092 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-18T01:09:53.270 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:09:53.273 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:09:53.274 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:09:53.275 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:09:53.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:10:14.400 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:10:14.403 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:10:44.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:10:44.559 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:10:44.596 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T01:10:44.595+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45923) UID: 0 2024-03-18T01:10:44.596 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T01:10:44.595+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45923) UID: 0 2024-03-18T01:10:44.596 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T01:10:44.595+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45923) UID: 0 2024-03-18T01:10:44.596 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T01:10:44.595+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45923) UID: 0 2024-03-18T01:11:53.988 INFO:teuthology.orchestra.run.smithi081.stdout:generic/323 120s 2024-03-18T01:11:53.992 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/323 2024-03-18T01:11:53.992 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:53.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:54.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:54.050 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-18T01:11:54.397 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:54.401 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:54.401 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:54.402 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:54.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:54.607 INFO:teuthology.orchestra.run.smithi081.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-18T01:11:54.611 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/324 2024-03-18T01:11:54.611 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/324 2024-03-18T01:11:54.611 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:54.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:54.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:54.624 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-18T01:11:54.801 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:54.805 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:54.805 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:54.806 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:54.806 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:55.016 INFO:teuthology.orchestra.run.smithi081.stdout:generic/325 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:11:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/325 2024-03-18T01:11:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/325 2024-03-18T01:11:55.020 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:55.022 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:55.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:55.033 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-18T01:11:55.206 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:55.210 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:55.210 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:55.211 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:55.212 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:55.551 INFO:teuthology.orchestra.run.smithi081.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:55.558 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/326 2024-03-18T01:11:55.558 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/326 2024-03-18T01:11:55.558 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:55.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:55.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:55.860 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-18T01:11:56.044 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:56.048 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:56.048 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:56.049 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:56.049 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:56.390 INFO:teuthology.orchestra.run.smithi081.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:56.395 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/327 2024-03-18T01:11:56.396 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/327 2024-03-18T01:11:56.396 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:56.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:56.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:56.758 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-18T01:11:56.956 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:56.960 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:56.960 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:56.961 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:56.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:57.297 INFO:teuthology.orchestra.run.smithi081.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:57.302 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/328 2024-03-18T01:11:57.302 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/328 2024-03-18T01:11:57.302 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:57.306 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:57.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:57.583 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-18T01:11:57.789 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:57.792 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:57.793 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:57.794 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:57.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:58.154 INFO:teuthology.orchestra.run.smithi081.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:58.163 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/329 2024-03-18T01:11:58.163 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/329 2024-03-18T01:11:58.163 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:58.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:58.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:58.406 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-18T01:11:58.589 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:58.592 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:58.593 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:58.594 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:58.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:58.954 INFO:teuthology.orchestra.run.smithi081.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:58.960 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/330 2024-03-18T01:11:58.960 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/330 2024-03-18T01:11:58.960 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:58.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:59.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:11:59.209 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-18T01:11:59.397 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:11:59.400 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:11:59.401 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:11:59.402 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:11:59.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:11:59.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:11:59.782 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/331 2024-03-18T01:11:59.782 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/331 2024-03-18T01:11:59.782 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:11:59.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:00.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:00.024 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-18T01:12:00.211 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:00.215 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:00.215 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:00.216 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:00.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:00.561 INFO:teuthology.orchestra.run.smithi081.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:12:00.566 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/332 2024-03-18T01:12:00.566 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/332 2024-03-18T01:12:00.566 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:00.570 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:00.708 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:00.709 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-18T01:12:00.975 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:00.978 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:00.979 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:00.980 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:00.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:01.309 INFO:teuthology.orchestra.run.smithi081.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:12:01.316 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/333 2024-03-18T01:12:01.316 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/333 2024-03-18T01:12:01.316 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:01.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:01.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:01.575 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-18T01:12:01.773 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:01.777 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:01.777 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:01.778 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:01.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:02.126 INFO:teuthology.orchestra.run.smithi081.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:12:02.131 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/334 2024-03-18T01:12:02.132 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/334 2024-03-18T01:12:02.132 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:02.135 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:02.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:02.424 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-18T01:12:02.615 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:02.619 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:02.620 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:02.621 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:02.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:02.834 INFO:teuthology.orchestra.run.smithi081.stdout:generic/335 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:12:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/335 2024-03-18T01:12:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/335 2024-03-18T01:12:02.838 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:02.840 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:02.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:02.851 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-18T01:12:03.029 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:03.032 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:03.033 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:03.034 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:03.034 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:03.257 INFO:teuthology.orchestra.run.smithi081.stdout:generic/336 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:12:03.261 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/336 2024-03-18T01:12:03.261 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/336 2024-03-18T01:12:03.261 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:03.263 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:03.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:03.288 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-18T01:12:03.472 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:03.475 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:03.476 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:03.477 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:03.477 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:03.785 INFO:teuthology.orchestra.run.smithi081.stdout:generic/337 0s 2024-03-18T01:12:03.790 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/337 2024-03-18T01:12:03.790 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:03.792 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:03.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:03.801 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-18T01:12:03.984 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:03.988 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:03.988 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:03.989 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:03.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:04.196 INFO:teuthology.orchestra.run.smithi081.stdout:generic/338 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:12:04.200 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/338 2024-03-18T01:12:04.200 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/338 2024-03-18T01:12:04.200 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:12:04.202 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:12:04.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:12:04.213 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-18T01:12:04.395 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:12:04.399 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:12:04.399 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:12:04.400 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:12:04.400 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:00.606 INFO:teuthology.orchestra.run.smithi081.stdout:generic/339 56s 2024-03-18T01:13:00.611 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/339 2024-03-18T01:13:00.611 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:00.613 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:00.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:00.622 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-18T01:13:00.799 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:00.802 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:00.803 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:00.803 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:00.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:03.128 INFO:teuthology.orchestra.run.smithi081.stdout:generic/340 3s 2024-03-18T01:13:03.140 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/340 2024-03-18T01:13:03.140 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:03.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:03.159 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:03.159 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-18T01:13:03.488 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:03.492 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:03.493 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:03.494 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:03.494 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:03.718 INFO:teuthology.orchestra.run.smithi081.stdout:generic/341 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:03.722 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/341 2024-03-18T01:13:03.722 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/341 2024-03-18T01:13:03.722 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:03.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:03.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:03.737 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-18T01:13:03.919 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:03.922 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:03.923 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:03.924 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:03.924 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:04.184 INFO:teuthology.orchestra.run.smithi081.stdout:generic/342 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:04.189 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/342 2024-03-18T01:13:04.189 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/342 2024-03-18T01:13:04.189 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:04.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:04.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:04.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-18T01:13:04.456 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:04.460 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:04.460 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:04.463 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:04.464 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:04.727 INFO:teuthology.orchestra.run.smithi081.stdout:generic/343 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:04.731 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/343 2024-03-18T01:13:04.731 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/343 2024-03-18T01:13:04.731 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:04.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:04.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:04.750 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-18T01:13:04.927 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:04.931 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:04.931 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:04.932 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:04.932 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:09.336 INFO:teuthology.orchestra.run.smithi081.stdout:generic/344 4s 2024-03-18T01:13:09.352 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/344 2024-03-18T01:13:09.352 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:09.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:09.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:09.372 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-18T01:13:09.729 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:09.733 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:09.734 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:09.735 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:18.404 INFO:teuthology.orchestra.run.smithi081.stdout:generic/345 9s 2024-03-18T01:13:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/345 2024-03-18T01:13:18.445 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:18.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:18.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:18.460 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-18T01:13:18.788 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:18.792 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:18.792 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:18.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:21.182 INFO:teuthology.orchestra.run.smithi081.stdout:generic/346 3s 2024-03-18T01:13:21.190 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/346 2024-03-18T01:13:21.191 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:21.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:21.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:21.210 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-18T01:13:21.525 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:21.529 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:21.529 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:21.530 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:21.530 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:21.774 INFO:teuthology.orchestra.run.smithi081.stdout:generic/347 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:21.777 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/347 2024-03-18T01:13:21.777 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/347 2024-03-18T01:13:21.778 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:21.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:21.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:21.793 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-18T01:13:21.976 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:21.979 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:21.980 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:21.981 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:21.981 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:22.259 INFO:teuthology.orchestra.run.smithi081.stdout:generic/348 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:22.263 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/348 2024-03-18T01:13:22.264 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/348 2024-03-18T01:13:22.264 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:22.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:22.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:22.300 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-18T01:13:22.566 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:22.571 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:22.572 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:22.573 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:22.573 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:22.897 INFO:teuthology.orchestra.run.smithi081.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T01:13:22.901 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/349 2024-03-18T01:13:22.901 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/349 2024-03-18T01:13:22.901 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:22.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:22.921 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-18T01:13:23.109 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:23.113 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:23.113 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:23.114 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:23.114 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:23.726 INFO:teuthology.orchestra.run.smithi081.stdout:generic/350 0s 2024-03-18T01:13:23.731 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/350 2024-03-18T01:13:23.731 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:23.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:23.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:23.742 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-18T01:13:23.924 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:23.927 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:23.928 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:23.929 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:23.929 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:24.166 INFO:teuthology.orchestra.run.smithi081.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:13:24.170 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/351 2024-03-18T01:13:24.170 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/351 2024-03-18T01:13:24.170 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:24.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:24.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:24.189 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-18T01:13:24.366 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:24.370 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:24.371 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:24.372 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:24.726 INFO:teuthology.orchestra.run.smithi081.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/352 2024-03-18T01:13:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/352 2024-03-18T01:13:24.731 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:24.735 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:24.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:24.972 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-18T01:13:25.191 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:25.195 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:25.195 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:25.196 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:25.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:25.554 INFO:teuthology.orchestra.run.smithi081.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:25.564 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/353 2024-03-18T01:13:25.564 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/353 2024-03-18T01:13:25.564 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:25.568 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:25.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:25.746 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-18T01:13:25.977 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:25.980 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:25.981 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:25.982 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:25.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:30.760 INFO:teuthology.orchestra.run.smithi081.stdout:generic/354 4s 2024-03-18T01:13:30.771 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/354 2024-03-18T01:13:30.771 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:30.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:30.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:30.790 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-18T01:13:31.153 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:31.157 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:31.158 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:31.159 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:31.159 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:31.879 INFO:teuthology.orchestra.run.smithi081.stdout:generic/355 0s 2024-03-18T01:13:32.081 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/355 2024-03-18T01:13:32.081 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:32.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:32.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:32.082 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-18T01:13:32.398 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:32.404 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:32.404 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:32.405 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:32.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:32.756 INFO:teuthology.orchestra.run.smithi081.stdout:generic/356 [not run] swapfiles are not supported 2024-03-18T01:13:32.760 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/356 2024-03-18T01:13:32.760 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/356 2024-03-18T01:13:32.760 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:32.763 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:32.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:32.777 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-18T01:13:32.961 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:32.964 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:32.965 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:32.966 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:32.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:33.281 INFO:teuthology.orchestra.run.smithi081.stdout:generic/357 [not run] swapfiles are not supported 2024-03-18T01:13:33.285 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/357 2024-03-18T01:13:33.285 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/357 2024-03-18T01:13:33.285 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:33.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:33.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:33.302 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-18T01:13:33.487 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:33.490 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:33.491 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:33.492 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:33.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:33.867 INFO:teuthology.orchestra.run.smithi081.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:33.874 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/358 2024-03-18T01:13:33.874 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/358 2024-03-18T01:13:33.874 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:33.876 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:34.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:34.102 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-18T01:13:34.322 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:34.326 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:34.326 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:34.327 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:34.327 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:34.691 INFO:teuthology.orchestra.run.smithi081.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:34.698 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/359 2024-03-18T01:13:34.698 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/359 2024-03-18T01:13:34.698 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:34.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:34.873 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-18T01:13:35.127 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:35.130 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:35.131 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:35.132 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:35.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:35.377 INFO:teuthology.orchestra.run.smithi081.stdout:generic/360 0s 2024-03-18T01:13:35.382 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/360 2024-03-18T01:13:35.382 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:35.384 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:35.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:35.403 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-18T01:13:35.577 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:35.581 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:35.581 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:35.582 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:35.582 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:35.797 INFO:teuthology.orchestra.run.smithi081.stdout:generic/361 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:35.800 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/361 2024-03-18T01:13:35.800 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/361 2024-03-18T01:13:35.801 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:35.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:35.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:35.815 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-18T01:13:36.002 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:36.006 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:36.006 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:36.007 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:36.007 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:36.210 INFO:teuthology.orchestra.run.smithi081.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:36.214 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/362 2024-03-18T01:13:36.214 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/362 2024-03-18T01:13:36.214 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:36.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:36.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:36.231 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-18T01:13:36.405 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:36.409 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:36.409 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:36.410 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:36.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:36.613 INFO:teuthology.orchestra.run.smithi081.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:36.617 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/363 2024-03-18T01:13:36.617 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/363 2024-03-18T01:13:36.617 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:36.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:36.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:36.632 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-18T01:13:36.808 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:36.812 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:36.812 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:36.813 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:36.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.016 INFO:teuthology.orchestra.run.smithi081.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:37.020 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/364 2024-03-18T01:13:37.020 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/364 2024-03-18T01:13:37.020 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:37.049 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-18T01:13:37.226 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:37.230 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:37.230 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:37.231 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.442 INFO:teuthology.orchestra.run.smithi081.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:37.446 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/365 2024-03-18T01:13:37.446 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/365 2024-03-18T01:13:37.446 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:37.448 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:37.461 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-18T01:13:37.644 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:37.648 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:37.648 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:37.649 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:37.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.848 INFO:teuthology.orchestra.run.smithi081.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:37.852 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/366 2024-03-18T01:13:37.852 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/366 2024-03-18T01:13:37.852 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:37.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:37.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:37.867 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-18T01:13:38.041 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:38.045 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:38.045 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:38.046 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:38.046 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:38.246 INFO:teuthology.orchestra.run.smithi081.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:38.250 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/367 2024-03-18T01:13:38.250 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/367 2024-03-18T01:13:38.250 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:38.252 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:38.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:38.265 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-18T01:13:38.449 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:38.452 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:38.453 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:38.454 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:38.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:38.659 INFO:teuthology.orchestra.run.smithi081.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/368 2024-03-18T01:13:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/368 2024-03-18T01:13:38.663 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:38.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:38.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:38.678 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-18T01:13:38.855 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:38.858 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:38.859 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:38.860 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:38.860 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.064 INFO:teuthology.orchestra.run.smithi081.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:39.068 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/369 2024-03-18T01:13:39.068 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/369 2024-03-18T01:13:39.068 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:39.083 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-18T01:13:39.278 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:39.282 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:39.282 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:39.283 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:39.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.488 INFO:teuthology.orchestra.run.smithi081.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T01:13:39.492 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/370 2024-03-18T01:13:39.492 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/370 2024-03-18T01:13:39.492 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:39.494 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:39.507 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-18T01:13:39.688 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:39.692 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:39.692 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:39.693 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:39.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.906 INFO:teuthology.orchestra.run.smithi081.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:13:39.910 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/371 2024-03-18T01:13:39.910 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/371 2024-03-18T01:13:39.910 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:39.912 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:39.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:39.928 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-18T01:13:40.109 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:40.113 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:40.113 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:40.114 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:40.114 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:40.455 INFO:teuthology.orchestra.run.smithi081.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:40.461 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/372 2024-03-18T01:13:40.462 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/372 2024-03-18T01:13:40.462 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:40.464 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:40.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:40.658 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-18T01:13:40.899 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:40.903 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:40.903 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:40.904 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:40.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:41.132 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:13:41.135 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:13:41.263 INFO:teuthology.orchestra.run.smithi081.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:41.269 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/373 2024-03-18T01:13:41.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/373 2024-03-18T01:13:41.269 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:41.278 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:41.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:41.463 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-18T01:13:41.717 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:41.720 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:41.721 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:41.722 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:41.722 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:42.051 INFO:teuthology.orchestra.run.smithi081.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T01:13:42.101 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/374 2024-03-18T01:13:42.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/374 2024-03-18T01:13:42.101 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:42.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:42.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:42.241 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-18T01:13:42.521 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:42.525 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:42.525 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:42.526 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:42.802 INFO:teuthology.orchestra.run.smithi081.stdout:generic/375 0s 2024-03-18T01:13:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/375 2024-03-18T01:13:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:42.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:42.857 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-18T01:13:43.222 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:43.226 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:43.226 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:43.227 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:43.452 INFO:teuthology.orchestra.run.smithi081.stdout:generic/376 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:43.456 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/376 2024-03-18T01:13:43.456 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/376 2024-03-18T01:13:43.456 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:43.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:43.471 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-18T01:13:43.643 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:43.647 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:43.648 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:43.649 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:43.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:43.989 INFO:teuthology.orchestra.run.smithi081.stdout:generic/377 0s 2024-03-18T01:13:43.995 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/377 2024-03-18T01:13:43.995 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:43.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:44.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:44.006 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-18T01:13:44.185 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:44.188 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:44.189 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:44.190 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:44.190 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:44.668 INFO:teuthology.orchestra.run.smithi081.stdout:generic/378 0s 2024-03-18T01:13:44.674 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/378 2024-03-18T01:13:44.674 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:44.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:44.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:44.734 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-18T01:13:45.106 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:45.110 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:45.110 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:45.111 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:45.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:45.324 INFO:teuthology.orchestra.run.smithi081.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:45.328 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/379 2024-03-18T01:13:45.328 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/379 2024-03-18T01:13:45.328 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:45.330 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:45.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:45.343 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-18T01:13:45.523 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:45.527 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:45.527 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:45.528 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:45.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:45.741 INFO:teuthology.orchestra.run.smithi081.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:45.745 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/380 2024-03-18T01:13:45.746 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/380 2024-03-18T01:13:45.746 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:45.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:45.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:45.783 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-18T01:13:45.975 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:45.979 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:45.979 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:45.980 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:45.980 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:46.185 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/381 2024-03-18T01:13:46.186 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/381 2024-03-18T01:13:46.186 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:46.188 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:46.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:46.213 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-18T01:13:46.399 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:46.403 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:46.404 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:46.404 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:46.405 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:46.610 INFO:teuthology.orchestra.run.smithi081.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/382 2024-03-18T01:13:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/382 2024-03-18T01:13:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:46.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:46.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:46.629 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-18T01:13:46.820 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:46.824 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:46.824 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:46.825 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:46.825 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.026 INFO:teuthology.orchestra.run.smithi081.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/383 2024-03-18T01:13:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/383 2024-03-18T01:13:47.030 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:47.045 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-18T01:13:47.225 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:47.229 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:47.229 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:47.230 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:47.230 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.447 INFO:teuthology.orchestra.run.smithi081.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:47.451 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/384 2024-03-18T01:13:47.451 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/384 2024-03-18T01:13:47.451 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:47.453 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:47.466 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-18T01:13:47.653 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:47.656 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:47.657 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:47.658 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:47.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.866 INFO:teuthology.orchestra.run.smithi081.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:47.870 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/385 2024-03-18T01:13:47.870 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/385 2024-03-18T01:13:47.870 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:47.873 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:47.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:47.886 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-18T01:13:48.065 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:48.068 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:48.069 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:48.070 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:48.070 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:48.275 INFO:teuthology.orchestra.run.smithi081.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:48.279 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/386 2024-03-18T01:13:48.279 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/386 2024-03-18T01:13:48.279 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:48.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:48.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:48.294 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-18T01:13:48.483 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:48.487 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:48.487 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:48.488 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:48.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:48.845 INFO:teuthology.orchestra.run.smithi081.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:13:48.851 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/387 2024-03-18T01:13:48.851 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/387 2024-03-18T01:13:48.851 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:48.855 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:49.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:49.040 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-18T01:13:49.277 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:49.281 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:49.281 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:49.282 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:49.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:49.519 INFO:teuthology.orchestra.run.smithi081.stdout:generic/388 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T01:13:49.523 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/388 2024-03-18T01:13:49.523 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/388 2024-03-18T01:13:49.523 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:49.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:49.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:49.539 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-18T01:13:49.719 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:49.723 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:49.723 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:49.724 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:49.724 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:49.938 INFO:teuthology.orchestra.run.smithi081.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-18T01:13:49.942 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/389 2024-03-18T01:13:49.942 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/389 2024-03-18T01:13:49.942 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:49.944 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:49.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:49.957 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-18T01:13:50.134 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:50.138 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:50.138 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:50.139 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:50.139 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:50.357 INFO:teuthology.orchestra.run.smithi081.stdout:generic/390 [not run] ceph does not support freezing 2024-03-18T01:13:50.361 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/390 2024-03-18T01:13:50.361 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/390 2024-03-18T01:13:50.361 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:50.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:50.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:50.376 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-18T01:13:50.555 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:50.559 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:50.559 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:50.560 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:50.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:50.785 INFO:teuthology.orchestra.run.smithi081.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:13:50.790 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/391 2024-03-18T01:13:50.790 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/391 2024-03-18T01:13:50.790 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:50.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:50.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:50.819 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-18T01:13:50.998 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:50.999 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:51.000 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:51.000 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:51.286 INFO:teuthology.orchestra.run.smithi081.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-18T01:13:51.313 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/392 2024-03-18T01:13:51.313 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/392 2024-03-18T01:13:51.313 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:51.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:51.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:51.327 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-18T01:13:51.505 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:51.509 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:51.510 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:51.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:52.111 INFO:teuthology.orchestra.run.smithi081.stdout:generic/393 1s 2024-03-18T01:13:52.116 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/393 2024-03-18T01:13:52.117 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:52.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:52.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:52.128 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-18T01:13:52.313 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:52.317 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:52.318 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:52.319 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:52.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:52.557 INFO:teuthology.orchestra.run.smithi081.stdout:generic/394 0s 2024-03-18T01:13:52.563 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/394 2024-03-18T01:13:52.563 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:52.565 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:52.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:52.607 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-18T01:13:52.960 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:52.965 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:52.965 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:52.966 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:52.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:53.341 INFO:teuthology.orchestra.run.smithi081.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-03-18T01:13:53.361 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/395 2024-03-18T01:13:53.361 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/395 2024-03-18T01:13:53.361 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:53.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:53.380 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-18T01:13:53.609 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:53.614 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:53.614 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:53.615 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:53.616 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:54.028 INFO:teuthology.orchestra.run.smithi081.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-03-18T01:13:54.041 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/396 2024-03-18T01:13:54.041 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/396 2024-03-18T01:13:54.041 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:54.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:54.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:54.060 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-18T01:13:54.306 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:54.310 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:54.311 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:54.312 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:54.313 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:54.657 INFO:teuthology.orchestra.run.smithi081.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-03-18T01:13:54.666 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/397 2024-03-18T01:13:54.666 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/397 2024-03-18T01:13:54.666 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:54.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:54.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:54.680 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-18T01:13:54.862 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:54.866 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:54.867 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:54.867 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:54.868 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:55.190 INFO:teuthology.orchestra.run.smithi081.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-03-18T01:13:55.197 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/398 2024-03-18T01:13:55.198 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/398 2024-03-18T01:13:55.198 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:55.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:55.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:55.211 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-18T01:13:55.384 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:55.387 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:55.388 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:55.389 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:55.389 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:55.727 INFO:teuthology.orchestra.run.smithi081.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-03-18T01:13:55.734 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/399 2024-03-18T01:13:55.735 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/399 2024-03-18T01:13:55.735 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:55.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:55.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:55.749 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-18T01:13:55.920 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:55.923 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:55.924 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:55.925 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:55.925 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:56.140 INFO:teuthology.orchestra.run.smithi081.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T01:13:56.143 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/400 2024-03-18T01:13:56.144 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/400 2024-03-18T01:13:56.144 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:56.145 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:56.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:56.160 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-18T01:13:56.340 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:56.343 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:56.344 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:56.345 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:56.345 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:56.728 INFO:teuthology.orchestra.run.smithi081.stdout:generic/401 0s 2024-03-18T01:13:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/401 2024-03-18T01:13:56.735 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:56.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:56.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:56.762 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-18T01:13:57.076 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:57.080 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:57.080 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:57.081 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:57.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:57.387 INFO:teuthology.orchestra.run.smithi081.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-18T01:13:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/402 2024-03-18T01:13:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/402 2024-03-18T01:13:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:57.396 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:57.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:57.408 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-18T01:13:57.606 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:57.610 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:57.610 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:57.611 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:57.611 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.049 INFO:teuthology.orchestra.run.smithi081.stdout:generic/403 1s 2024-03-18T01:13:58.055 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/403 2024-03-18T01:13:58.055 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:58.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:58.065 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-18T01:13:58.254 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:58.257 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:58.258 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:58.259 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:58.259 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.475 INFO:teuthology.orchestra.run.smithi081.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:13:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/404 2024-03-18T01:13:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/404 2024-03-18T01:13:58.479 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:58.481 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:58.511 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-18T01:13:58.690 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:58.693 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:58.694 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:58.695 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:58.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.941 INFO:teuthology.orchestra.run.smithi081.stdout:generic/405 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:13:58.945 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/405 2024-03-18T01:13:58.945 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/405 2024-03-18T01:13:58.945 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:13:58.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:13:58.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:13:58.975 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-18T01:13:59.158 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:13:59.162 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:13:59.162 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:13:59.163 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:13:59.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:00.641 INFO:teuthology.orchestra.run.smithi081.stdout:generic/406 1s 2024-03-18T01:14:00.647 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/406 2024-03-18T01:14:00.647 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:00.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:00.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:00.658 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-18T01:14:00.840 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:00.844 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:00.845 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:00.846 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:00.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:01.107 INFO:teuthology.orchestra.run.smithi081.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:14:01.112 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/407 2024-03-18T01:14:01.112 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/407 2024-03-18T01:14:01.112 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:01.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:01.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:01.169 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-18T01:14:01.652 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:01.656 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:01.656 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:01.657 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:01.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:01.911 INFO:teuthology.orchestra.run.smithi081.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T01:14:01.915 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/408 2024-03-18T01:14:01.915 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/408 2024-03-18T01:14:01.915 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:01.918 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:01.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:01.979 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-18T01:14:02.430 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:02.434 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:02.434 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:02.435 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:02.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:02.643 INFO:teuthology.orchestra.run.smithi081.stdout:generic/409 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T01:14:02.647 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/409 2024-03-18T01:14:02.647 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/409 2024-03-18T01:14:02.647 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:02.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:02.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:02.672 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-18T01:14:02.861 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:02.865 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:02.866 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:02.867 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:02.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:03.081 INFO:teuthology.orchestra.run.smithi081.stdout:generic/410 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T01:14:03.085 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/410 2024-03-18T01:14:03.085 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/410 2024-03-18T01:14:03.085 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:03.087 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:03.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:03.099 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-18T01:14:03.276 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:03.279 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:03.280 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:03.281 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:03.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:03.500 INFO:teuthology.orchestra.run.smithi081.stdout:generic/411 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T01:14:03.504 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/411 2024-03-18T01:14:03.504 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/411 2024-03-18T01:14:03.504 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:03.507 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:03.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:03.538 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-18T01:14:03.720 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:03.724 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:03.724 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:03.725 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:03.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:04.151 INFO:teuthology.orchestra.run.smithi081.stdout:generic/412 1s 2024-03-18T01:14:04.156 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/412 2024-03-18T01:14:04.156 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:04.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:04.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:04.166 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-18T01:14:04.348 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:04.351 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:04.352 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:04.353 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:04.353 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:04.630 INFO:teuthology.orchestra.run.smithi081.stdout:generic/413 [not run] mount 172.21.15.81:6789:/scratch with dax failed 2024-03-18T01:14:04.634 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/413 2024-03-18T01:14:04.634 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/413 2024-03-18T01:14:04.634 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:04.636 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:04.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:04.661 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-18T01:14:04.834 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:04.837 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:04.838 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:04.839 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:04.839 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:05.199 INFO:teuthology.orchestra.run.smithi081.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:14:05.210 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/414 2024-03-18T01:14:05.210 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/414 2024-03-18T01:14:05.210 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:05.212 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:05.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:05.390 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-18T01:14:05.628 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:05.632 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:05.632 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:05.633 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:05.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:05.983 INFO:teuthology.orchestra.run.smithi081.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:14:05.989 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/415 2024-03-18T01:14:05.989 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/415 2024-03-18T01:14:05.989 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:05.993 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:06.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:06.196 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-18T01:14:06.430 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:06.434 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:06.434 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:06.435 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:06.435 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:06.637 INFO:teuthology.orchestra.run.smithi081.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:14:06.641 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/416 2024-03-18T01:14:06.641 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/416 2024-03-18T01:14:06.641 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:06.644 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:06.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:06.656 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-18T01:14:06.838 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:06.841 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:06.842 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:06.843 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:06.843 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:07.126 INFO:teuthology.orchestra.run.smithi081.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-18T01:14:07.135 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/417 2024-03-18T01:14:07.136 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/417 2024-03-18T01:14:07.136 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:07.138 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:07.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:07.151 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-18T01:14:07.326 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:07.329 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:07.330 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:07.331 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:07.331 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:07.573 INFO:teuthology.orchestra.run.smithi081.stdout:generic/418 [not run] require 172.21.15.81:6789:/test to be valid block disk 2024-03-18T01:14:07.577 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/418 2024-03-18T01:14:07.577 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/418 2024-03-18T01:14:07.577 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:07.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:07.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:07.595 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-18T01:14:07.778 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:07.781 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:07.782 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:07.783 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:07.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:08.114 INFO:teuthology.orchestra.run.smithi081.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-03-18T01:14:08.124 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/419 2024-03-18T01:14:08.124 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/419 2024-03-18T01:14:08.124 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:08.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:08.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:08.138 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-18T01:14:08.323 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:08.326 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:08.327 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:08.328 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:08.328 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:08.643 INFO:teuthology.orchestra.run.smithi081.stdout:generic/420 0s 2024-03-18T01:14:08.649 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/420 2024-03-18T01:14:08.649 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:08.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:08.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:08.716 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-18T01:14:09.081 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:09.085 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:09.085 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:09.086 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:09.086 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:09.405 INFO:teuthology.orchestra.run.smithi081.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-03-18T01:14:09.412 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/421 2024-03-18T01:14:09.412 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/421 2024-03-18T01:14:09.412 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:09.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:09.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:09.427 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-18T01:14:09.600 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:09.604 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:09.605 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:09.606 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:09.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:09.836 INFO:teuthology.orchestra.run.smithi081.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T01:14:09.840 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/422 2024-03-18T01:14:09.840 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/422 2024-03-18T01:14:09.840 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:09.842 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:09.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:09.878 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-18T01:14:10.048 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:10.052 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:10.052 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:10.053 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:10.053 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:10.343 INFO:teuthology.orchestra.run.smithi081.stdout:generic/423 0s 2024-03-18T01:14:10.349 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/423 2024-03-18T01:14:10.349 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:10.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:10.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:10.420 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-18T01:14:10.811 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:10.815 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:10.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:11.039 INFO:teuthology.orchestra.run.smithi081.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-18T01:14:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/424 2024-03-18T01:14:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/424 2024-03-18T01:14:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:11.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:11.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:11.061 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-18T01:14:11.242 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:11.246 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:11.246 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:11.247 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:11.247 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:11.489 INFO:teuthology.orchestra.run.smithi081.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-18T01:14:11.493 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/425 2024-03-18T01:14:11.493 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/425 2024-03-18T01:14:11.493 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:11.495 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:11.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:14:11.516 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:14:11.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:11.543 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-18T01:14:11.934 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:11.937 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:11.938 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:11.939 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:11.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:36.231 INFO:teuthology.orchestra.run.smithi081.stdout:generic/426 24s 2024-03-18T01:14:36.293 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/426 2024-03-18T01:14:36.293 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:36.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:36.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:36.469 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-18T01:14:37.995 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:37.999 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:37.999 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:38.000 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:38.000 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:38.410 INFO:teuthology.orchestra.run.smithi081.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:14:38.414 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/427 2024-03-18T01:14:38.414 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/427 2024-03-18T01:14:38.414 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:38.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:38.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:38.433 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-18T01:14:38.618 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:38.621 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:38.622 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:38.623 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:38.623 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:38.874 INFO:teuthology.orchestra.run.smithi081.stdout:generic/428 0s 2024-03-18T01:14:38.879 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/428 2024-03-18T01:14:38.880 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:38.882 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:38.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:38.902 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-18T01:14:39.094 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:39.097 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:39.098 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:39.099 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:39.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:39.477 INFO:teuthology.orchestra.run.smithi081.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-03-18T01:14:39.486 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/429 2024-03-18T01:14:39.486 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/429 2024-03-18T01:14:39.486 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:39.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:39.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:39.501 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-18T01:14:39.686 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:39.690 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:39.690 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:39.691 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:39.691 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:40.037 INFO:teuthology.orchestra.run.smithi081.stdout:generic/430 1s 2024-03-18T01:14:40.042 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/430 2024-03-18T01:14:40.042 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:40.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:40.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:40.136 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-18T01:14:40.542 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:40.546 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:40.546 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:40.547 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:40.547 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:40.839 INFO:teuthology.orchestra.run.smithi081.stdout:generic/431 0s 2024-03-18T01:14:40.844 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/431 2024-03-18T01:14:40.845 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:40.847 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:40.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:40.930 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-18T01:14:41.321 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:41.324 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:41.325 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:41.326 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:41.326 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:41.638 INFO:teuthology.orchestra.run.smithi081.stdout:generic/432 0s 2024-03-18T01:14:41.644 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/432 2024-03-18T01:14:41.644 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:41.646 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:41.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:41.717 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-18T01:14:41.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:14:41.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:14:42.086 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:42.090 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:42.090 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:42.091 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:42.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:42.384 INFO:teuthology.orchestra.run.smithi081.stdout:generic/433 0s 2024-03-18T01:14:42.390 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/433 2024-03-18T01:14:42.390 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:42.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:42.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:42.451 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-18T01:14:42.803 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:42.807 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:42.808 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:42.809 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:43.108 INFO:teuthology.orchestra.run.smithi081.stdout:generic/434 1s 2024-03-18T01:14:43.113 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/434 2024-03-18T01:14:43.113 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:43.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:43.173 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-18T01:14:43.539 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:43.543 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:43.543 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:43.545 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:43.887 INFO:teuthology.orchestra.run.smithi081.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-03-18T01:14:43.895 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/435 2024-03-18T01:14:43.896 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/435 2024-03-18T01:14:43.896 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:43.898 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:43.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:43.911 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-18T01:14:44.103 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:44.107 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:44.107 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:44.108 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:44.108 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:44.633 INFO:teuthology.orchestra.run.smithi081.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:14:44.637 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/436 2024-03-18T01:14:44.637 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/436 2024-03-18T01:14:44.637 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:44.639 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:44.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:44.678 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-18T01:14:45.068 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:45.072 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:45.072 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:45.073 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:45.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:45.968 INFO:teuthology.orchestra.run.smithi081.stdout:generic/437 0s 2024-03-18T01:14:45.973 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/437 2024-03-18T01:14:45.973 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:14:45.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:14:45.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:14:45.995 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-18T01:14:46.177 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:14:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:14:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:14:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:14:46.182 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:15:12.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:15:12.031 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:15:12.073 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T01:15:12.072+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46134) UID: 0 2024-03-18T01:15:12.073 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T01:15:12.072+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46134) UID: 0 2024-03-18T01:16:03.451 INFO:teuthology.orchestra.run.smithi081.stdout:generic/438 77s 2024-03-18T01:16:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/438 2024-03-18T01:16:03.456 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:03.459 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:03.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:03.476 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-18T01:16:03.661 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:03.665 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:03.666 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:03.666 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:03.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:04.567 INFO:teuthology.orchestra.run.smithi081.stdout:generic/439 1s 2024-03-18T01:16:04.572 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/439 2024-03-18T01:16:04.573 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:04.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:04.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:04.589 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-18T01:16:04.770 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:04.773 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:04.774 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:04.775 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:05.104 INFO:teuthology.orchestra.run.smithi081.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-03-18T01:16:05.111 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/440 2024-03-18T01:16:05.111 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/440 2024-03-18T01:16:05.111 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:05.113 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:05.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:05.125 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-18T01:16:05.301 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:05.305 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:05.306 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:05.307 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:05.307 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:05.558 INFO:teuthology.orchestra.run.smithi081.stdout:generic/441 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:16:05.561 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/441 2024-03-18T01:16:05.561 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/441 2024-03-18T01:16:05.562 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:05.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:05.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:05.576 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-18T01:16:05.755 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:05.759 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:05.759 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:05.760 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:05.760 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:05.982 INFO:teuthology.orchestra.run.smithi081.stdout:generic/442 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:16:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/442 2024-03-18T01:16:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/442 2024-03-18T01:16:05.986 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:05.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:06.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:06.000 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-18T01:16:06.182 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:06.186 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:06.186 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:06.187 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:06.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:06.432 INFO:teuthology.orchestra.run.smithi081.stdout:generic/443 0s 2024-03-18T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/443 2024-03-18T01:16:06.440 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:06.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:06.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:06.459 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-18T01:16:06.637 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:06.641 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:06.641 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:06.642 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:06.642 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:07.682 INFO:teuthology.orchestra.run.smithi081.stdout:generic/444 1s 2024-03-18T01:16:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/444 2024-03-18T01:16:07.698 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:07.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:07.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:07.722 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-18T01:16:07.913 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:07.916 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:07.917 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:07.918 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:07.918 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:08.405 INFO:teuthology.orchestra.run.smithi081.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:16:08.409 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/445 2024-03-18T01:16:08.409 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/445 2024-03-18T01:16:08.409 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:08.412 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:08.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:08.460 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-18T01:16:08.799 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:08.803 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:08.803 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:08.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:25.763 INFO:teuthology.orchestra.run.smithi081.stdout:generic/446 17s 2024-03-18T01:16:25.771 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/446 2024-03-18T01:16:25.771 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:25.775 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:25.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:25.787 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-18T01:16:26.118 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:26.122 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:26.123 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:26.124 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:26.124 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:26.505 INFO:teuthology.orchestra.run.smithi081.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:16:26.512 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/447 2024-03-18T01:16:26.513 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/447 2024-03-18T01:16:26.513 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:26.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:26.685 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-18T01:16:26.897 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:26.901 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:26.902 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:26.903 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:26.903 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:27.773 INFO:teuthology.orchestra.run.smithi081.stdout:generic/448 0s 2024-03-18T01:16:27.778 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/448 2024-03-18T01:16:27.778 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:27.781 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:27.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:27.815 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-18T01:16:28.161 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:28.165 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:28.166 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:28.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:28.434 INFO:teuthology.orchestra.run.smithi081.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T01:16:28.438 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/449 2024-03-18T01:16:28.438 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/449 2024-03-18T01:16:28.438 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:28.440 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:28.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:28.500 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-18T01:16:28.845 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:28.849 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:28.850 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:28.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:29.532 INFO:teuthology.orchestra.run.smithi081.stdout:generic/450 1s 2024-03-18T01:16:29.537 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/450 2024-03-18T01:16:29.538 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:16:29.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:16:29.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:16:29.595 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-18T01:16:29.934 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:16:29.938 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:16:29.938 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:16:29.940 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:16:29.940 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:00.275 INFO:teuthology.orchestra.run.smithi081.stdout:generic/451 30s 2024-03-18T01:17:00.280 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/451 2024-03-18T01:17:00.280 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:00.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:00.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:00.323 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-18T01:17:00.682 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:00.685 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:00.686 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:00.687 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:00.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.052 INFO:teuthology.orchestra.run.smithi081.stdout:generic/452 1s 2024-03-18T01:17:01.057 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/452 2024-03-18T01:17:01.057 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:01.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:01.068 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-18T01:17:01.241 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:01.245 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:01.246 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:01.247 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:01.247 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.465 INFO:teuthology.orchestra.run.smithi081.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-18T01:17:01.469 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/453 2024-03-18T01:17:01.469 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/453 2024-03-18T01:17:01.469 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:01.471 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:01.486 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-18T01:17:01.671 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:01.675 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:01.676 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:01.677 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:01.677 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.903 INFO:teuthology.orchestra.run.smithi081.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-18T01:17:01.907 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/454 2024-03-18T01:17:01.907 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/454 2024-03-18T01:17:01.907 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:01.909 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:01.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:01.927 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-18T01:17:02.116 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:02.120 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:02.120 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:02.121 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:02.121 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:02.393 INFO:teuthology.orchestra.run.smithi081.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T01:17:02.397 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/455 2024-03-18T01:17:02.397 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/455 2024-03-18T01:17:02.397 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:02.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:02.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:02.413 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-18T01:17:02.592 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:02.596 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:02.596 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:02.597 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:02.597 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:02.820 INFO:teuthology.orchestra.run.smithi081.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T01:17:02.824 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/456 2024-03-18T01:17:02.824 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/456 2024-03-18T01:17:02.824 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:02.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:02.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:02.842 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-18T01:17:03.013 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:03.017 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:03.017 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:03.018 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:03.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:03.440 INFO:teuthology.orchestra.run.smithi081.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:17:03.449 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/457 2024-03-18T01:17:03.449 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/457 2024-03-18T01:17:03.449 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:03.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:03.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:03.615 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-18T01:17:03.819 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:03.823 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:03.823 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:03.824 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:03.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:04.168 INFO:teuthology.orchestra.run.smithi081.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T01:17:04.175 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/458 2024-03-18T01:17:04.175 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/458 2024-03-18T01:17:04.175 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:04.177 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:04.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:04.408 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-18T01:17:04.623 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:04.627 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:04.627 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:04.628 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:04.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:05.065 INFO:teuthology.orchestra.run.smithi081.stdout:generic/459 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:17:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/459 2024-03-18T01:17:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/459 2024-03-18T01:17:05.069 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:05.071 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:05.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:05.084 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-18T01:17:05.265 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:05.269 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:05.269 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:05.270 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:05.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:06.957 INFO:teuthology.orchestra.run.smithi081.stdout:generic/460 1s 2024-03-18T01:17:06.963 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/460 2024-03-18T01:17:06.963 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:06.965 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:06.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:06.974 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-18T01:17:07.158 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:07.162 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:07.162 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:07.163 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:07.163 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-18T01:17:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/461 2024-03-18T01:17:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/461 2024-03-18T01:17:07.500 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:07.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:07.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:07.523 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-18T01:17:07.747 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:07.751 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:07.752 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:07.752 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:08.026 INFO:teuthology.orchestra.run.smithi081.stdout:generic/462 [not run] mount 172.21.15.81:6789:/scratch with dax failed 2024-03-18T01:17:08.030 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/462 2024-03-18T01:17:08.030 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/462 2024-03-18T01:17:08.030 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:08.032 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:08.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:08.064 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-18T01:17:08.243 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:08.246 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:08.247 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:08.248 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:08.248 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:08.513 INFO:teuthology.orchestra.run.smithi081.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T01:17:08.517 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/463 2024-03-18T01:17:08.517 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/463 2024-03-18T01:17:08.518 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:17:08.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:08.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:17:08.584 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-18T01:17:08.909 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:17:08.913 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:17:08.913 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:17:08.915 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:17:08.915 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:17:50.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:17:50.266 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:18:05.051 INFO:teuthology.orchestra.run.smithi081.stdout:generic/464 56s 2024-03-18T01:18:05.056 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/464 2024-03-18T01:18:05.056 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:05.058 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:05.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:05.066 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-18T01:18:05.249 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:05.251 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:05.251 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:05.252 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:05.252 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:09.346 INFO:teuthology.orchestra.run.smithi081.stdout:generic/465 4s 2024-03-18T01:18:09.357 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/465 2024-03-18T01:18:09.358 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:09.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:09.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:09.374 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-18T01:18:09.739 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:09.744 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:09.744 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:09.745 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:09.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:09.953 INFO:teuthology.orchestra.run.smithi081.stdout:generic/466 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:18:09.958 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/466 2024-03-18T01:18:09.958 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/466 2024-03-18T01:18:09.958 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:09.959 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:09.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:09.971 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-18T01:18:10.154 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:10.158 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:10.158 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:10.162 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:10.162 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:14.744 INFO:teuthology.orchestra.run.smithi081.stdout:generic/467 4s 2024-03-18T01:18:14.795 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/467 2024-03-18T01:18:14.795 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:14.797 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:14.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:14.974 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-18T01:18:16.078 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:16.082 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:16.082 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:16.083 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:16.083 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:16.454 INFO:teuthology.orchestra.run.smithi081.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-18T01:18:16.461 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/468 2024-03-18T01:18:16.461 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/468 2024-03-18T01:18:16.461 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:16.463 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:16.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:16.476 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-18T01:18:16.651 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:16.655 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:16.655 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:16.656 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:16.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:16.887 INFO:teuthology.orchestra.run.smithi081.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T01:18:16.891 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/469 2024-03-18T01:18:16.891 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/469 2024-03-18T01:18:16.891 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:16.893 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:16.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:16.911 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-18T01:18:17.107 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:17.111 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:17.111 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:17.112 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:17.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:17.381 INFO:teuthology.orchestra.run.smithi081.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T01:18:17.385 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/470 2024-03-18T01:18:17.385 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/470 2024-03-18T01:18:17.385 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:18:17.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:17.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:18:17.400 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-18T01:18:17.602 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:18:17.605 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:18:17.606 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:18:17.607 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:18:17.607 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:18:20.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:18:20.585 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:18:50.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:18:50.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:19:06.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/471 49s 2024-03-18T01:19:06.131 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/471 2024-03-18T01:19:06.131 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:19:06.134 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:06.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:19:06.372 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-18T01:19:06.876 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:19:06.881 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:19:06.882 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:19:06.887 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:19:06.887 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:07.495 INFO:teuthology.orchestra.run.smithi081.stdout:generic/472 [not run] swapfiles are not supported 2024-03-18T01:19:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/472 2024-03-18T01:19:07.498 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/472 2024-03-18T01:19:07.499 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:19:07.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:07.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:19:07.517 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-18T01:19:07.696 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:19:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:19:07.703 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:19:07.704 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:19:07.704 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:07.961 INFO:teuthology.orchestra.run.smithi081.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T01:19:07.965 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/473 2024-03-18T01:19:07.965 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/473 2024-03-18T01:19:07.965 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:19:07.967 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:07.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:19:07.990 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-18T01:19:08.167 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:19:08.170 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:19:08.171 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:19:08.172 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:19:08.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:08.449 INFO:teuthology.orchestra.run.smithi081.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-18T01:19:08.457 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/474 2024-03-18T01:19:08.457 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/474 2024-03-18T01:19:08.458 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:19:08.459 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:08.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:19:08.472 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-18T01:19:08.666 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:19:08.670 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:19:08.670 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:19:08.671 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:19:08.671 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:08.917 INFO:teuthology.orchestra.run.smithi081.stdout:generic/475 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T01:19:08.920 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/475 2024-03-18T01:19:08.920 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/475 2024-03-18T01:19:08.921 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T01:19:08.923 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:08.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T01:19:08.936 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-18T01:19:09.125 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T01:19:09.128 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T01:19:09.129 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T01:19:09.130 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T01:19:09.130 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T01:19:20.764 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:19:20.768 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:19:50.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:19:50.892 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:20:20.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:20:20.981 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:20:51.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:20:51.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:21:21.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:21:21.150 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:21:51.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:21:51.416 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:22:21.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:22:21.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:22:51.663 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:22:51.668 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:23:21.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:23:21.790 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:23:51.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:23:51.859 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:24:22.051 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:24:22.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:24:52.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:24:52.656 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:25:22.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:25:22.740 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:25:52.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:25:52.823 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:26:22.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:26:22.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:26:53.186 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:26:53.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:27:23.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:27:23.265 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:27:53.416 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:27:53.420 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:28:23.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:28:23.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:28:53.833 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:28:53.836 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:29:24.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:29:24.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:29:24.421 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T01:29:24.420+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47014) UID: 0 2024-03-18T01:29:24.421 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T01:29:24.420+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47014) UID: 0 2024-03-18T01:32:07.943 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T01:32:07.940+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47041) UID: 0 2024-03-18T01:32:07.943 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T01:32:07.941+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47041) UID: 0 2024-03-18T01:32:07.944 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T01:32:07.942+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47041) UID: 0 2024-03-18T01:32:07.951 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T01:32:07.950+0000 7f23e5f92640 -1 Fail to open '/proc/47041/cmdline' error = (2) No such file or directory 2024-03-18T01:32:07.951 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T01:32:07.950+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 47041) UID: 0 2024-03-18T01:35:19.713 INFO:teuthology.orchestra.run.smithi136.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.7.log.1: 2024-03-18T01:35:19.714 INFO:teuthology.orchestra.run.smithi136.stderr:gzip: stdin: file size changed while zipping 2024-03-18T01:35:52.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:35:52.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:35:52.085 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T01:35:52.084+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47085) UID: 0 2024-03-18T01:35:52.086 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T01:35:52.084+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47085) UID: 0 2024-03-18T01:35:52.086 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T01:35:52.084+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47085) UID: 0 2024-03-18T01:35:52.086 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T01:35:52.085+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47085) UID: 0 2024-03-18T01:35:52.175 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T01:35:52.175+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582760) UID: 0 2024-03-18T01:35:52.175 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T01:35:52.175+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582760) UID: 0 2024-03-18T01:35:52.191 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T01:35:52.175+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582760) UID: 0 2024-03-18T01:35:52.192 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T01:35:52.175+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582760) UID: 0 2024-03-18T01:43:24.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:43:24.351 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:43:24.714 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T01:43:24.713+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47158) UID: 0 2024-03-18T01:43:24.721 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T01:43:24.714+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47158) UID: 0 2024-03-18T01:48:43.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:48:43.056 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:49:13.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:49:13.181 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:49:43.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:49:43.273 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:50:13.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:50:13.398 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:50:43.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:50:43.491 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:51:13.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:51:13.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:51:43.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:51:43.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:51:43.739 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T01:51:43.738+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583090) UID: 0 2024-03-18T01:51:43.740 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T01:51:43.738+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583090) UID: 0 2024-03-18T01:51:43.740 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T01:51:43.738+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583090) UID: 0 2024-03-18T01:51:43.740 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T01:51:43.738+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583090) UID: 0 2024-03-18T01:55:03.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:55:03.452 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:55:03.828 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T01:55:03.827+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47386) UID: 0 2024-03-18T01:55:03.830 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T01:55:03.828+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47386) UID: 0 2024-03-18T01:59:13.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:59:13.158 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:59:43.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T01:59:43.253 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:00:13.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:00:13.716 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:00:43.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:00:43.811 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:01:13.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:01:13.896 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:01:44.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:01:44.035 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:01:44.099 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T02:01:44.097+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47569) UID: 0 2024-03-18T02:01:44.102 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T02:01:44.100+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 47569) UID: 0 2024-03-18T02:01:44.112 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T02:01:44.097+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47569) UID: 0 2024-03-18T02:01:44.121 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T02:01:44.107+0000 7f66ecb1e640 -1 Fail to open '/proc/47569/cmdline' error = (2) No such file or directory 2024-03-18T02:01:44.121 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T02:01:44.111+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 47569) UID: 0 2024-03-18T02:05:24.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:05:24.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:05:24.586 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T02:05:24.581+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583496) UID: 0 2024-03-18T02:05:24.586 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T02:05:24.581+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583496) UID: 0 2024-03-18T02:05:24.586 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T02:05:24.584+0000 7f221bd57640 -1 received signal: Hangup from (PID: 583496) UID: 0 2024-03-18T02:05:24.587 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T02:05:24.584+0000 7f7e89a01640 -1 received signal: Hangup from (PID: 583496) UID: 0 2024-03-18T02:05:24.778 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T02:05:24.771+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47614) UID: 0 2024-03-18T02:05:24.778 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T02:05:24.771+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47614) UID: 0 2024-03-18T02:09:17.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:09:17.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:09:47.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:09:47.526 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:10:17.656 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:10:17.659 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:10:47.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:10:47.949 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:11:18.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:11:18.033 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:11:48.184 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:11:48.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:12:18.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:12:18.259 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:12:48.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:12:48.347 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:13:18.447 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:13:18.450 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:13:48.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:13:48.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:14:19.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:14:19.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:14:49.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:14:49.475 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:14:49.525 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T02:14:49.524+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47918) UID: 0 2024-03-18T02:14:49.525 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T02:14:49.524+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47918) UID: 0 2024-03-18T02:17:32.139 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T02:17:32.137+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47925) UID: 0 2024-03-18T02:17:32.140 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T02:17:32.137+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47925) UID: 0 2024-03-18T02:17:32.140 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T02:17:32.137+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47925) UID: 0 2024-03-18T02:17:32.140 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T02:17:32.137+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47925) UID: 0 2024-03-18T02:21:25.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:21:25.999 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:21:26.067 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T02:21:26.066+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583992) UID: 0 2024-03-18T02:21:26.068 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T02:21:26.066+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583992) UID: 0 2024-03-18T02:21:26.068 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T02:21:26.066+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583992) UID: 0 2024-03-18T02:21:26.080 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T02:21:26.066+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583992) UID: 0 2024-03-18T02:21:26.252 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T02:21:26.251+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47969) UID: 0 2024-03-18T02:21:26.253 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T02:21:26.251+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47969) UID: 0 2024-03-18T02:21:26.253 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T02:21:26.251+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47969) UID: 0 2024-03-18T02:21:26.253 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T02:21:26.252+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47969) UID: 0 2024-03-18T02:28:00.513 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:28:00.517 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:28:00.658 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T02:28:00.656+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48008) UID: 0 2024-03-18T02:28:00.658 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T02:28:00.656+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48008) UID: 0 2024-03-18T02:34:01.072 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T02:34:01.069+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48071) UID: 0 2024-03-18T02:34:01.100 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T02:34:01.070+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48071) UID: 0 2024-03-18T02:34:01.101 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T02:34:01.071+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48071) UID: 0 2024-03-18T02:34:01.101 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T02:34:01.071+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48071) UID: 0 2024-03-18T02:38:29.239 INFO:teuthology.orchestra.run.smithi081.stdout:generic/476 4760s 2024-03-18T02:38:29.318 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/476 2024-03-18T02:38:29.319 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:38:29.322 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:38:29.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:38:29.342 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-18T02:38:33.851 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:38:33.854 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:38:34.876 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:38:34.880 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:38:34.880 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:38:34.881 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:38:34.881 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:38:35.017 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T02:38:35.014+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48108) UID: 0 2024-03-18T02:38:35.017 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T02:38:35.014+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48108) UID: 0 2024-03-18T02:44:44.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:44:44.440 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:44:44.736 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T02:44:44.734+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48134) UID: 0 2024-03-18T02:44:44.737 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T02:44:44.734+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48134) UID: 0 2024-03-18T02:46:26.471 INFO:teuthology.orchestra.run.smithi081.stdout:generic/477 14s 2024-03-18T02:46:26.573 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/477 2024-03-18T02:46:26.573 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:26.577 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:26.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:26.693 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-18T02:46:27.861 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:27.865 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:27.866 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:27.866 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:27.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:38.547 INFO:teuthology.orchestra.run.smithi081.stdout:generic/478 10s 2024-03-18T02:46:38.592 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/478 2024-03-18T02:46:38.592 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:38.594 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:38.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:38.628 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-18T02:46:38.858 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:38.862 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:38.863 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:38.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:39.232 INFO:teuthology.orchestra.run.smithi081.stdout:generic/479 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:39.237 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/479 2024-03-18T02:46:39.237 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/479 2024-03-18T02:46:39.237 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:39.239 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:39.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:39.273 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-18T02:46:39.513 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:39.517 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:39.518 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:39.519 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:39.519 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:39.840 INFO:teuthology.orchestra.run.smithi081.stdout:generic/480 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:39.845 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/480 2024-03-18T02:46:39.845 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/480 2024-03-18T02:46:39.845 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:39.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:39.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:39.882 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-18T02:46:40.136 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:40.142 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:40.142 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:40.143 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:40.144 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:40.415 INFO:teuthology.orchestra.run.smithi081.stdout:generic/481 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:40.419 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/481 2024-03-18T02:46:40.419 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/481 2024-03-18T02:46:40.419 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:40.422 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:40.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:40.440 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-18T02:46:40.672 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:40.676 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:40.676 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:40.677 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:40.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:41.028 INFO:teuthology.orchestra.run.smithi081.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T02:46:41.032 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/482 2024-03-18T02:46:41.032 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/482 2024-03-18T02:46:41.032 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:41.035 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:41.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:41.063 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-18T02:46:41.285 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:41.290 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:41.290 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:41.292 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:41.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:41.579 INFO:teuthology.orchestra.run.smithi081.stdout:generic/483 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:41.583 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/483 2024-03-18T02:46:41.583 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/483 2024-03-18T02:46:41.583 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:41.586 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:41.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:41.604 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-18T02:46:41.841 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:41.846 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:41.846 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:41.847 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:41.847 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:42.122 INFO:teuthology.orchestra.run.smithi081.stdout:generic/484 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:42.127 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/484 2024-03-18T02:46:42.127 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/484 2024-03-18T02:46:42.127 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:42.130 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:42.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:42.152 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-18T02:46:42.399 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:42.404 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:42.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:42.690 INFO:teuthology.orchestra.run.smithi081.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T02:46:42.696 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/485 2024-03-18T02:46:42.696 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/485 2024-03-18T02:46:42.696 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:42.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:42.726 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-18T02:46:42.964 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:42.968 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:42.968 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:42.969 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:43.500 INFO:teuthology.orchestra.run.smithi081.stdout:generic/486 0s 2024-03-18T02:46:43.508 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/486 2024-03-18T02:46:43.508 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:43.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:43.521 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-18T02:46:43.745 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:43.749 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:43.749 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:43.750 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:43.750 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:44.031 INFO:teuthology.orchestra.run.smithi081.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-18T02:46:44.036 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/487 2024-03-18T02:46:44.036 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/487 2024-03-18T02:46:44.036 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:44.039 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:44.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:44.057 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-18T02:46:44.278 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:44.282 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:44.283 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:44.284 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:44.571 INFO:teuthology.orchestra.run.smithi081.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T02:46:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/488 2024-03-18T02:46:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/488 2024-03-18T02:46:44.578 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:44.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:44.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:44.610 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-18T02:46:44.856 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:44.860 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:44.860 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:44.861 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:44.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:45.150 INFO:teuthology.orchestra.run.smithi081.stdout:generic/489 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:45.154 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/489 2024-03-18T02:46:45.154 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/489 2024-03-18T02:46:45.154 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:45.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:45.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:45.184 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-18T02:46:45.430 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:45.437 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:45.438 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:47.302 INFO:teuthology.orchestra.run.smithi081.stdout:generic/490 2s 2024-03-18T02:46:47.309 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/490 2024-03-18T02:46:47.309 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:47.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:47.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:47.415 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-18T02:46:47.776 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:47.780 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:47.780 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:47.781 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:47.781 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:48.064 INFO:teuthology.orchestra.run.smithi081.stdout:generic/491 [not run] ceph does not support freezing 2024-03-18T02:46:48.068 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/491 2024-03-18T02:46:48.068 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/491 2024-03-18T02:46:48.069 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:48.071 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:48.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:48.090 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-18T02:46:48.341 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:48.345 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:48.345 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:48.347 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:48.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:48.621 INFO:teuthology.orchestra.run.smithi081.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-18T02:46:48.626 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/492 2024-03-18T02:46:48.627 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/492 2024-03-18T02:46:48.627 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:48.630 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:48.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:48.650 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-18T02:46:48.880 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:48.885 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:48.885 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:48.886 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:48.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:49.371 INFO:teuthology.orchestra.run.smithi081.stdout:generic/493 [not run] swapfiles are not supported 2024-03-18T02:46:49.375 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/493 2024-03-18T02:46:49.375 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/493 2024-03-18T02:46:49.375 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:49.378 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:49.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:49.407 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-18T02:46:49.650 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:49.655 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:49.655 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:49.657 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:49.657 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:50.121 INFO:teuthology.orchestra.run.smithi081.stdout:generic/494 [not run] swapfiles are not supported 2024-03-18T02:46:50.125 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/494 2024-03-18T02:46:50.126 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/494 2024-03-18T02:46:50.126 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:50.128 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:50.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:50.158 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-18T02:46:50.393 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:50.398 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:50.399 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:50.400 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:50.862 INFO:teuthology.orchestra.run.smithi081.stdout:generic/495 [not run] swapfiles are not supported 2024-03-18T02:46:50.867 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/495 2024-03-18T02:46:50.867 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/495 2024-03-18T02:46:50.867 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:50.870 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:50.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:50.899 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-18T02:46:51.128 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:51.133 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:51.133 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:51.134 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:51.134 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:51.595 INFO:teuthology.orchestra.run.smithi081.stdout:generic/496 [not run] swapfiles are not supported 2024-03-18T02:46:51.599 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/496 2024-03-18T02:46:51.599 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/496 2024-03-18T02:46:51.599 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:51.602 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:51.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:51.625 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-18T02:46:51.852 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:51.857 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:51.857 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:51.858 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:51.858 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:52.326 INFO:teuthology.orchestra.run.smithi081.stdout:generic/497 [not run] swapfiles are not supported 2024-03-18T02:46:52.332 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/497 2024-03-18T02:46:52.332 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/497 2024-03-18T02:46:52.332 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:52.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:52.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:52.366 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-18T02:46:52.615 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:52.621 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:52.621 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:52.623 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:52.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:53.079 INFO:teuthology.orchestra.run.smithi081.stdout:generic/498 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:53.083 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/498 2024-03-18T02:46:53.084 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/498 2024-03-18T02:46:53.084 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:53.087 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:53.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:53.114 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-18T02:46:53.357 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:53.361 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:53.361 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:53.362 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:53.680 INFO:teuthology.orchestra.run.smithi081.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T02:46:53.685 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/499 2024-03-18T02:46:53.685 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/499 2024-03-18T02:46:53.685 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:53.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:53.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:53.722 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-18T02:46:53.948 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:53.953 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:53.954 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:53.955 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:53.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:54.520 INFO:teuthology.orchestra.run.smithi081.stdout:generic/500 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/500 2024-03-18T02:46:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/500 2024-03-18T02:46:54.525 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:54.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:54.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:54.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-18T02:46:54.765 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:54.770 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:54.770 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:54.771 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:54.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:55.294 INFO:teuthology.orchestra.run.smithi081.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T02:46:55.299 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/501 2024-03-18T02:46:55.299 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/501 2024-03-18T02:46:55.299 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:55.303 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:55.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:55.581 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-18T02:46:55.780 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:55.783 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:55.784 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:55.785 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:55.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:56.106 INFO:teuthology.orchestra.run.smithi081.stdout:generic/502 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:46:56.109 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/502 2024-03-18T02:46:56.110 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/502 2024-03-18T02:46:56.110 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:56.112 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:56.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:56.144 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-18T02:46:56.373 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:56.378 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:56.379 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:56.380 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:56.381 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:56.687 INFO:teuthology.orchestra.run.smithi081.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T02:46:56.692 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/503 2024-03-18T02:46:56.692 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/503 2024-03-18T02:46:56.692 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:56.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:56.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:56.723 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-18T02:46:56.946 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:56.951 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:56.951 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:56.953 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:56.953 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:57.289 INFO:teuthology.orchestra.run.smithi081.stdout:generic/504 0s 2024-03-18T02:46:57.296 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/504 2024-03-18T02:46:57.296 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:57.299 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:57.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:57.328 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-18T02:46:57.566 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:57.571 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:57.572 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:57.573 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:57.573 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:57.953 INFO:teuthology.orchestra.run.smithi081.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-18T02:46:57.964 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/505 2024-03-18T02:46:57.964 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/505 2024-03-18T02:46:57.964 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:57.966 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:57.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:57.987 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-18T02:46:58.227 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:58.233 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:58.233 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:58.235 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:58.235 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:58.517 INFO:teuthology.orchestra.run.smithi081.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T02:46:58.521 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/506 2024-03-18T02:46:58.521 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/506 2024-03-18T02:46:58.521 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:58.523 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:58.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:58.544 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-18T02:46:58.776 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:58.780 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:58.781 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:58.783 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:58.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:59.092 INFO:teuthology.orchestra.run.smithi081.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-18T02:46:59.098 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/507 2024-03-18T02:46:59.098 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/507 2024-03-18T02:46:59.098 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:59.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:59.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:59.129 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-18T02:46:59.360 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:59.367 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:59.369 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:59.369 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:59.369 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:59.654 INFO:teuthology.orchestra.run.smithi081.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-18T02:46:59.658 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/508 2024-03-18T02:46:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/508 2024-03-18T02:46:59.659 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:46:59.663 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:46:59.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:46:59.679 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-18T02:46:59.901 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:46:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:46:59.906 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:46:59.907 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:46:59.907 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:00.178 INFO:teuthology.orchestra.run.smithi081.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-18T02:47:00.182 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/509 2024-03-18T02:47:00.183 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/509 2024-03-18T02:47:00.183 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:00.186 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:00.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:00.204 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-18T02:47:00.428 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:00.433 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:00.433 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:00.434 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:00.434 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:00.718 INFO:teuthology.orchestra.run.smithi081.stdout:generic/510 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:47:00.723 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/510 2024-03-18T02:47:00.723 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/510 2024-03-18T02:47:00.723 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:00.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:00.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:00.747 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-18T02:47:00.986 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:00.991 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:00.991 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:00.992 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:00.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:01.285 INFO:teuthology.orchestra.run.smithi081.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T02:47:01.289 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/511 2024-03-18T02:47:01.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/511 2024-03-18T02:47:01.290 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:01.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:01.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:01.328 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-18T02:47:01.558 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:01.564 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:01.564 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:01.565 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:01.565 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:01.863 INFO:teuthology.orchestra.run.smithi081.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T02:47:01.871 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/512 2024-03-18T02:47:01.871 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/512 2024-03-18T02:47:01.871 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:01.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:01.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:01.897 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-18T02:47:02.121 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:02.125 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:02.126 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:02.127 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:02.606 INFO:teuthology.orchestra.run.smithi081.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T02:47:02.617 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/513 2024-03-18T02:47:02.617 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/513 2024-03-18T02:47:02.617 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:02.619 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:02.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:02.896 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-18T02:47:03.099 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:03.103 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:03.103 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:03.104 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:03.105 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:03.603 INFO:teuthology.orchestra.run.smithi081.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T02:47:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/514 2024-03-18T02:47:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/514 2024-03-18T02:47:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:03.612 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:03.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:03.844 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-18T02:47:04.075 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:04.079 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:04.079 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:04.080 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:04.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:04.541 INFO:teuthology.orchestra.run.smithi081.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T02:47:04.549 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/515 2024-03-18T02:47:04.550 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/515 2024-03-18T02:47:04.550 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:04.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:04.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:04.805 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-18T02:47:05.027 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:05.031 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:05.032 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:05.033 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:05.385 INFO:teuthology.orchestra.run.smithi081.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T02:47:05.389 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/516 2024-03-18T02:47:05.389 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/516 2024-03-18T02:47:05.389 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:05.391 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:05.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:05.451 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-18T02:47:05.864 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:05.868 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:05.868 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:05.869 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:05.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:06.276 INFO:teuthology.orchestra.run.smithi081.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T02:47:06.323 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/517 2024-03-18T02:47:06.323 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/517 2024-03-18T02:47:06.323 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:06.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:06.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:06.546 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-18T02:47:06.790 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:06.794 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:06.794 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:06.795 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:06.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:07.264 INFO:teuthology.orchestra.run.smithi081.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T02:47:07.269 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/518 2024-03-18T02:47:07.269 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/518 2024-03-18T02:47:07.269 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:07.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:07.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:07.516 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-18T02:47:07.739 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:07.743 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:07.744 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:07.744 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:08.042 INFO:teuthology.orchestra.run.smithi081.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-18T02:47:08.047 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/519 2024-03-18T02:47:08.047 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/519 2024-03-18T02:47:08.048 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:08.051 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:08.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:08.115 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-18T02:47:08.500 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:08.504 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:08.505 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:08.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:08.776 INFO:teuthology.orchestra.run.smithi081.stdout:generic/520 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T02:47:08.780 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/520 2024-03-18T02:47:08.780 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/520 2024-03-18T02:47:08.780 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T02:47:08.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:47:08.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T02:47:08.800 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-18T02:47:09.029 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T02:47:09.034 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T02:47:09.034 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T02:47:09.035 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T02:47:09.035 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T02:49:02.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:49:02.942 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:49:33.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:49:33.823 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:50:03.895 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:50:03.898 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:50:33.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:50:33.989 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:51:04.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:51:04.329 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:51:34.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:51:34.394 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:52:04.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:52:04.496 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:52:34.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:52:34.603 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:53:05.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:53:05.007 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:53:35.072 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:53:35.076 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:54:05.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:54:05.337 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:54:35.563 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:54:35.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:55:05.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:55:05.686 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:55:35.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:55:35.757 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:56:06.026 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:56:06.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:56:36.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:56:36.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:57:06.549 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:57:06.552 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:57:36.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:57:36.617 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T02:57:36.690 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T02:57:36.688+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606334) UID: 0 2024-03-18T02:57:36.690 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T02:57:36.690+0000 7f951d6d3640 -1 Fail to open '/proc/606334/cmdline' error = (2) No such file or directory 2024-03-18T02:57:36.690 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T02:57:36.690+0000 7f951d6d3640 -1 received signal: Hangup from (PID: 606334) UID: 0 2024-03-18T02:57:36.691 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T02:57:36.688+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606334) UID: 0 2024-03-18T02:57:36.691 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T02:57:36.688+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606334) UID: 0 2024-03-18T03:00:48.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:00:48.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:00:48.287 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:00:48.287+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606358) UID: 0 2024-03-18T03:00:48.287 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:00:48.287+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606358) UID: 0 2024-03-18T03:00:48.287 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:00:48.287+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606358) UID: 0 2024-03-18T03:00:48.288 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:00:48.286+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606358) UID: 0 2024-03-18T03:04:09.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:04:09.037 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:04:09.332 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:04:09.329+0000 7f5ae90b1640 -1 Fail to open '/proc/48522/cmdline' error = (2) No such file or directory 2024-03-18T03:04:09.333 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:04:09.329+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 48522) UID: 0 2024-03-18T03:04:09.333 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:04:09.329+0000 7f23e5f92640 -1 Fail to open '/proc/48522/cmdline' error = (2) No such file or directory 2024-03-18T03:04:09.333 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:04:09.329+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 48522) UID: 0 2024-03-18T03:04:09.334 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:04:09.333+0000 7f66ecb1e640 -1 Fail to open '/proc/48522/cmdline' error = (2) No such file or directory 2024-03-18T03:04:09.334 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:04:09.333+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 48522) UID: 0 2024-03-18T03:04:09.337 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:04:09.330+0000 7f5d43992640 -1 Fail to open '/proc/48522/cmdline' error = (2) No such file or directory 2024-03-18T03:04:09.338 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:04:09.330+0000 7f5d43992640 -1 received signal: Hangup from (PID: 48522) UID: 0 2024-03-18T03:07:37.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:07:37.085 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:07:37.124 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:07:37.124+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606424) UID: 0 2024-03-18T03:07:37.124 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:07:37.124+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606424) UID: 0 2024-03-18T03:07:37.125 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:07:37.124+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606424) UID: 0 2024-03-18T03:07:37.125 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:07:37.124+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606424) UID: 0 2024-03-18T03:10:45.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:10:45.271 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:11:15.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:11:15.414 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:11:15.459 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:11:15.459+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48588) UID: 0 2024-03-18T03:11:15.460 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:11:15.459+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48588) UID: 0 2024-03-18T03:11:15.460 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:11:15.459+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48588) UID: 0 2024-03-18T03:11:15.460 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:11:15.459+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48588) UID: 0 2024-03-18T03:14:30.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:14:30.015 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:15:00.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:15:00.155 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:15:30.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:15:30.493 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:16:00.807 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:16:00.812 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:16:30.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:16:30.890 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:16:30.931 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:16:30.931+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 48685) UID: 0 2024-03-18T03:16:30.932 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:16:30.931+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 48685) UID: 0 2024-03-18T03:16:30.932 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:16:30.932+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 48685) UID: 0 2024-03-18T03:16:30.933 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:16:30.930+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48685) UID: 0 2024-03-18T03:19:53.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:19:53.824 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:20:24.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:20:24.124 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:20:54.260 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:20:54.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:21:24.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:21:24.695 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:21:54.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:21:54.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:22:24.881 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:22:24.884 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:22:55.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:22:55.490 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:23:25.555 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:23:25.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:23:25.644 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:23:25.643+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48839) UID: 0 2024-03-18T03:23:25.644 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:23:25.643+0000 7f66ecb1e640 -1 Fail to open '/proc/48839/cmdline' error = (2) No such file or directory 2024-03-18T03:23:25.645 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:23:25.643+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 48839) UID: 0 2024-03-18T03:23:25.645 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:23:25.643+0000 7f5d43992640 -1 Fail to open '/proc/48839/cmdline' error = (2) No such file or directory 2024-03-18T03:23:25.645 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:23:25.643+0000 7f5d43992640 -1 received signal: Hangup from (PID: 48839) UID: 0 2024-03-18T03:23:25.645 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:23:25.644+0000 7f5ae90b1640 -1 Fail to open '/proc/48839/cmdline' error = (2) No such file or directory 2024-03-18T03:23:25.645 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:23:25.644+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 48839) UID: 0 2024-03-18T03:26:44.264 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:26:44.267 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:26:44.600 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:26:44.601+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606731) UID: 0 2024-03-18T03:26:44.608 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:26:44.601+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606731) UID: 0 2024-03-18T03:26:44.609 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:26:44.601+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606731) UID: 0 2024-03-18T03:26:44.611 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:26:44.602+0000 7f951d6d3640 -1 Fail to open '/proc/606731/cmdline' error = (2) No such file or directory 2024-03-18T03:26:44.611 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:26:44.602+0000 7f951d6d3640 -1 received signal: Hangup from (PID: 606731) UID: 0 2024-03-18T03:30:00.334 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:30:00.338 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:30:00.382 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:30:00.383+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606753) UID: 0 2024-03-18T03:30:00.383 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:30:00.383+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606753) UID: 0 2024-03-18T03:30:00.383 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:30:00.383+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606753) UID: 0 2024-03-18T03:30:00.383 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:30:00.383+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 606753) UID: 0 2024-03-18T03:33:09.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:33:09.104 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:33:39.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:33:39.247 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:34:09.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:34:09.315 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:34:39.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:34:39.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:35:09.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:35:09.518 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:35:39.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:35:39.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:35:39.643 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T03:35:39.643+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48994) UID: 0 2024-03-18T03:35:39.643 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T03:35:39.643+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48994) UID: 0 2024-03-18T03:39:11.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:39:11.492 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:39:42.193 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:39:42.196 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:40:12.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:40:12.300 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:40:42.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:40:42.374 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:41:12.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:41:12.467 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:41:42.592 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:41:42.595 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:42:12.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:42:12.661 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:42:42.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:42:42.787 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:43:12.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:43:12.979 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:43:43.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:43:43.320 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:44:13.380 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:44:13.383 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:44:43.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:44:43.455 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:45:13.562 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:45:13.566 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:45:13.622 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 49239) UID: 0 2024-03-18T03:45:13.623 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f5ae90b1640 -1 Fail to open '/proc/49239/cmdline' error = (2) No such file or directory 2024-03-18T03:45:13.623 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f66ecb1e640 -1 Fail to open '/proc/49239/cmdline' error = (2) No such file or directory 2024-03-18T03:45:13.623 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 49239) UID: 0 2024-03-18T03:45:13.624 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 49239) UID: 0 2024-03-18T03:45:13.624 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f5d43992640 -1 Fail to open '/proc/49239/cmdline' error = (2) No such file or directory 2024-03-18T03:45:13.624 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:45:13.622+0000 7f5d43992640 -1 received signal: Hangup from (PID: 49239) UID: 0 2024-03-18T03:48:30.321 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:48:30.325 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:49:01.122 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:49:01.125 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:49:31.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:49:31.194 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:50:01.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:50:01.301 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:50:31.420 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:50:31.423 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:50:31.463 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:50:31.463+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607203) UID: 0 2024-03-18T03:50:31.464 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:50:31.463+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607203) UID: 0 2024-03-18T03:50:31.464 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:50:31.463+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607203) UID: 0 2024-03-18T03:50:31.464 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:50:31.463+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607203) UID: 0 2024-03-18T03:53:38.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:53:38.372 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:54:08.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:54:08.647 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:54:38.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:54:38.732 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:55:08.841 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:55:08.844 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:55:38.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:55:38.916 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:56:09.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:56:09.436 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:56:39.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:56:39.624 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:56:39.669 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T03:56:39.669+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49465) UID: 0 2024-03-18T03:56:39.669 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T03:56:39.669+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49465) UID: 0 2024-03-18T03:56:39.670 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:56:39.669+0000 7f5d43992640 -1 Fail to open '/proc/49465/cmdline' error = (2) No such file or directory 2024-03-18T03:56:39.670 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T03:56:39.669+0000 7f5d43992640 -1 received signal: Hangup from (PID: 49465) UID: 0 2024-03-18T03:56:39.670 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T03:56:39.669+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49465) UID: 0 2024-03-18T03:59:52.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:59:52.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T03:59:52.496 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T03:59:52.496+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607356) UID: 0 2024-03-18T03:59:52.497 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T03:59:52.496+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607356) UID: 0 2024-03-18T03:59:52.497 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T03:59:52.496+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607356) UID: 0 2024-03-18T03:59:52.497 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T03:59:52.496+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 607356) UID: 0 2024-03-18T04:05:35.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:05:35.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:05:48.887 INFO:teuthology.orchestra.run.smithi081.stdout:generic/521 4719s 2024-03-18T04:05:48.955 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/521 2024-03-18T04:05:48.956 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T04:05:48.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T04:05:49.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T04:05:49.031 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-18T04:05:49.662 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T04:05:49.666 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T04:05:49.667 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T04:05:49.667 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T04:05:49.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T04:06:05.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:06:05.921 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:06:35.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:06:35.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:07:06.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:07:06.072 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:07:36.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:07:36.208 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:08:06.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:08:06.311 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:08:36.627 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:08:36.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:09:06.693 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:09:06.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:09:36.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:09:36.789 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:10:06.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:10:06.913 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:10:37.283 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:10:37.288 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:11:07.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:11:07.368 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:11:07.470 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T04:11:07.470+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49726) UID: 0 2024-03-18T04:11:07.471 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:11:07.470+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49726) UID: 0 2024-03-18T04:11:07.471 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:11:07.470+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49726) UID: 0 2024-03-18T04:11:07.471 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:11:07.470+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49726) UID: 0 2024-03-18T04:14:27.973 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:14:27.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:14:58.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:14:58.054 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:15:28.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:15:28.415 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:15:58.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:15:58.484 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:16:28.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:16:28.629 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:16:58.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:16:58.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:17:28.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:17:28.975 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:17:59.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:17:59.051 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:18:29.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:18:29.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:18:59.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:18:59.551 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:19:29.635 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:19:29.639 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:19:59.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:19:59.801 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:20:29.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:20:29.903 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:20:29.948 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:20:29.948+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49967) UID: 0 2024-03-18T04:20:29.949 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:20:29.948+0000 7f5d43992640 -1 received signal: Hangup from (PID: 49967) UID: 0 2024-03-18T04:20:29.949 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:20:29.948+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 49967) UID: 0 2024-03-18T04:20:29.949 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T04:20:29.948+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49967) UID: 0 2024-03-18T04:23:50.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:23:50.862 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:24:21.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:24:21.166 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:24:51.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:24:51.262 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:25:21.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:25:21.562 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:25:51.767 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:25:51.770 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:26:22.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:26:22.147 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:26:22.214 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f5d43992640 -1 Fail to open '/proc/50083/cmdline' error = (2) No such file or directory 2024-03-18T04:26:22.215 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50083) UID: 0 2024-03-18T04:26:22.215 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f5d43992640 -1 received signal: Hangup from (PID: 50083) UID: 0 2024-03-18T04:26:22.215 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f66ecb1e640 -1 received signal: Hangup from (PID: 50083) UID: 0 2024-03-18T04:26:22.216 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f23e5f92640 -1 Fail to open '/proc/50083/cmdline' error = (2) No such file or directory 2024-03-18T04:26:22.216 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:26:22.213+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 50083) UID: 0 2024-03-18T04:29:45.817 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:29:45.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:30:15.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:30:15.913 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:30:46.202 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:30:46.209 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:31:16.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:31:16.393 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:31:46.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:31:46.745 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:32:16.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:32:16.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:32:46.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:32:46.889 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:33:17.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:33:17.019 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:33:47.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:33:47.148 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:33:47.200 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T04:33:47.201+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 608598) UID: 0 2024-03-18T04:33:47.200 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T04:33:47.202+0000 7f951d6d3640 -1 Fail to open '/proc/608598/cmdline' error = (2) No such file or directory 2024-03-18T04:33:47.201 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T04:33:47.202+0000 7f951d6d3640 -1 received signal: Hangup from (PID: 608598) UID: 0 2024-03-18T04:33:47.201 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T04:33:47.203+0000 7fb304c13640 -1 Fail to open '/proc/608598/cmdline' error = (2) No such file or directory 2024-03-18T04:33:47.201 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T04:33:47.203+0000 7fb304c13640 -1 received signal: Hangup from (PID: 608598) UID: 0 2024-03-18T04:33:47.202 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T04:33:47.203+0000 7f221bd57640 -1 Fail to open '/proc/608598/cmdline' error = (2) No such file or directory 2024-03-18T04:33:47.202 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T04:33:47.203+0000 7f221bd57640 -1 received signal: Hangup from (PID: 608598) UID: 0 2024-03-18T04:36:43.875 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:36:43.880 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:37:14.061 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:37:14.064 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:37:44.131 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:37:44.134 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:38:14.251 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:38:14.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:38:14.293 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T04:38:14.295+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50331) UID: 0 2024-03-18T04:38:14.297 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T04:38:14.295+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50331) UID: 0 2024-03-18T04:41:50.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:41:50.153 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:42:20.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:42:20.472 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:42:50.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:42:50.567 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:42:50.888 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:42:50.892+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50391) UID: 0 2024-03-18T04:42:50.889 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T04:42:50.892+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50391) UID: 0 2024-03-18T04:42:50.889 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:42:50.892+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50391) UID: 0 2024-03-18T04:42:50.889 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:42:50.893+0000 7f5d43992640 -1 Fail to open '/proc/50391/cmdline' error = (2) No such file or directory 2024-03-18T04:42:50.889 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:42:50.893+0000 7f5d43992640 -1 received signal: Hangup from (PID: 50391) UID: 0 2024-03-18T04:46:15.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:46:15.101 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:46:15.210 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T04:46:15.214+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 608756) UID: 0 2024-03-18T04:46:15.211 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T04:46:15.215+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 608756) UID: 0 2024-03-18T04:46:15.211 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T04:46:15.215+0000 7f221bd57640 -1 received signal: Hangup from (PID: 608756) UID: 0 2024-03-18T04:46:15.212 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T04:46:15.214+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 608756) UID: 0 2024-03-18T04:51:59.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:51:59.576 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:52:29.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:52:29.803 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:53:00.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:53:00.119 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:53:30.195 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:53:30.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:54:00.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:54:00.277 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:54:30.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:54:30.558 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:55:00.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:55:00.702 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:55:30.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:55:30.776 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:56:01.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:56:01.287 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:56:31.652 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:56:31.655 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:57:02.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:57:02.044 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:57:32.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:57:32.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:58:02.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:58:02.515 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:58:32.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:58:32.582 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:59:02.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:59:02.662 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T04:59:02.747 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T04:59:02.752+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50696) UID: 0 2024-03-18T04:59:02.747 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T04:59:02.752+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50696) UID: 0 2024-03-18T04:59:02.753 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:59:02.755+0000 7f5ae90b1640 -1 Fail to open '/proc/50696/cmdline' error = (2) No such file or directory 2024-03-18T04:59:02.753 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T04:59:02.752+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50696) UID: 0 2024-03-18T04:59:02.753 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T04:59:02.755+0000 7f5ae90b1640 -1 received signal: Hangup from (PID: 50696) UID: 0 2024-03-18T05:02:26.381 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:02:26.384 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:02:26.425 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T05:02:26.431+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609072) UID: 0 2024-03-18T05:02:26.425 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T05:02:26.432+0000 7f951d6d3640 -1 received signal: Hangup from (PID: 609072) UID: 0 2024-03-18T05:02:26.426 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T05:02:26.431+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609072) UID: 0 2024-03-18T05:02:26.426 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T05:02:26.431+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 609072) UID: 0 2024-03-18T05:04:15.730 INFO:teuthology.orchestra.run.smithi081.stdout:generic/522 3506s 2024-03-18T05:04:15.860 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/522 2024-03-18T05:04:15.860 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:15.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:15.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:15.927 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-18T05:04:16.820 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:16.824 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:16.825 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:16.826 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:16.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:17.531 INFO:teuthology.orchestra.run.smithi081.stdout:generic/523 1s 2024-03-18T05:04:17.538 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/523 2024-03-18T05:04:17.538 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:17.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:17.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:17.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-18T05:04:17.820 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:17.825 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:17.826 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:17.827 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:17.827 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:22.493 INFO:teuthology.orchestra.run.smithi081.stdout:generic/524 5s 2024-03-18T05:04:22.501 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/524 2024-03-18T05:04:22.501 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:22.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:22.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:22.514 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-18T05:04:22.785 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:22.792 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:22.793 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:22.794 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:22.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:23.294 INFO:teuthology.orchestra.run.smithi081.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-18T05:04:23.310 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/525 2024-03-18T05:04:23.310 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/525 2024-03-18T05:04:23.310 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:23.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:23.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:23.343 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-18T05:04:23.624 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:23.629 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:23.630 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:23.631 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:23.631 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:24.025 INFO:teuthology.orchestra.run.smithi081.stdout:generic/526 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:04:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/526 2024-03-18T05:04:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/526 2024-03-18T05:04:24.031 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:24.034 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:24.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:24.067 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-18T05:04:24.342 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:24.346 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:24.347 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:24.347 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:24.685 INFO:teuthology.orchestra.run.smithi081.stdout:generic/527 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:04:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/527 2024-03-18T05:04:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/527 2024-03-18T05:04:24.692 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:24.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:24.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:24.732 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-18T05:04:24.971 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:24.975 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:24.975 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:24.976 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:24.976 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:25.374 INFO:teuthology.orchestra.run.smithi081.stdout:generic/528 0s 2024-03-18T05:04:25.383 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/528 2024-03-18T05:04:25.384 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:25.387 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:25.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:25.422 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-18T05:04:25.915 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:25.919 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:25.919 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:25.920 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:25.921 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:27.323 INFO:teuthology.orchestra.run.smithi081.stdout:generic/529 1s 2024-03-18T05:04:27.332 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/529 2024-03-18T05:04:27.332 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:27.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:27.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:27.349 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-18T05:04:27.628 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:27.633 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:27.633 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:27.634 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:27.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-18T05:04:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/530 2024-03-18T05:04:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/530 2024-03-18T05:04:28.080 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:28.082 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:28.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:28.103 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-18T05:04:28.352 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:28.357 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:28.359 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:28.360 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:28.360 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:28.671 INFO:teuthology.orchestra.run.smithi081.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-18T05:04:28.676 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/531 2024-03-18T05:04:28.676 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/531 2024-03-18T05:04:28.677 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:28.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:28.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:28.716 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-18T05:04:28.968 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:28.973 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:28.973 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:28.976 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:28.976 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:29.393 INFO:teuthology.orchestra.run.smithi081.stdout:generic/532 0s 2024-03-18T05:04:29.399 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/532 2024-03-18T05:04:29.399 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:29.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:29.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:29.425 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-18T05:04:29.681 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:29.685 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:29.686 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:29.687 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:29.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:30.809 INFO:teuthology.orchestra.run.smithi081.stdout:generic/533 1s 2024-03-18T05:04:30.819 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/533 2024-03-18T05:04:30.819 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:30.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:30.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:30.846 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-18T05:04:31.108 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:31.118 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:31.118 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:31.119 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:31.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:31.425 INFO:teuthology.orchestra.run.smithi081.stdout:generic/534 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:04:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/534 2024-03-18T05:04:31.429 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/534 2024-03-18T05:04:31.430 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:31.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:31.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:31.451 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-18T05:04:31.713 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:31.721 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:31.722 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:31.723 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:31.723 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:32.052 INFO:teuthology.orchestra.run.smithi081.stdout:generic/535 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:04:32.058 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/535 2024-03-18T05:04:32.058 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/535 2024-03-18T05:04:32.058 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:32.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:32.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:32.081 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-18T05:04:32.353 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:32.358 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:32.358 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:32.359 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:32.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:32.799 INFO:teuthology.orchestra.run.smithi081.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-18T05:04:32.813 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/536 2024-03-18T05:04:32.814 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/536 2024-03-18T05:04:32.814 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:32.819 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:32.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:32.839 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-18T05:04:33.123 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:33.131 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:33.131 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:33.132 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:33.132 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:33.572 INFO:teuthology.orchestra.run.smithi081.stdout:generic/537 [not run] FSTRIM not supported 2024-03-18T05:04:33.596 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/537 2024-03-18T05:04:33.596 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/537 2024-03-18T05:04:33.596 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:04:33.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:04:33.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:04:33.620 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-18T05:04:33.874 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:04:33.883 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:04:33.883 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:04:33.885 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:04:33.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:05:33.590 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:05:33.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:05:33.665 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T05:05:33.674+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50753) UID: 0 2024-03-18T05:05:33.665 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T05:05:33.674+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50753) UID: 0 2024-03-18T05:05:33.666 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T05:05:33.674+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50753) UID: 0 2024-03-18T05:05:33.667 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T05:05:33.674+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50753) UID: 0 2024-03-18T05:09:00.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:09:00.523 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:09:00.569 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T05:09:00.580+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50777) UID: 0 2024-03-18T05:09:00.569 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T05:09:00.580+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50777) UID: 0 2024-03-18T05:09:00.570 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T05:09:00.580+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50777) UID: 0 2024-03-18T05:09:00.570 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T05:09:00.580+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50777) UID: 0 2024-03-18T05:12:25.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:12:25.820 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:12:35.739 INFO:teuthology.orchestra.run.smithi081.stdout:generic/538 481s 2024-03-18T05:12:35.747 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/538 2024-03-18T05:12:35.748 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:35.751 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:35.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:35.803 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-18T05:12:36.184 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:36.189 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:36.189 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:36.191 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:38.157 INFO:teuthology.orchestra.run.smithi081.stdout:generic/539 2s 2024-03-18T05:12:38.164 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/539 2024-03-18T05:12:38.164 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:38.166 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:38.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:38.217 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-18T05:12:38.612 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:38.616 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:38.617 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:39.120 INFO:teuthology.orchestra.run.smithi081.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:12:39.125 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/540 2024-03-18T05:12:39.126 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/540 2024-03-18T05:12:39.126 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:39.129 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:39.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:39.425 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-18T05:12:39.636 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:39.640 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:39.641 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:40.117 INFO:teuthology.orchestra.run.smithi081.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:12:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/541 2024-03-18T05:12:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/541 2024-03-18T05:12:40.124 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:40.126 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:40.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:40.431 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-18T05:12:40.673 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:40.678 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:40.678 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:40.679 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:40.679 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:41.146 INFO:teuthology.orchestra.run.smithi081.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:12:41.153 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/542 2024-03-18T05:12:41.153 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/542 2024-03-18T05:12:41.153 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:41.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:41.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:41.493 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-18T05:12:41.704 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:41.709 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:41.709 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:41.710 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:41.710 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:42.194 INFO:teuthology.orchestra.run.smithi081.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:12:42.200 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/543 2024-03-18T05:12:42.200 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/543 2024-03-18T05:12:42.200 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:42.206 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:42.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:42.606 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-18T05:12:42.833 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:42.837 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:42.838 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:42.839 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:43.290 INFO:teuthology.orchestra.run.smithi081.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:12:43.300 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/544 2024-03-18T05:12:43.300 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/544 2024-03-18T05:12:43.300 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:43.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:43.652 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-18T05:12:43.869 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:43.873 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:43.873 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:43.874 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:43.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:44.258 INFO:teuthology.orchestra.run.smithi081.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-18T05:12:44.262 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/545 2024-03-18T05:12:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/545 2024-03-18T05:12:44.263 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:44.265 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:44.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:44.297 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-18T05:12:44.528 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:44.534 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:44.534 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:44.535 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:44.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:44.868 INFO:teuthology.orchestra.run.smithi081.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:12:44.868 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/546 2024-03-18T05:12:44.868 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/546 2024-03-18T05:12:44.868 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:44.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:44.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:44.904 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-18T05:12:45.134 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:45.138 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:45.138 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:45.140 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:45.140 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:45.431 INFO:teuthology.orchestra.run.smithi081.stdout:generic/547 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:12:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/547 2024-03-18T05:12:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/547 2024-03-18T05:12:45.436 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:45.439 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:45.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:45.458 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-18T05:12:45.687 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:45.691 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:45.692 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:45.693 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:45.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:46.150 INFO:teuthology.orchestra.run.smithi081.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-03-18T05:12:46.162 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/548 2024-03-18T05:12:46.162 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/548 2024-03-18T05:12:46.162 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:46.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:46.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:46.184 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-18T05:12:46.408 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:46.412 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:46.412 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:46.414 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:46.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:46.885 INFO:teuthology.orchestra.run.smithi081.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-03-18T05:12:46.897 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/549 2024-03-18T05:12:46.898 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/549 2024-03-18T05:12:46.898 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:46.900 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:46.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:46.920 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-18T05:12:47.164 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:47.168 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:47.168 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:47.169 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:47.169 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:47.614 INFO:teuthology.orchestra.run.smithi081.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-03-18T05:12:47.638 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/550 2024-03-18T05:12:47.638 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/550 2024-03-18T05:12:47.638 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:12:47.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:47.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:12:47.660 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-18T05:12:47.898 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:12:47.901 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:12:47.902 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:12:47.903 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:12:47.903 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:12:55.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:12:55.918 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:13:26.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:13:26.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:13:56.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:13:56.344 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:14:27.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:14:27.375 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:14:57.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:14:57.483 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:15:27.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:15:27.575 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:15:57.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:15:57.726 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:16:27.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:16:27.831 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:16:58.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:16:58.038 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:17:28.129 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:17:28.133 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:17:28.363 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T05:17:28.377+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 630262) UID: 0 2024-03-18T05:17:28.365 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T05:17:28.377+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 630262) UID: 0 2024-03-18T05:17:28.366 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T05:17:28.377+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 630262) UID: 0 2024-03-18T05:17:28.370 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T05:17:28.377+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 630262) UID: 0 2024-03-18T05:20:45.773 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:20:45.777 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:21:15.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:21:15.931 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:21:46.000 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:21:46.003 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:22:16.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:22:16.246 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:22:46.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:22:46.358 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:23:16.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:23:16.631 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:23:46.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:23:46.796 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:24:17.014 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:24:17.017 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:24:47.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:24:47.096 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:25:17.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:25:17.525 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:25:47.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:25:47.597 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:25:50.713 INFO:teuthology.orchestra.run.smithi081.stdout:generic/551 782s 2024-03-18T05:25:50.765 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/551 2024-03-18T05:25:50.766 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:50.768 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:50.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:50.791 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-18T05:25:51.358 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:51.362 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:51.362 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:51.363 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:51.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:51.823 INFO:teuthology.orchestra.run.smithi081.stdout:generic/552 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:25:51.828 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/552 2024-03-18T05:25:51.828 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/552 2024-03-18T05:25:51.828 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:51.830 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:51.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:51.851 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-18T05:25:52.119 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:52.125 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:52.126 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:52.128 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:52.129 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:52.524 INFO:teuthology.orchestra.run.smithi081.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-03-18T05:25:52.532 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/553 2024-03-18T05:25:52.532 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/553 2024-03-18T05:25:52.532 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:52.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:52.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:52.651 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-18T05:25:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:53.099 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:53.099 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:53.100 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:53.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:53.635 INFO:teuthology.orchestra.run.smithi081.stdout:generic/554 [not run] swapfiles are not supported 2024-03-18T05:25:53.640 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/554 2024-03-18T05:25:53.640 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/554 2024-03-18T05:25:53.640 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:53.643 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:53.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:53.701 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-18T05:25:54.088 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:54.093 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:54.095 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:54.096 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:54.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:54.806 INFO:teuthology.orchestra.run.smithi081.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-03-18T05:25:54.811 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/555 2024-03-18T05:25:54.811 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/555 2024-03-18T05:25:54.811 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:54.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:54.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:54.845 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-18T05:25:55.225 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:55.229 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:55.230 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:55.231 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:55.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:55.504 INFO:teuthology.orchestra.run.smithi081.stdout:generic/556 [not run] ceph does not support casefold feature 2024-03-18T05:25:55.509 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/556 2024-03-18T05:25:55.509 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/556 2024-03-18T05:25:55.509 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:55.512 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:55.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:55.533 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-18T05:25:55.766 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:55.779 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:55.779 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:55.780 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:55.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:56.066 INFO:teuthology.orchestra.run.smithi081.stdout:generic/557 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:25:56.070 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/557 2024-03-18T05:25:56.071 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/557 2024-03-18T05:25:56.071 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:56.073 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:56.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:56.091 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-18T05:25:56.313 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:56.317 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:56.318 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:56.319 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:56.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:56.620 INFO:teuthology.orchestra.run.smithi081.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T05:25:56.625 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/558 2024-03-18T05:25:56.625 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/558 2024-03-18T05:25:56.625 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:56.628 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:56.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:56.648 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-18T05:25:56.873 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:56.878 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:56.878 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:56.879 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:56.879 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:57.158 INFO:teuthology.orchestra.run.smithi081.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-03-18T05:25:57.163 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/559 2024-03-18T05:25:57.163 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/559 2024-03-18T05:25:57.164 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:57.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:57.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:57.197 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-18T05:25:57.426 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:57.431 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:57.432 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:57.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:57.704 INFO:teuthology.orchestra.run.smithi081.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-03-18T05:25:57.710 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/560 2024-03-18T05:25:57.710 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/560 2024-03-18T05:25:57.710 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:57.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:57.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:57.736 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-18T05:25:57.972 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:57.976 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:57.976 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:57.977 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:57.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:58.243 INFO:teuthology.orchestra.run.smithi081.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-03-18T05:25:58.247 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/561 2024-03-18T05:25:58.247 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/561 2024-03-18T05:25:58.248 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:58.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:58.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:58.271 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-18T05:25:58.514 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:58.518 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:58.519 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:58.520 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:58.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:59.000 INFO:teuthology.orchestra.run.smithi081.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:25:59.005 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/562 2024-03-18T05:25:59.005 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/562 2024-03-18T05:25:59.005 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:59.009 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:59.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:59.238 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-18T05:25:59.496 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:25:59.502 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:25:59.503 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:25:59.504 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:25:59.504 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:59.841 INFO:teuthology.orchestra.run.smithi081.stdout:generic/563 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:25:59.853 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/563 2024-03-18T05:25:59.853 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/563 2024-03-18T05:25:59.853 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:25:59.857 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:25:59.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:25:59.879 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-18T05:26:00.117 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:00.122 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:00.122 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:00.123 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:00.124 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:00.612 INFO:teuthology.orchestra.run.smithi081.stdout:generic/564 0s 2024-03-18T05:26:00.620 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/564 2024-03-18T05:26:00.621 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:00.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:00.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:00.697 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-18T05:26:01.071 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:01.074 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:01.075 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:01.076 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:01.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:01.593 INFO:teuthology.orchestra.run.smithi081.stdout:generic/565 0s 2024-03-18T05:26:01.599 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/565 2024-03-18T05:26:01.599 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:01.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:01.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:01.658 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-18T05:26:02.053 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:02.060 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:02.060 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:02.060 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:02.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:02.370 INFO:teuthology.orchestra.run.smithi081.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:02.377 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/566 2024-03-18T05:26:02.377 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/566 2024-03-18T05:26:02.377 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:02.379 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:02.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:02.405 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-18T05:26:02.642 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:02.647 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:02.647 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:02.648 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:02.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:03.390 INFO:teuthology.orchestra.run.smithi081.stdout:generic/567 1s 2024-03-18T05:26:03.397 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/567 2024-03-18T05:26:03.397 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:03.399 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:03.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:03.409 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-18T05:26:03.670 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:03.675 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:03.675 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:03.974 INFO:teuthology.orchestra.run.smithi081.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:26:03.979 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/568 2024-03-18T05:26:03.979 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/568 2024-03-18T05:26:03.979 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:03.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:04.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:04.010 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-18T05:26:04.235 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:04.239 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:04.240 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:04.240 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:04.241 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:04.528 INFO:teuthology.orchestra.run.smithi081.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:26:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/569 2024-03-18T05:26:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/569 2024-03-18T05:26:04.532 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:04.535 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:04.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:04.567 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-18T05:26:04.794 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:04.799 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:04.800 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:04.801 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:04.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:05.078 INFO:teuthology.orchestra.run.smithi081.stdout:generic/570 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:26:05.083 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/570 2024-03-18T05:26:05.083 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/570 2024-03-18T05:26:05.083 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:05.085 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:05.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:05.104 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-18T05:26:05.339 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:05.345 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:05.346 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:05.347 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:05.347 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:05.666 INFO:teuthology.orchestra.run.smithi081.stdout:generic/571 [not run] Require fcntl setlease support 2024-03-18T05:26:05.670 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/571 2024-03-18T05:26:05.670 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/571 2024-03-18T05:26:05.670 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:05.672 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:05.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:05.706 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-18T05:26:05.950 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:06.248 INFO:teuthology.orchestra.run.smithi081.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:06.258 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/572 2024-03-18T05:26:06.259 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/572 2024-03-18T05:26:06.259 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:06.262 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:06.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:06.288 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-18T05:26:06.510 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:06.514 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:06.515 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:06.516 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:06.516 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:06.796 INFO:teuthology.orchestra.run.smithi081.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:06.801 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/573 2024-03-18T05:26:06.801 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/573 2024-03-18T05:26:06.801 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:06.803 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:06.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:06.821 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-18T05:26:07.059 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:07.065 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:07.065 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:07.066 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:07.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:07.331 INFO:teuthology.orchestra.run.smithi081.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:07.337 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/574 2024-03-18T05:26:07.337 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/574 2024-03-18T05:26:07.337 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:07.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:07.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:07.357 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-18T05:26:07.580 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:07.588 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:07.588 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:07.589 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:07.589 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:07.855 INFO:teuthology.orchestra.run.smithi081.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/575 2024-03-18T05:26:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/575 2024-03-18T05:26:07.859 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:07.862 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:07.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:07.881 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-18T05:26:08.115 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:08.120 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:08.121 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:08.122 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:08.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:08.423 INFO:teuthology.orchestra.run.smithi081.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:08.428 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/576 2024-03-18T05:26:08.428 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/576 2024-03-18T05:26:08.428 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:08.431 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:08.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:08.454 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-18T05:26:08.683 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:08.687 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:08.688 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:08.689 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:08.689 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:08.986 INFO:teuthology.orchestra.run.smithi081.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:08.991 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/577 2024-03-18T05:26:08.991 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/577 2024-03-18T05:26:08.991 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:08.993 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:09.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:09.026 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-18T05:26:09.269 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:09.273 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:09.273 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:09.275 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:09.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:09.597 INFO:teuthology.orchestra.run.smithi081.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T05:26:09.601 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/578 2024-03-18T05:26:09.602 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/578 2024-03-18T05:26:09.602 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:09.604 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:09.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:09.634 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-18T05:26:09.872 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:09.878 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:09.878 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:09.880 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:09.880 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:10.174 INFO:teuthology.orchestra.run.smithi081.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-03-18T05:26:10.178 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/579 2024-03-18T05:26:10.178 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/579 2024-03-18T05:26:10.178 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:10.181 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:10.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:10.206 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-18T05:26:10.444 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:10.449 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:10.449 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:10.450 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:10.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:10.981 INFO:teuthology.orchestra.run.smithi081.stdout:generic/580 [not run] kernel does not support ceph encryption 2024-03-18T05:26:11.003 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/580 2024-03-18T05:26:11.003 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/580 2024-03-18T05:26:11.003 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:11.006 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:11.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:11.027 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-18T05:26:11.265 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:11.269 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:11.270 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:11.270 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:12.375 INFO:teuthology.orchestra.run.smithi081.stdout:generic/581 [not run] kernel does not support ceph encryption 2024-03-18T05:26:12.389 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/581 2024-03-18T05:26:12.389 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/581 2024-03-18T05:26:12.389 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:12.392 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:12.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:12.411 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-18T05:26:12.638 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:12.642 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:12.643 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:12.644 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:12.644 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:13.090 INFO:teuthology.orchestra.run.smithi081.stdout:generic/582 [not run] kernel does not support ceph encryption 2024-03-18T05:26:13.100 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/582 2024-03-18T05:26:13.101 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/582 2024-03-18T05:26:13.101 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:13.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:13.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:13.128 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-18T05:26:13.358 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:13.362 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:13.362 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:13.363 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:13.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:13.850 INFO:teuthology.orchestra.run.smithi081.stdout:generic/583 [not run] kernel does not support ceph encryption 2024-03-18T05:26:13.872 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/583 2024-03-18T05:26:13.872 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/583 2024-03-18T05:26:13.872 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:13.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:13.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:13.893 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-18T05:26:14.141 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:14.146 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:14.146 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:14.148 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:14.610 INFO:teuthology.orchestra.run.smithi081.stdout:generic/584 [not run] kernel does not support ceph encryption 2024-03-18T05:26:14.624 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/584 2024-03-18T05:26:14.624 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/584 2024-03-18T05:26:14.624 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:14.627 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:14.650 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:14.650 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-18T05:26:14.899 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:14.904 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:14.905 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:14.905 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:15.271 INFO:teuthology.orchestra.run.smithi081.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-03-18T05:26:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/585 2024-03-18T05:26:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/585 2024-03-18T05:26:15.278 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:15.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:15.327 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:15.327 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-18T05:26:15.714 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:15.719 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:15.720 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:15.720 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:15.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:16.113 INFO:teuthology.orchestra.run.smithi081.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:26:16.118 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/586 2024-03-18T05:26:16.118 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/586 2024-03-18T05:26:16.118 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:16.121 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:16.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:16.166 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-18T05:26:16.578 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:16.583 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:16.583 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:16.584 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:16.584 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:16.876 INFO:teuthology.orchestra.run.smithi081.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:16.880 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/587 2024-03-18T05:26:16.880 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/587 2024-03-18T05:26:16.880 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:16.883 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:16.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:16.913 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-18T05:26:17.147 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:17.153 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:17.154 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:17.155 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:17.155 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:17.640 INFO:teuthology.orchestra.run.smithi081.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:26:17.648 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/588 2024-03-18T05:26:17.648 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/588 2024-03-18T05:26:17.648 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:17.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:17.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:26:17.669 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:26:17.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:17.813 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-18T05:26:18.118 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:18.123 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:18.124 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:18.125 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:18.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:18.420 INFO:teuthology.orchestra.run.smithi081.stdout:generic/589 [not run] require 172.21.15.81:6789:/scratch to be local device 2024-03-18T05:26:18.425 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/589 2024-03-18T05:26:18.425 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/589 2024-03-18T05:26:18.425 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:18.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:18.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:18.467 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-18T05:26:18.739 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:18.744 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:18.745 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:18.746 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:18.747 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:19.084 INFO:teuthology.orchestra.run.smithi081.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:26:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/590 2024-03-18T05:26:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/590 2024-03-18T05:26:19.089 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:19.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:19.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:19.122 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-18T05:26:19.382 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:19.388 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:19.389 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:19.390 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:19.390 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:19.934 INFO:teuthology.orchestra.run.smithi081.stdout:generic/591 0s 2024-03-18T05:26:19.941 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/591 2024-03-18T05:26:19.941 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:19.946 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:20.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:20.007 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-18T05:26:20.463 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:20.468 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:20.468 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:20.469 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:20.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:20.913 INFO:teuthology.orchestra.run.smithi081.stdout:generic/592 [not run] kernel does not support ceph encryption 2024-03-18T05:26:20.927 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/592 2024-03-18T05:26:20.928 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/592 2024-03-18T05:26:20.928 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:20.930 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:20.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:20.947 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-18T05:26:21.194 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:21.198 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:21.199 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:21.200 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:21.200 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:21.656 INFO:teuthology.orchestra.run.smithi081.stdout:generic/593 [not run] kernel does not support ceph encryption 2024-03-18T05:26:21.681 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/593 2024-03-18T05:26:21.682 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/593 2024-03-18T05:26:21.682 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:21.684 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:21.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:21.703 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-18T05:26:21.940 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:21.945 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:21.945 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:21.947 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:21.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:22.604 INFO:teuthology.orchestra.run.smithi081.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:22.609 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/594 2024-03-18T05:26:22.609 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/594 2024-03-18T05:26:22.609 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:22.612 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:22.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:22.638 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-18T05:26:22.882 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:22.888 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:23.311 INFO:teuthology.orchestra.run.smithi081.stdout:generic/595 [not run] kernel does not support ceph encryption 2024-03-18T05:26:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/595 2024-03-18T05:26:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/595 2024-03-18T05:26:23.324 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:23.326 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:23.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:23.346 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-18T05:26:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:23.578 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:23.579 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:23.580 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:23.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:23.962 INFO:teuthology.orchestra.run.smithi081.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-18T05:26:23.966 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/596 2024-03-18T05:26:23.967 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/596 2024-03-18T05:26:23.967 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:23.969 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:23.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:23.999 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-18T05:26:24.235 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:24.240 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:24.241 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:24.242 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:24.242 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:25.107 INFO:teuthology.orchestra.run.smithi081.stdout:generic/597 1s 2024-03-18T05:26:25.114 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/597 2024-03-18T05:26:25.114 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:25.118 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:25.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:25.177 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-18T05:26:25.539 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:25.543 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:25.544 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:25.545 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:25.545 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:26.450 INFO:teuthology.orchestra.run.smithi081.stdout:generic/598 1s 2024-03-18T05:26:26.457 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/598 2024-03-18T05:26:26.457 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:26.459 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:26.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:26.535 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-18T05:26:26.889 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:26.893 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:26.894 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:26.895 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:26.895 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:27.345 INFO:teuthology.orchestra.run.smithi081.stdout:generic/599 [not run] ceph does not support shutdown 2024-03-18T05:26:27.359 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/599 2024-03-18T05:26:27.360 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/599 2024-03-18T05:26:27.360 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:27.364 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:27.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:27.385 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-18T05:26:27.634 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:27.638 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:27.638 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:27.640 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:27.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:27.932 INFO:teuthology.orchestra.run.smithi081.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:27.937 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/600 2024-03-18T05:26:27.937 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/600 2024-03-18T05:26:27.937 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:27.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:27.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:27.958 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-18T05:26:28.180 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:28.188 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:28.190 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:28.190 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:28.471 INFO:teuthology.orchestra.run.smithi081.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/601 2024-03-18T05:26:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/601 2024-03-18T05:26:28.474 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:28.476 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:28.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:28.496 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-18T05:26:28.734 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:28.740 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:28.741 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:28.742 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:28.742 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:29.179 INFO:teuthology.orchestra.run.smithi081.stdout:generic/602 [not run] kernel does not support ceph encryption 2024-03-18T05:26:29.206 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/602 2024-03-18T05:26:29.206 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/602 2024-03-18T05:26:29.207 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:29.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:29.226 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:29.226 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-18T05:26:29.476 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:29.481 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:29.482 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:29.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T05:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/603 2024-03-18T05:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/603 2024-03-18T05:26:29.779 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:29.782 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:29.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:29.810 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-18T05:26:30.051 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:30.055 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:30.056 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:30.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:34.828 INFO:teuthology.orchestra.run.smithi081.stdout:generic/604 4s 2024-03-18T05:26:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/604 2024-03-18T05:26:34.834 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:34.837 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:34.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:34.847 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-18T05:26:35.074 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:35.079 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:35.079 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:35.080 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:35.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:37.285 INFO:teuthology.orchestra.run.smithi081.stdout:generic/605 [not run] mount 172.21.15.81:6789:/scratch with dax=always failed 2024-03-18T05:26:37.290 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/605 2024-03-18T05:26:37.290 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/605 2024-03-18T05:26:37.290 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:37.292 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:37.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:37.315 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-18T05:26:37.551 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:37.556 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:37.556 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:37.557 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:37.558 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:37.978 INFO:teuthology.orchestra.run.smithi081.stdout:generic/606 [not run] mount 172.21.15.81:6789:/scratch with dax=always failed 2024-03-18T05:26:37.982 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/606 2024-03-18T05:26:37.982 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/606 2024-03-18T05:26:37.983 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:37.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:38.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:38.004 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-18T05:26:38.237 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:38.241 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:38.241 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:38.242 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:38.242 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:38.535 INFO:teuthology.orchestra.run.smithi081.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-03-18T05:26:38.539 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/607 2024-03-18T05:26:38.539 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/607 2024-03-18T05:26:38.539 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:38.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:38.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:38.594 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-18T05:26:38.989 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:38.992 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:38.993 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:38.994 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:38.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:39.366 INFO:teuthology.orchestra.run.smithi081.stdout:generic/608 [not run] mount 172.21.15.81:6789:/scratch with dax=always failed 2024-03-18T05:26:39.371 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/608 2024-03-18T05:26:39.371 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/608 2024-03-18T05:26:39.371 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:39.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:39.398 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:39.398 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-18T05:26:39.628 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:39.631 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:39.632 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:39.633 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:40.206 INFO:teuthology.orchestra.run.smithi081.stdout:generic/609 1s 2024-03-18T05:26:40.213 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/609 2024-03-18T05:26:40.213 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:40.216 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:40.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:40.266 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-18T05:26:40.690 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:40.692 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:40.693 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:40.694 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:40.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:41.074 INFO:teuthology.orchestra.run.smithi081.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T05:26:41.079 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/610 2024-03-18T05:26:41.079 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/610 2024-03-18T05:26:41.079 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:41.081 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:41.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:41.111 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-18T05:26:41.367 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:41.372 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:41.373 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:41.373 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:41.975 INFO:teuthology.orchestra.run.smithi081.stdout:generic/611 0s 2024-03-18T05:26:41.982 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/611 2024-03-18T05:26:41.982 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:41.985 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:41.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:41.996 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-18T05:26:42.226 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:42.232 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:42.232 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:42.233 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:42.233 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:42.627 INFO:teuthology.orchestra.run.smithi081.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T05:26:42.631 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/612 2024-03-18T05:26:42.631 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/612 2024-03-18T05:26:42.631 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:42.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:42.687 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-18T05:26:43.095 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:43.099 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:43.100 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:43.100 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:43.559 INFO:teuthology.orchestra.run.smithi081.stdout:generic/613 [not run] kernel does not support ceph encryption 2024-03-18T05:26:43.573 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/613 2024-03-18T05:26:43.573 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/613 2024-03-18T05:26:43.574 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:43.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:43.597 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-18T05:26:43.836 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:43.840 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:43.840 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:43.841 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:43.841 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:44.391 INFO:teuthology.orchestra.run.smithi081.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-03-18T05:26:44.415 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/614 2024-03-18T05:26:44.415 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/614 2024-03-18T05:26:44.415 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:26:44.418 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:44.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:26:44.442 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-18T05:26:44.663 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:26:44.666 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:26:44.666 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:26:44.668 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:26:44.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:26:47.808 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:26:47.813 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:27:17.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:27:17.883 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:27:42.446 INFO:teuthology.orchestra.run.smithi081.stdout:generic/615 58s 2024-03-18T05:27:42.451 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/615 2024-03-18T05:27:42.451 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:42.454 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:42.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:42.469 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-18T05:27:42.690 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:42.694 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:42.695 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:42.696 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:42.984 INFO:teuthology.orchestra.run.smithi081.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-18T05:27:42.989 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/616 2024-03-18T05:27:42.990 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/616 2024-03-18T05:27:42.990 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:43.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:43.009 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-18T05:27:43.232 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:43.242 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:43.242 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:43.243 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:43.599 INFO:teuthology.orchestra.run.smithi081.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-18T05:27:43.605 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/617 2024-03-18T05:27:43.606 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/617 2024-03-18T05:27:43.606 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:43.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:43.627 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-18T05:27:43.857 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:43.862 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:43.863 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:43.864 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:43.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:44.443 INFO:teuthology.orchestra.run.smithi081.stdout:generic/618 0s 2024-03-18T05:27:44.453 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/618 2024-03-18T05:27:44.454 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:44.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:44.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:44.465 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-18T05:27:44.689 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:44.694 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:44.694 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:44.695 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:44.695 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:45.002 INFO:teuthology.orchestra.run.smithi081.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T05:27:45.007 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/619 2024-03-18T05:27:45.007 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/619 2024-03-18T05:27:45.007 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:45.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:45.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:45.038 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-18T05:27:45.277 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:45.281 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:45.282 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:45.283 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:45.283 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:45.595 INFO:teuthology.orchestra.run.smithi081.stdout:generic/620 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:27:45.598 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/620 2024-03-18T05:27:45.599 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/620 2024-03-18T05:27:45.599 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:45.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:45.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:45.620 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-18T05:27:45.855 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:45.860 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:45.860 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:45.861 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:45.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:46.299 INFO:teuthology.orchestra.run.smithi081.stdout:generic/621 [not run] kernel does not support ceph encryption 2024-03-18T05:27:46.313 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/621 2024-03-18T05:27:46.313 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/621 2024-03-18T05:27:46.313 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:46.316 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:46.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:46.338 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-18T05:27:46.572 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:46.578 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:46.579 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:46.580 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:46.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:46.965 INFO:teuthology.orchestra.run.smithi081.stdout:generic/622 [not run] ceph does not support shutdown 2024-03-18T05:27:46.980 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/622 2024-03-18T05:27:46.980 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/622 2024-03-18T05:27:46.980 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:46.982 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:47.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:47.003 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-18T05:27:47.250 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:47.254 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:47.254 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:47.256 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:47.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:47.643 INFO:teuthology.orchestra.run.smithi081.stdout:generic/623 [not run] ceph does not support shutdown 2024-03-18T05:27:47.661 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/623 2024-03-18T05:27:47.661 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/623 2024-03-18T05:27:47.661 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:47.664 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:47.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:47.682 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-18T05:27:47.944 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:47.949 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:47.950 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:47.951 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:47.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:47.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:27:47.976 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:27:48.234 INFO:teuthology.orchestra.run.smithi081.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-03-18T05:27:48.238 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/624 2024-03-18T05:27:48.238 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/624 2024-03-18T05:27:48.238 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:48.241 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:48.260 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:48.260 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-18T05:27:48.506 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:48.510 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:48.510 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:48.511 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:48.511 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:48.774 INFO:teuthology.orchestra.run.smithi081.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-03-18T05:27:48.780 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/625 2024-03-18T05:27:48.780 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/625 2024-03-18T05:27:48.780 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:48.783 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:48.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:48.804 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-18T05:27:49.033 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:49.037 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:49.037 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:49.038 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:49.038 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:49.349 INFO:teuthology.orchestra.run.smithi081.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-03-18T05:27:49.354 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/626 2024-03-18T05:27:49.355 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/626 2024-03-18T05:27:49.355 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:49.357 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:49.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:49.411 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-18T05:27:49.809 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:49.813 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:49.813 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:49.814 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:49.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:50.179 INFO:teuthology.orchestra.run.smithi081.stdout:generic/627 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:27:50.184 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/627 2024-03-18T05:27:50.184 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/627 2024-03-18T05:27:50.184 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:50.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:50.205 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:50.205 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-18T05:27:50.440 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:50.445 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:50.446 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:50.447 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:50.447 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:50.961 INFO:teuthology.orchestra.run.smithi081.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:27:50.967 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/628 2024-03-18T05:27:50.967 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/628 2024-03-18T05:27:50.967 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:50.973 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:51.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:51.272 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-18T05:27:51.482 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:51.486 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:51.486 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:51.487 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:51.487 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:51.814 INFO:teuthology.orchestra.run.smithi081.stdout:generic/629 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:27:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/629 2024-03-18T05:27:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/629 2024-03-18T05:27:51.818 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:51.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:51.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:51.846 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-18T05:27:52.073 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:52.078 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:52.078 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:52.079 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:52.080 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:52.514 INFO:teuthology.orchestra.run.smithi081.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T05:27:52.578 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/630 2024-03-18T05:27:52.578 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/630 2024-03-18T05:27:52.578 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:27:52.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:27:52.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:27:52.933 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-18T05:27:53.153 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:27:53.157 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:27:53.157 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:27:53.159 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:27:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:18.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:28:18.067 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:28:24.274 INFO:teuthology.orchestra.run.smithi081.stdout:generic/631 - output mismatch (see /tmp/tmp.MYwjXdaX5wxfstests-dev/results//generic/631.out.bad) 2024-03-18T05:28:24.291 INFO:teuthology.orchestra.run.smithi081.stdout: --- tests/generic/631.out 2024-03-18 00:26:21.756060621 +0000 2024-03-18T05:28:24.291 INFO:teuthology.orchestra.run.smithi081.stdout: +++ /tmp/tmp.MYwjXdaX5wxfstests-dev/results//generic/631.out.bad 2024-03-18 05:28:24.223240902 +0000 2024-03-18T05:28:24.291 INFO:teuthology.orchestra.run.smithi081.stdout: @@ -1,2 +1,4046 @@ 2024-03-18T05:28:24.291 INFO:teuthology.orchestra.run.smithi081.stdout: QA output created by 631 2024-03-18T05:28:24.291 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.292 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.293 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.294 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.295 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.296 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.297 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.298 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.299 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.300 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.301 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.301 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.301 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.301 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.301 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.302 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.303 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.304 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.305 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.306 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.307 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.308 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.309 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.310 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.311 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.312 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.313 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.314 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.315 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.316 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.317 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.318 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.319 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.320 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.321 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.322 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.323 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.324 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.325 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.326 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.327 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.328 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.329 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.330 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.331 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.332 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.333 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.334 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.335 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.336 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.337 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.338 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.339 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.340 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.341 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.342 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.343 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.344 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.345 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.346 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.347 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted.umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.348 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.349 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.350 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.351 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.352 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.353 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.354 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.355 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.355 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.355 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.355 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.355 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.356 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.357 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.357 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.357 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.357 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.357 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.358 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.359 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.359 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.359 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.359 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.359 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.360 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.360 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.360 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.360 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.360 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.361 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.362 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.363 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.364 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.365 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.366 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.367 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.368 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.369 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.370 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.371 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.372 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.373 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.374 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.375 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.376 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.377 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.384 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.385 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.386 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.387 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.388 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.389 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.390 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.391 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.392 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.393 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: umount: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'/tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted.: No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: touch: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.394 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.395 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.396 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf' 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.397 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.398 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.399 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf' 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory: No such file or directory: No such file or directory 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.400 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.401 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.402 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.403 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.404 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.405 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.406 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.407 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.408 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.409 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.410 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.411 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'mv: : No such file or directory: No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf' 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.412 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.413 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.414 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.415 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.416 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.417 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.418 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.419 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.420 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.421 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.422 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.423 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.424 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.425 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.426 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.427 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.428 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.429 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.430 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.431 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.432 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.433 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.434 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.435 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.436 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.437 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf' 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.438 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.439 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.440 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.441 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted.touch: 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.442 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.443 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.444 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.445 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.446 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.447 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.448 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.449 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.450 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.451 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.452 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.453 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directorymv: 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.454 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.455 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.456 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.457 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.458 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.459 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.460 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.461 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.462 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.463 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.464 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.465 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.466 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.467 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.468 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.469 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.470 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.471 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.472 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.473 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.474 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.475 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.476 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.477 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.478 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.479 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.480 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directorymv: 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.481 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.482 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.483 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.484 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.485 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.486 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.487 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.488 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.umount: 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.489 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.490 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.491 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.492 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.493 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.494 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.495 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.496 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted.umount: 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.497 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.498 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.499 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.500 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.502 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.503 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.504 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.505 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.506 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.507 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.508 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.509 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.510 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.511 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.512 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.513 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: mv: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted.cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf' 2024-03-18T05:28:24.514 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.515 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.516 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.517 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mount: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'/tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.518 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.519 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.520 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.521 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.522 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: mv: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.523 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.524 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.525 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted./tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.526 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.527 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.528 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.529 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.530 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.531 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.532 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.533 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.534 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.535 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.536 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.537 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.538 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.539 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.540 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.541 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.542 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.543 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.544 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.545 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.546 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.547 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.548 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.549 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.550 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.551 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.552 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.553 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.554 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.555 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.556 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.557 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.558 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.559 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.560 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.561 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.562 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.563 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.564 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.565 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.566 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: touch: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted.cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf' 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.567 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.568 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.569 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf' 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.570 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directorymv: 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.571 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.572 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.573 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.574 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.575 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.576 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.577 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.578 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.579 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.580 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.581 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.582 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.583 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.584 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf' 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.585 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.586 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.587 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf'mv: : No such file or directorymv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf' 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory: No such file or directory: No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.588 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.589 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.590 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.591 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.592 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: mount: umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.593 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.594 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.595 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.596 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.597 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.598 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted.umount: 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.599 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.600 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf' 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +: No such file or directorymv: 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.601 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.602 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.603 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.604 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.605 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +/tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.606 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.607 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.608 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.609 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.610 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.611 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.612 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged3: not mounted. 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: mount: /tmp/tmp.PuVtZgZAHXscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.PuVtZgZAHXscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: + 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.613 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged0: not mounted. 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mount: /tmp/tmp.PuVtZgZAHXscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged5: not mounted. 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.614 INFO:teuthology.orchestra.run.smithi081.stdout: +mv: cannot stat '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged2: not mounted. 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged4: not mounted. 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: +touch: cannot touch '/tmp/tmp.PuVtZgZAHXscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: +umount: /tmp/tmp.PuVtZgZAHXscratch/merged1: not mounted. 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: Silence is golden. 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout:HINT: You _MAY_ be missing kernel fix: 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/631 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout:Failures: generic/631 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout:Failed 1 of 1 tests 2024-03-18T05:28:24.615 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:24.616 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-18T05:28:24.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-18T05:28:24.616 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-18T05:28:24.862 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:24.866 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:24.866 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:24.867 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:24.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:25.926 INFO:teuthology.orchestra.run.smithi081.stdout:generic/632 0s 2024-03-18T05:28:25.931 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/632 2024-03-18T05:28:25.931 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:25.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:25.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:25.967 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-18T05:28:26.204 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:26.208 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:26.209 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:26.210 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:26.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:generic/633 1s 2024-03-18T05:28:27.353 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/633 2024-03-18T05:28:27.354 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:27.356 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:27.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:27.442 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-18T05:28:27.823 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:27.827 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:27.828 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:27.829 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:27.829 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:28.993 INFO:teuthology.orchestra.run.smithi081.stdout:generic/634 2s 2024-03-18T05:28:29.000 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/634 2024-03-18T05:28:29.000 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:29.003 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:29.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:29.013 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-18T05:28:29.252 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:29.257 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:29.258 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:29.258 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:29.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:29.673 INFO:teuthology.orchestra.run.smithi081.stdout:generic/635 [not run] ceph does not support shutdown 2024-03-18T05:28:29.684 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/635 2024-03-18T05:28:29.684 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/635 2024-03-18T05:28:29.684 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:29.688 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:29.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:29.707 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-18T05:28:29.953 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:29.958 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:29.960 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:29.961 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:29.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:30.389 INFO:teuthology.orchestra.run.smithi081.stdout:generic/636 [not run] swapfiles are not supported 2024-03-18T05:28:30.394 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/636 2024-03-18T05:28:30.394 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/636 2024-03-18T05:28:30.394 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:30.398 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:30.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:30.422 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-18T05:28:30.650 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:30.655 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:30.655 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:30.656 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:30.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:32.476 INFO:teuthology.orchestra.run.smithi081.stdout:generic/637 2s 2024-03-18T05:28:32.483 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/637 2024-03-18T05:28:32.483 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:32.486 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:32.733 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:32.734 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-18T05:28:33.085 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:33.089 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:33.090 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:33.091 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:33.091 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:33.423 INFO:teuthology.orchestra.run.smithi081.stdout:generic/638 0s 2024-03-18T05:28:33.430 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/638 2024-03-18T05:28:33.430 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:33.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:33.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:33.463 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-18T05:28:33.706 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:33.710 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:33.712 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:33.712 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:33.712 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:34.163 INFO:teuthology.orchestra.run.smithi081.stdout:generic/639 1s 2024-03-18T05:28:34.172 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/639 2024-03-18T05:28:34.172 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:34.175 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:34.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:34.208 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-18T05:28:34.450 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:34.454 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:34.454 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:34.455 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:34.455 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:34.729 INFO:teuthology.orchestra.run.smithi081.stdout:generic/640 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T05:28:34.733 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/640 2024-03-18T05:28:34.733 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/640 2024-03-18T05:28:34.733 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:34.735 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:34.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:34.760 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-18T05:28:34.993 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:34.997 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:34.997 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:34.998 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:34.999 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:35.443 INFO:teuthology.orchestra.run.smithi081.stdout:generic/641 [not run] swapfiles are not supported 2024-03-18T05:28:35.448 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/641 2024-03-18T05:28:35.448 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/641 2024-03-18T05:28:35.448 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:28:35.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:35.481 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:28:35.482 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-18T05:28:35.720 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:28:35.725 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:28:35.726 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:28:35.727 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:28:35.727 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:28:48.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:28:48.136 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:29:18.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:29:18.408 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:29:48.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:29:48.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:29:48.728 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T05:29:48.745+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51434) UID: 0 2024-03-18T05:29:48.729 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T05:29:48.745+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51434) UID: 0 2024-03-18T05:33:26.799 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T05:33:26.814+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51441) UID: 0 2024-03-18T05:33:26.799 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T05:33:26.814+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51441) UID: 0 2024-03-18T05:33:26.800 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T05:33:26.814+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51441) UID: 0 2024-03-18T05:33:26.800 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T05:33:26.814+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51441) UID: 0 2024-03-18T05:37:58.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:37:58.969 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:37:59.010 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T05:37:59.028+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 736132) UID: 0 2024-03-18T05:37:59.011 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T05:37:59.028+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 736132) UID: 0 2024-03-18T05:37:59.011 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T05:37:59.028+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 736132) UID: 0 2024-03-18T05:37:59.012 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T05:37:59.028+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 736132) UID: 0 2024-03-18T05:38:00.702 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T05:38:00.720+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51465) UID: 0 2024-03-18T05:38:00.702 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T05:38:00.720+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51465) UID: 0 2024-03-18T05:41:41.903 INFO:teuthology.orchestra.run.smithi081.stdout:generic/642 786s 2024-03-18T05:41:41.958 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/642 2024-03-18T05:41:41.958 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:41:41.961 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:41:41.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:41:41.971 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-18T05:41:43.830 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:41:43.834 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:41:43.835 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:41:43.836 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:41:43.836 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:15.314 INFO:teuthology.orchestra.run.smithi081.stdout:generic/643 [not run] swapfiles are not supported 2024-03-18T05:45:15.317 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/643 2024-03-18T05:45:15.317 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/643 2024-03-18T05:45:15.317 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:15.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:15.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:15.339 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-18T05:45:15.517 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:15.521 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:15.521 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:15.522 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:15.522 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:15.946 INFO:teuthology.orchestra.run.smithi081.stdout:generic/644 [not run] vfstest not support by ceph 2024-03-18T05:45:15.950 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/644 2024-03-18T05:45:15.950 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/644 2024-03-18T05:45:15.950 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:15.952 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:15.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:15.968 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-18T05:45:16.147 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:16.151 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:16.151 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:16.152 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:16.152 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:16.356 INFO:teuthology.orchestra.run.smithi081.stdout:generic/645 [not run] vfstest not support by ceph 2024-03-18T05:45:16.360 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/645 2024-03-18T05:45:16.360 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/645 2024-03-18T05:45:16.360 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:16.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:16.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:16.377 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-18T05:45:16.555 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:16.559 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:16.559 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:16.560 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:16.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:16.853 INFO:teuthology.orchestra.run.smithi081.stdout:generic/646 [not run] ceph does not support shutdown 2024-03-18T05:45:16.863 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/646 2024-03-18T05:45:16.863 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/646 2024-03-18T05:45:16.863 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:16.865 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:16.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:16.880 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-18T05:45:17.065 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:17.069 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:17.069 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:17.070 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:17.071 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:17.565 INFO:teuthology.orchestra.run.smithi081.stdout:generic/647 0s 2024-03-18T05:45:17.572 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/647 2024-03-18T05:45:17.572 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:17.575 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:17.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:17.631 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-18T05:45:18.063 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:18.066 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:18.067 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:18.069 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:18.069 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:18.512 INFO:teuthology.orchestra.run.smithi081.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T05:45:18.518 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/648 2024-03-18T05:45:18.519 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/648 2024-03-18T05:45:18.519 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:18.521 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:18.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:18.802 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-18T05:45:18.996 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:19.000 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:19.000 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:19.001 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:19.001 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:19.274 INFO:teuthology.orchestra.run.smithi081.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T05:45:19.279 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/649 2024-03-18T05:45:19.279 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/649 2024-03-18T05:45:19.279 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T05:45:19.281 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:19.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T05:45:19.336 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-18T05:45:19.728 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T05:45:19.732 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T05:45:19.732 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T05:45:19.733 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T05:45:19.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T05:45:20.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:45:20.968 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:45:21.227 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T05:45:21.245+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51492) UID: 0 2024-03-18T05:45:21.227 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T05:45:21.246+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51492) UID: 0 2024-03-18T05:49:51.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:49:51.251 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:50:21.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:50:21.400 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:50:51.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:50:51.527 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:51:21.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:51:21.802 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:51:51.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:51:51.975 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:52:22.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:52:22.272 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:52:52.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:52:52.474 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:53:22.745 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:53:22.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:53:53.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:53:53.070 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:54:23.280 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:54:23.284 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:54:53.508 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:54:53.512 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:55:23.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:55:23.648 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:55:53.791 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:55:53.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:56:24.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:56:24.010 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:56:54.151 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:56:54.154 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:57:24.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:57:24.280 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T05:57:24.331 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T05:57:24.352+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51794) UID: 0 2024-03-18T05:57:24.331 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T05:57:24.352+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51794) UID: 0 2024-03-18T05:57:24.332 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T05:57:24.352+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51794) UID: 0 2024-03-18T05:57:24.336 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T05:57:24.352+0000 7f23e5f92640 -1 Fail to open '/proc/51794/cmdline' error = (2) No such file or directory 2024-03-18T05:57:24.336 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T05:57:24.352+0000 7f23e5f92640 -1 received signal: Hangup from (PID: 51794) UID: 0 2024-03-18T06:00:24.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:00:24.485 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:00:54.644 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:00:54.652 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:01:24.770 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:01:24.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:01:54.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:01:54.939 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:02:25.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:02:25.093 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:02:55.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:02:55.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:03:25.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:03:25.361 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:03:55.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:03:55.544 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:04:25.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:04:25.677 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:04:55.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:04:55.815 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:05:25.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:05:25.943 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:05:56.095 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:05:56.103 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:06:26.368 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:06:26.372 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:06:56.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:06:56.513 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:07:26.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:07:26.912 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:07:26.943 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T06:07:26.965+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52083) UID: 0 2024-03-18T06:07:26.943 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T06:07:26.965+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52083) UID: 0 2024-03-18T06:07:26.944 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T06:07:26.965+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52083) UID: 0 2024-03-18T06:07:26.944 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T06:07:26.965+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52083) UID: 0 2024-03-18T06:10:28.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:10:28.704 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:10:58.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:10:58.960 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:11:29.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:11:29.243 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:11:59.405 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:11:59.411 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:12:29.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:12:29.560 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:12:59.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:12:59.722 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:13:29.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:13:29.875 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:14:00.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:14:00.014 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:14:30.224 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:14:30.231 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:14:30.393 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T06:14:30.403+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 744346) UID: 0 2024-03-18T06:14:30.396 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T06:14:30.403+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 744346) UID: 0 2024-03-18T06:14:30.396 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T06:14:30.406+0000 7f7e89a01640 -1 Fail to open '/proc/744346/cmdline' error = (2) No such file or directory 2024-03-18T06:14:30.397 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T06:14:30.403+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 744346) UID: 0 2024-03-18T06:14:30.397 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T06:14:30.406+0000 7f7e89a01640 -1 received signal: Hangup from (PID: 744346) UID: 0 2024-03-18T06:18:18.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:18:18.413 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:18:48.687 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:18:48.691 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:19:18.861 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:19:18.864 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:19:48.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:19:48.978 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:20:19.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:20:19.098 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:20:49.360 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:20:49.366 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:21:19.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:21:19.637 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:21:49.765 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:21:49.769 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:21:49.820 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T06:21:49.821+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52426) UID: 0 2024-03-18T06:21:49.820 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T06:21:49.821+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52426) UID: 0 2024-03-18T06:24:09.232 INFO:teuthology.orchestra.run.smithi081.stdout:generic/650 2330s 2024-03-18T06:24:09.287 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/650 2024-03-18T06:24:09.288 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:09.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:09.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:09.360 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-18T06:24:09.929 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:09.946 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:09.947 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:09.949 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:09.950 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:10.901 INFO:teuthology.orchestra.run.smithi081.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:10.922 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/651 2024-03-18T06:24:10.923 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/651 2024-03-18T06:24:10.923 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:10.933 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:11.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:11.122 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-18T06:24:11.802 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:11.809 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:11.813 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:11.814 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:12.806 INFO:teuthology.orchestra.run.smithi081.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:12.823 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/652 2024-03-18T06:24:12.824 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/652 2024-03-18T06:24:12.824 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:12.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:13.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:13.036 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-18T06:24:13.830 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:13.841 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:13.845 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:13.846 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:13.846 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:14.806 INFO:teuthology.orchestra.run.smithi081.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/653 2024-03-18T06:24:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/653 2024-03-18T06:24:14.820 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:14.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:15.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:15.105 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-18T06:24:15.701 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:15.717 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:15.718 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:15.720 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:15.721 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:16.603 INFO:teuthology.orchestra.run.smithi081.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:16.620 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/654 2024-03-18T06:24:16.620 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/654 2024-03-18T06:24:16.620 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:16.638 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:17.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:17.070 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-18T06:24:17.682 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:17.688 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:17.689 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:17.689 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:17.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:18.549 INFO:teuthology.orchestra.run.smithi081.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:18.562 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/655 2024-03-18T06:24:18.562 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/655 2024-03-18T06:24:18.563 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:18.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:18.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:18.898 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-18T06:24:19.459 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:19.470 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:19.470 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:19.473 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:19.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:20.086 INFO:teuthology.orchestra.run.smithi081.stdout:generic/656 [not run] vfstest not support by ceph 2024-03-18T06:24:20.097 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/656 2024-03-18T06:24:20.098 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/656 2024-03-18T06:24:20.098 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:20.106 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:20.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:20.141 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-18T06:24:20.688 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:20.691 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:20.692 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:20.693 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:20.693 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:21.624 INFO:teuthology.orchestra.run.smithi081.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:21.642 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/657 2024-03-18T06:24:21.642 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/657 2024-03-18T06:24:21.643 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:21.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:22.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:22.094 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-18T06:24:22.609 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:22.618 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:22.620 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:22.622 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:22.622 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:23.598 INFO:teuthology.orchestra.run.smithi081.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:23.615 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/658 2024-03-18T06:24:23.620 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/658 2024-03-18T06:24:23.620 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:23.629 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:24.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:24.072 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-18T06:24:24.607 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:24.619 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:24.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:25.609 INFO:teuthology.orchestra.run.smithi081.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:25.617 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/659 2024-03-18T06:24:25.617 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/659 2024-03-18T06:24:25.617 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:25.621 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:26.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:26.002 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-18T06:24:26.566 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:26.570 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:26.571 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:26.574 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:26.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:27.468 INFO:teuthology.orchestra.run.smithi081.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:27.486 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/660 2024-03-18T06:24:27.487 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/660 2024-03-18T06:24:27.487 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:27.498 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:27.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:27.811 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-18T06:24:28.381 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:28.392 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:28.393 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:28.395 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:28.395 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:29.316 INFO:teuthology.orchestra.run.smithi081.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:29.332 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/661 2024-03-18T06:24:29.332 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/661 2024-03-18T06:24:29.332 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:29.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:29.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:29.672 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-18T06:24:30.249 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:30.261 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:30.262 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:30.266 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:30.266 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:31.092 INFO:teuthology.orchestra.run.smithi081.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:31.107 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/662 2024-03-18T06:24:31.108 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/662 2024-03-18T06:24:31.108 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:31.123 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:31.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:31.451 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-18T06:24:32.087 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:32.100 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:32.100 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:32.103 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:32.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:32.943 INFO:teuthology.orchestra.run.smithi081.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:32.957 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/663 2024-03-18T06:24:32.958 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/663 2024-03-18T06:24:32.958 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:32.967 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:33.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:33.290 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-18T06:24:33.912 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:33.919 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:33.919 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:33.921 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:33.921 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:34.778 INFO:teuthology.orchestra.run.smithi081.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:34.792 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/664 2024-03-18T06:24:34.792 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/664 2024-03-18T06:24:34.792 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:34.802 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:35.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:35.210 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-18T06:24:35.761 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:35.772 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:35.773 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:35.774 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:36.737 INFO:teuthology.orchestra.run.smithi081.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:36.751 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/665 2024-03-18T06:24:36.751 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/665 2024-03-18T06:24:36.752 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:36.765 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:37.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:37.170 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-18T06:24:37.786 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:37.796 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:37.797 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:37.800 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:37.800 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:38.722 INFO:teuthology.orchestra.run.smithi081.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:38.733 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/666 2024-03-18T06:24:38.733 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/666 2024-03-18T06:24:38.733 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:38.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:39.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:39.114 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-18T06:24:39.648 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:39.655 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:39.656 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:39.658 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:40.561 INFO:teuthology.orchestra.run.smithi081.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:40.568 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/667 2024-03-18T06:24:40.569 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/667 2024-03-18T06:24:40.569 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:40.581 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:41.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:41.007 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-18T06:24:41.569 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:41.583 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:41.583 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:41.584 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:41.584 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:42.528 INFO:teuthology.orchestra.run.smithi081.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:42.534 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/668 2024-03-18T06:24:42.535 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/668 2024-03-18T06:24:42.535 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:42.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:42.912 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-18T06:24:43.524 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:43.537 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:43.538 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:43.540 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:44.435 INFO:teuthology.orchestra.run.smithi081.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:44.449 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/669 2024-03-18T06:24:44.449 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/669 2024-03-18T06:24:44.450 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:44.465 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:44.742 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:44.742 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-18T06:24:45.310 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:45.314 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:45.316 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:45.318 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:45.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:46.274 INFO:teuthology.orchestra.run.smithi081.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:46.287 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/670 2024-03-18T06:24:46.288 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/670 2024-03-18T06:24:46.288 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:46.304 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:46.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:46.726 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-18T06:24:47.259 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:47.266 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:47.266 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:47.267 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:47.267 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:48.185 INFO:teuthology.orchestra.run.smithi081.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:48.199 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/671 2024-03-18T06:24:48.200 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/671 2024-03-18T06:24:48.200 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:48.210 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:48.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:48.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-18T06:24:49.159 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:49.171 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:49.172 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:49.178 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:49.178 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:50.048 INFO:teuthology.orchestra.run.smithi081.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:50.061 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/672 2024-03-18T06:24:50.062 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/672 2024-03-18T06:24:50.062 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:50.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:50.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:50.404 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-18T06:24:50.906 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:50.916 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:50.917 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:50.920 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:50.920 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:52.598 INFO:teuthology.orchestra.run.smithi081.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/673 2024-03-18T06:24:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/673 2024-03-18T06:24:52.612 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:52.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:53.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:53.078 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-18T06:24:53.641 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:53.656 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:53.657 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:53.659 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:53.659 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:54.569 INFO:teuthology.orchestra.run.smithi081.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T06:24:54.650 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/674 2024-03-18T06:24:54.650 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/674 2024-03-18T06:24:54.650 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:54.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:55.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:55.116 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-18T06:24:55.651 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:55.663 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:55.663 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:55.667 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:55.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:56.611 INFO:teuthology.orchestra.run.smithi081.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:24:56.628 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/675 2024-03-18T06:24:56.629 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/675 2024-03-18T06:24:56.629 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:24:56.643 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:24:57.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:24:57.013 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-18T06:24:57.551 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:24:57.563 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:24:57.565 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:24:57.568 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:24:57.568 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:26:03.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:26:03.753 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:26:03.828 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T06:26:03.825+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757860) UID: 0 2024-03-18T06:26:03.828 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T06:26:03.825+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757860) UID: 0 2024-03-18T06:26:03.828 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T06:26:03.825+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757860) UID: 0 2024-03-18T06:26:03.829 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T06:26:03.825+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 757860) UID: 0 2024-03-18T06:35:26.491 INFO:teuthology.orchestra.run.smithi081.stdout:generic/676 629s 2024-03-18T06:35:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/676 2024-03-18T06:35:26.518 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:26.524 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:26.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:26.627 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-18T06:35:27.973 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:27.986 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:27.987 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:27.991 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:27.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:28.694 INFO:teuthology.orchestra.run.smithi081.stdout:generic/677 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T06:35:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/677 2024-03-18T06:35:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/677 2024-03-18T06:35:28.706 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:28.714 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:28.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:28.763 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-18T06:35:29.278 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:29.285 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:29.286 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:29.287 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:29.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:30.036 INFO:teuthology.orchestra.run.smithi081.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-18T06:35:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/678 2024-03-18T06:35:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/678 2024-03-18T06:35:30.042 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:30.047 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:30.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:30.088 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-18T06:35:30.643 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:30.648 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:30.648 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:30.650 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:30.650 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:31.245 INFO:teuthology.orchestra.run.smithi081.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T06:35:31.250 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/679 2024-03-18T06:35:31.250 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/679 2024-03-18T06:35:31.250 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:31.255 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:31.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:31.309 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-18T06:35:31.796 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:31.808 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:31.809 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:31.812 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:31.812 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:33.810 INFO:teuthology.orchestra.run.smithi081.stdout:generic/680 1s 2024-03-18T06:35:33.830 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/680 2024-03-18T06:35:33.830 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:33.834 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:33.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:33.910 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-18T06:35:34.682 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:34.698 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:34.700 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:34.702 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:34.702 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:35.425 INFO:teuthology.orchestra.run.smithi081.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T06:35:35.433 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/681 2024-03-18T06:35:35.434 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/681 2024-03-18T06:35:35.434 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:35.436 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:35.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:35.471 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-18T06:35:35.972 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:35.981 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:35.983 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:35.986 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:36.666 INFO:teuthology.orchestra.run.smithi081.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T06:35:36.677 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/682 2024-03-18T06:35:36.678 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/682 2024-03-18T06:35:36.678 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:36.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:36.724 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-18T06:35:37.221 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:37.233 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:37.235 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:37.238 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:37.944 INFO:teuthology.orchestra.run.smithi081.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T06:35:37.948 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/683 2024-03-18T06:35:37.948 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/683 2024-03-18T06:35:37.948 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:37.952 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:37.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:37.987 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-18T06:35:38.598 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:38.611 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:38.613 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:38.617 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:44.069 INFO:teuthology.orchestra.run.smithi081.stdout:generic/684 - output mismatch (see /tmp/tmp.MYwjXdaX5wxfstests-dev/results//generic/684.out.bad) 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: --- tests/generic/684.out 2024-03-18 00:26:21.759060566 +0000 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: +++ /tmp/tmp.MYwjXdaX5wxfstests-dev/results//generic/684.out.bad 2024-03-18 06:35:44.039515020 +0000 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: @@ -1,7 +1,7 @@ 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: QA output created by 684 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: Test 1 - qa_user, non-exec file fpunch 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: +2666 -rw-rwSrw- TEST_DIR/684/a 2024-03-18T06:35:44.077 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: Test 2 - qa_user, group-exec file fpunch 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: @@ -9,7 +9,7 @@ 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: Test 3 - qa_user, user-exec file fpunch 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: +2766 -rwxrwSrw- TEST_DIR/684/a 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: Test 4 - qa_user, all-exec file fpunch 2024-03-18T06:35:44.078 INFO:teuthology.orchestra.run.smithi081.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2024-03-18T06:35:44.084 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/684 2024-03-18T06:35:44.084 INFO:teuthology.orchestra.run.smithi081.stdout:Failures: generic/684 2024-03-18T06:35:44.084 INFO:teuthology.orchestra.run.smithi081.stdout:Failed 1 of 1 tests 2024-03-18T06:35:44.090 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:44.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T06:35:44.165 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-18T06:35:44.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-18T06:35:44.166 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-18T06:35:44.942 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:44.958 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:44.960 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:44.963 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:44.963 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:45.775 INFO:teuthology.orchestra.run.smithi081.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T06:35:45.780 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/685 2024-03-18T06:35:45.781 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/685 2024-03-18T06:35:45.781 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:45.784 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:45.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:45.854 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-18T06:35:46.407 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:46.411 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:46.411 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:46.413 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:46.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:47.264 INFO:teuthology.orchestra.run.smithi081.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-18T06:35:47.278 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/686 2024-03-18T06:35:47.278 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/686 2024-03-18T06:35:47.278 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:47.286 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:47.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:47.354 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-18T06:35:47.882 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:47.886 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:47.886 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:47.889 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:47.889 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:48.707 INFO:teuthology.orchestra.run.smithi081.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T06:35:48.711 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/687 2024-03-18T06:35:48.711 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/687 2024-03-18T06:35:48.711 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:48.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:48.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:48.803 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-18T06:35:49.385 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:49.400 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:49.401 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:49.407 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:49.407 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:50.079 INFO:teuthology.orchestra.run.smithi081.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T06:35:50.087 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/688 2024-03-18T06:35:50.087 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/688 2024-03-18T06:35:50.087 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:50.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:50.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:50.164 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-18T06:35:50.710 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:50.723 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:50.724 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:50.727 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:50.727 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:51.404 INFO:teuthology.orchestra.run.smithi081.stdout:generic/689 [not run] vfstest not support by ceph 2024-03-18T06:35:51.411 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/689 2024-03-18T06:35:51.411 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/689 2024-03-18T06:35:51.411 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:51.413 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:51.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:51.454 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-18T06:35:52.020 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:52.031 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:52.033 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:52.035 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:52.036 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:52.746 INFO:teuthology.orchestra.run.smithi081.stdout:generic/690 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T06:35:52.758 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/690 2024-03-18T06:35:52.758 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/690 2024-03-18T06:35:52.758 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:52.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:52.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:52.834 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-18T06:35:53.386 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:53.394 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:53.395 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:53.403 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:53.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:54.127 INFO:teuthology.orchestra.run.smithi081.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T06:35:54.135 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/691 2024-03-18T06:35:54.135 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/691 2024-03-18T06:35:54.137 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:54.147 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:54.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:54.198 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-18T06:35:54.864 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:54.872 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:54.873 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:54.876 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:54.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:55.741 INFO:teuthology.orchestra.run.smithi081.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-03-18T06:35:55.754 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/692 2024-03-18T06:35:55.754 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/692 2024-03-18T06:35:55.754 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:55.761 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:55.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:55.797 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-18T06:35:56.446 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:56.458 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:56.460 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:56.467 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:56.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:57.509 INFO:teuthology.orchestra.run.smithi081.stdout:generic/693 [not run] kernel does not support ceph encryption 2024-03-18T06:35:57.552 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/693 2024-03-18T06:35:57.552 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/693 2024-03-18T06:35:57.552 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:35:57.560 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:35:57.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:35:57.598 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-18T06:35:58.132 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:35:58.145 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:35:58.147 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:35:58.158 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:35:58.158 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:11.624 INFO:teuthology.orchestra.run.smithi081.stdout:generic/694 13s 2024-03-18T06:36:11.641 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/694 2024-03-18T06:36:11.641 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:11.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:11.718 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-18T06:36:12.498 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:12.513 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:12.515 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:12.518 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:12.518 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:13.171 INFO:teuthology.orchestra.run.smithi081.stdout:generic/695 [not run] require 172.21.15.81:6789:/scratch to be valid block disk 2024-03-18T06:36:13.186 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/695 2024-03-18T06:36:13.186 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/695 2024-03-18T06:36:13.186 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:13.196 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:13.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:13.234 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-18T06:36:13.802 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:13.813 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:13.815 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:13.818 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:13.818 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:15.200 INFO:teuthology.orchestra.run.smithi081.stdout:generic/696 1s 2024-03-18T06:36:15.226 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/696 2024-03-18T06:36:15.226 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:15.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:15.855 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-18T06:36:16.702 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:16.709 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:16.712 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:16.713 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:16.713 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:17.709 INFO:teuthology.orchestra.run.smithi081.stdout:generic/697 1s 2024-03-18T06:36:17.730 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/697 2024-03-18T06:36:17.731 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:17.739 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:17.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:17.840 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-18T06:36:18.619 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:18.629 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:18.631 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:18.634 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:18.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:19.350 INFO:teuthology.orchestra.run.smithi081.stdout:generic/698 [not run] vfstest not support by ceph 2024-03-18T06:36:19.364 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/698 2024-03-18T06:36:19.364 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/698 2024-03-18T06:36:19.365 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:19.374 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:19.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:19.465 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-18T06:36:20.012 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:20.025 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:20.026 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:20.030 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:20.031 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:20.843 INFO:teuthology.orchestra.run.smithi081.stdout:generic/699 [not run] vfstest not support by ceph 2024-03-18T06:36:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/699 2024-03-18T06:36:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/699 2024-03-18T06:36:20.859 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:20.872 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:20.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:20.951 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-18T06:36:21.679 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:21.689 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:21.690 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:21.694 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:21.694 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:22.576 INFO:teuthology.orchestra.run.smithi081.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-03-18T06:36:22.584 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/700 2024-03-18T06:36:22.585 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/700 2024-03-18T06:36:22.585 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:22.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:22.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:22.693 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-18T06:36:23.590 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:23.602 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:23.603 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:23.606 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:23.606 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:37.256 INFO:teuthology.orchestra.run.smithi081.stdout:generic/701 14s 2024-03-18T06:36:37.287 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/701 2024-03-18T06:36:37.287 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:37.293 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:40.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:40.685 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-18T06:36:41.568 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:41.579 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:41.580 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:41.584 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:41.584 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:42.644 INFO:teuthology.orchestra.run.smithi081.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T06:36:42.667 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/702 2024-03-18T06:36:42.667 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/702 2024-03-18T06:36:42.667 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:43.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:43.312 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-18T06:36:43.933 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:43.947 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:43.948 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:43.951 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:43.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:44.801 INFO:teuthology.orchestra.run.smithi081.stdout:generic/703 [not run] kernel does not support IO_URING 2024-03-18T06:36:44.809 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/703 2024-03-18T06:36:44.809 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/703 2024-03-18T06:36:44.809 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:44.818 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:44.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:44.849 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-18T06:36:45.347 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:45.354 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:45.356 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:45.359 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:45.359 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:46.248 INFO:teuthology.orchestra.run.smithi081.stdout:generic/704 [not run] require 172.21.15.81:6789:/test to be valid block disk 2024-03-18T06:36:46.252 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/704 2024-03-18T06:36:46.252 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/704 2024-03-18T06:36:46.252 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:46.254 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:46.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:46.288 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-18T06:36:46.852 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:46.864 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:46.866 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:46.868 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:46.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:47.659 INFO:teuthology.orchestra.run.smithi081.stdout:generic/705 [not run] ceph does not support shutdown 2024-03-18T06:36:47.673 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/705 2024-03-18T06:36:47.673 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/705 2024-03-18T06:36:47.673 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:47.678 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:47.720 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:47.720 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-18T06:36:48.266 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:48.280 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:48.281 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:48.282 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:48.282 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:51.415 INFO:teuthology.orchestra.run.smithi081.stdout:generic/706 3s 2024-03-18T06:36:51.429 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/706 2024-03-18T06:36:51.429 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T06:36:51.436 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:36:51.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T06:36:51.513 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-18T06:36:52.363 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T06:36:52.372 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T06:36:52.372 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T06:36:52.379 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T06:36:52.379 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T06:38:51.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:38:51.521 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:38:51.797 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T06:38:51.788+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52475) UID: 0 2024-03-18T06:38:51.797 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T06:38:51.788+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52475) UID: 0 2024-03-18T06:51:48.373 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T06:51:48.367+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52490) UID: 0 2024-03-18T06:51:48.413 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T06:51:48.367+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52490) UID: 0 2024-03-18T06:51:48.413 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T06:51:48.367+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52490) UID: 0 2024-03-18T06:51:48.413 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T06:51:48.367+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52490) UID: 0 2024-03-18T06:58:44.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:58:44.522 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T06:58:44.761 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T06:58:44.756+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 839204) UID: 0 2024-03-18T06:58:44.762 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T06:58:44.756+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 839204) UID: 0 2024-03-18T06:58:44.762 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T06:58:44.756+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 839204) UID: 0 2024-03-18T06:58:44.762 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T06:58:44.756+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 839204) UID: 0 2024-03-18T06:58:45.460 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T06:58:45.455+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52515) UID: 0 2024-03-18T06:58:45.460 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T06:58:45.455+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52515) UID: 0 2024-03-18T07:02:32.391 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T07:02:32.386+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52547) UID: 0 2024-03-18T07:02:32.392 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T07:02:32.386+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52547) UID: 0 2024-03-18T07:02:32.392 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T07:02:32.386+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52547) UID: 0 2024-03-18T07:02:32.392 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T07:02:32.386+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52547) UID: 0 2024-03-18T07:07:28.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:07:28.748 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:07:59.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:07:59.108 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:08:29.226 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:08:29.230 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:08:59.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:08:59.355 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:09:29.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:09:29.482 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:09:59.574 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:09:59.579 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:10:16.917 INFO:teuthology.orchestra.run.smithi081.stdout:generic/707 2004s 2024-03-18T07:10:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/707 2024-03-18T07:10:16.974 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:16.977 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:17.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:17.017 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-03-18T07:10:17.833 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:17.850 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:17.852 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:17.855 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:17.855 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:21.224 INFO:teuthology.orchestra.run.smithi081.stdout:generic/708 1s 2024-03-18T07:10:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/708 2024-03-18T07:10:21.241 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:21.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:21.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:21.317 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-03-18T07:10:22.057 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:22.072 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:22.079 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:22.079 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:22.079 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:23.081 INFO:teuthology.orchestra.run.smithi081.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:23.092 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/709 2024-03-18T07:10:23.092 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/709 2024-03-18T07:10:23.092 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:23.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:23.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:23.156 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-03-18T07:10:23.852 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:23.862 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:23.862 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:23.864 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:23.864 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:24.481 INFO:teuthology.orchestra.run.smithi081.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:24.490 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/710 2024-03-18T07:10:24.490 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/710 2024-03-18T07:10:24.490 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:24.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:24.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:24.575 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-03-18T07:10:25.295 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:25.306 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:25.308 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:25.311 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:25.311 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:25.929 INFO:teuthology.orchestra.run.smithi081.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:25.936 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/711 2024-03-18T07:10:25.936 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/711 2024-03-18T07:10:25.936 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:25.941 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:25.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:25.999 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-03-18T07:10:26.765 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:26.773 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:26.775 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:26.778 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:26.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:27.409 INFO:teuthology.orchestra.run.smithi081.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:27.420 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/712 2024-03-18T07:10:27.420 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/712 2024-03-18T07:10:27.420 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:27.425 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:27.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:27.478 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-03-18T07:10:28.189 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:28.203 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:28.206 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:28.207 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:28.852 INFO:teuthology.orchestra.run.smithi081.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-18T07:10:28.856 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/713 2024-03-18T07:10:28.856 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/713 2024-03-18T07:10:28.856 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:28.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:28.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:28.914 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-03-18T07:10:29.639 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:29.645 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:29.646 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:29.647 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:29.647 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:29.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:10:29.743 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:10:30.302 INFO:teuthology.orchestra.run.smithi081.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:30.310 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/714 2024-03-18T07:10:30.310 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/714 2024-03-18T07:10:30.310 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:30.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:30.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:30.385 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-03-18T07:10:31.124 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:31.131 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:31.132 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:31.135 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:31.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:31.738 INFO:teuthology.orchestra.run.smithi081.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-18T07:10:31.746 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/715 2024-03-18T07:10:31.746 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/715 2024-03-18T07:10:31.746 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:31.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:31.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:31.838 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-03-18T07:10:32.476 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:32.483 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:32.487 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:32.488 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:32.488 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:33.170 INFO:teuthology.orchestra.run.smithi081.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:33.181 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/716 2024-03-18T07:10:33.182 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/716 2024-03-18T07:10:33.182 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:33.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:33.272 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-03-18T07:10:33.966 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:33.982 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:33.982 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:33.986 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:33.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:34.634 INFO:teuthology.orchestra.run.smithi081.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:34.638 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/717 2024-03-18T07:10:34.638 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/717 2024-03-18T07:10:34.638 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:34.640 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:34.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:34.730 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-03-18T07:10:35.436 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:35.446 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:35.447 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:35.450 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:35.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:36.095 INFO:teuthology.orchestra.run.smithi081.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:36.106 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/718 2024-03-18T07:10:36.106 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/718 2024-03-18T07:10:36.106 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:36.109 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:36.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:36.180 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-03-18T07:10:36.866 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:36.874 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:36.875 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:36.877 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:37.491 INFO:teuthology.orchestra.run.smithi081.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:37.502 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/719 2024-03-18T07:10:37.502 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/719 2024-03-18T07:10:37.502 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:37.505 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:37.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:37.574 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-03-18T07:10:38.262 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:38.273 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:38.275 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:38.278 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:38.279 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:38.854 INFO:teuthology.orchestra.run.smithi081.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/720 2024-03-18T07:10:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/720 2024-03-18T07:10:38.864 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:38.866 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:38.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:38.929 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-03-18T07:10:39.610 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:39.630 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:39.631 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:39.634 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:40.233 INFO:teuthology.orchestra.run.smithi081.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-03-18T07:10:40.241 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/721 2024-03-18T07:10:40.241 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/721 2024-03-18T07:10:40.241 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:40.244 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:40.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:40.291 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-03-18T07:10:40.753 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:40.762 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:40.763 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:40.764 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:40.764 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:41.400 INFO:teuthology.orchestra.run.smithi081.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T07:10:41.410 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/722 2024-03-18T07:10:41.410 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/722 2024-03-18T07:10:41.410 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:41.414 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:41.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:41.491 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-03-18T07:10:42.207 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:42.218 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:42.219 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:42.221 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:42.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:42.805 INFO:teuthology.orchestra.run.smithi081.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T07:10:42.814 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/723 2024-03-18T07:10:42.815 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/723 2024-03-18T07:10:42.815 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:42.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:42.906 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-03-18T07:10:43.653 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:43.664 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:43.666 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:43.669 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:43.669 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:44.268 INFO:teuthology.orchestra.run.smithi081.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T07:10:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/724 2024-03-18T07:10:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/724 2024-03-18T07:10:44.279 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:44.287 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:44.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:44.349 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-03-18T07:10:45.047 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:45.058 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:45.060 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:45.061 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:45.061 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:45.608 INFO:teuthology.orchestra.run.smithi081.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T07:10:45.613 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/725 2024-03-18T07:10:45.613 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/725 2024-03-18T07:10:45.613 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:45.620 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:45.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:45.689 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-03-18T07:10:46.484 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:46.499 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:46.500 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:46.503 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:46.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:47.622 INFO:teuthology.orchestra.run.smithi081.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T07:10:47.633 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/726 2024-03-18T07:10:47.633 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/726 2024-03-18T07:10:47.634 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:47.644 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:47.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:47.724 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-03-18T07:10:48.438 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:48.447 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:48.449 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:48.451 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:48.451 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:49.134 INFO:teuthology.orchestra.run.smithi081.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T07:10:49.143 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/727 2024-03-18T07:10:49.143 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/727 2024-03-18T07:10:49.143 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:49.153 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:49.239 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:49.240 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-03-18T07:10:49.997 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:50.004 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:50.005 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:50.006 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:50.007 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:54.899 INFO:teuthology.orchestra.run.smithi081.stdout:generic/728 4s 2024-03-18T07:10:54.916 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/728 2024-03-18T07:10:54.916 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:54.926 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:54.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:54.994 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-03-18T07:10:55.674 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:55.685 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:55.685 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:55.686 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:55.686 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:57.075 INFO:teuthology.orchestra.run.smithi081.stdout:generic/729 2s 2024-03-18T07:10:57.093 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/729 2024-03-18T07:10:57.093 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:57.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:57.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:57.174 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-03-18T07:10:57.884 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:57.899 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:57.900 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:57.903 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:58.488 INFO:teuthology.orchestra.run.smithi081.stdout:generic/730 [not run] require 172.21.15.81:6789:/test to be valid block disk 2024-03-18T07:10:58.500 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/730 2024-03-18T07:10:58.500 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/730 2024-03-18T07:10:58.501 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:58.512 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:58.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:58.542 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-03-18T07:10:58.995 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:10:59.010 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:10:59.011 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:10:59.014 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:10:59.014 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:59.521 INFO:teuthology.orchestra.run.smithi081.stdout:generic/731 [not run] require 172.21.15.81:6789:/test to be valid block disk 2024-03-18T07:10:59.525 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/731 2024-03-18T07:10:59.525 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/731 2024-03-18T07:10:59.526 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:10:59.531 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:10:59.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:10:59.551 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-03-18T07:10:59.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:10:59.848 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:10:59.886 INFO:tasks.ceph.osd.5.smithi136.stderr:2024-03-18T07:10:59.880+0000 7f5d43992640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52699) UID: 0 2024-03-18T07:10:59.886 INFO:tasks.ceph.osd.6.smithi136.stderr:2024-03-18T07:10:59.880+0000 7f5ae90b1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52699) UID: 0 2024-03-18T07:10:59.887 INFO:tasks.ceph.osd.4.smithi136.stderr:2024-03-18T07:10:59.880+0000 7f66ecb1e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52699) UID: 0 2024-03-18T07:10:59.887 INFO:tasks.ceph.osd.7.smithi136.stderr:2024-03-18T07:10:59.880+0000 7f23e5f92640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52699) UID: 0 2024-03-18T07:11:00.096 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:11:00.101 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:11:00.102 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:11:00.103 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:11:00.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:01.481 INFO:teuthology.orchestra.run.smithi081.stdout:generic/732 1s 2024-03-18T07:11:01.506 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/732 2024-03-18T07:11:01.507 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:11:01.514 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:01.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:11:01.553 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-03-18T07:11:02.135 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:11:02.142 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:11:02.143 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:11:02.146 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:11:02.146 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:03.097 INFO:teuthology.orchestra.run.smithi081.stdout:generic/733 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T07:11:03.118 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/733 2024-03-18T07:11:03.118 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/733 2024-03-18T07:11:03.119 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:11:03.131 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:03.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:11:03.308 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-03-18T07:11:03.931 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:11:03.940 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:11:03.941 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:11:03.944 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:11:03.944 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:04.501 INFO:teuthology.orchestra.run.smithi081.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T07:11:04.512 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/734 2024-03-18T07:11:04.512 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/734 2024-03-18T07:11:04.512 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:11:04.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:04.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:11:04.603 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-03-18T07:11:05.288 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:11:05.299 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:11:05.300 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:11:05.303 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:11:05.303 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:05.977 INFO:teuthology.orchestra.run.smithi081.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T07:11:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/735 2024-03-18T07:11:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/735 2024-03-18T07:11:05.981 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:11:05.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:11:06.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:11:06.060 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-03-18T07:11:06.755 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:11:06.771 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:11:06.772 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:11:06.776 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:11:06.776 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:15.781 INFO:teuthology.orchestra.run.smithi081.stdout:generic/736 189s 2024-03-18T07:14:15.793 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/736 2024-03-18T07:14:15.793 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:14:15.801 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:15.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:14:15.896 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-03-18T07:14:16.726 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:14:16.736 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:14:16.736 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:14:16.738 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:14:16.738 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:17.493 INFO:teuthology.orchestra.run.smithi081.stdout:generic/737 [not run] ceph does not support shutdown 2024-03-18T07:14:17.519 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/737 2024-03-18T07:14:17.519 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/737 2024-03-18T07:14:17.519 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:14:17.527 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:17.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:14:17.565 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-03-18T07:14:18.137 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:14:18.147 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:14:18.149 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:14:18.152 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:14:18.152 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:18.774 INFO:teuthology.orchestra.run.smithi081.stdout:generic/738 [not run] ceph does not support freezing 2024-03-18T07:14:18.787 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/738 2024-03-18T07:14:18.788 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/738 2024-03-18T07:14:18.788 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:14:18.793 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:18.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:14:18.828 DEBUG:teuthology.orchestra.run.smithi081:> (cd /tmp/tmp.MYwjXdaX5wxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-03-18T07:14:19.404 INFO:teuthology.orchestra.run.smithi081.stdout:FSTYP -- ceph 2024-03-18T07:14:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM -- Linux/x86_64 smithi081 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T07:14:19.418 INFO:teuthology.orchestra.run.smithi081.stdout:MKFS_OPTIONS -- 172.21.15.81:6789:/scratch 2024-03-18T07:14:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQC4ifdlmr8sLBAAAjFUO1LZKZkVL6BY6i59Yw== -o context=system_u:object_r:root_t:s0 172.21.15.81:6789:/scratch /tmp/tmp.PuVtZgZAHXscratch 2024-03-18T07:14:19.420 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:20.135 INFO:teuthology.orchestra.run.smithi081.stdout:generic/739 [not run] xfs_io set_encpolicy doesn't support -s 2024-03-18T07:14:20.149 INFO:teuthology.orchestra.run.smithi081.stdout:Ran: generic/739 2024-03-18T07:14:20.150 INFO:teuthology.orchestra.run.smithi081.stdout:Not run: generic/739 2024-03-18T07:14:20.150 INFO:teuthology.orchestra.run.smithi081.stdout:Passed all 1 tests 2024-03-18T07:14:20.157 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:20.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T07:14:20.182 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2024-03-18T07:14:20.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo userdel --force --remove fsgqa 2024-03-18T07:14:21.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo userdel --force --remove 123456-fsgqa 2024-03-18T07:14:21.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo groupdel fsgqa 2024-03-18T07:14:21.807 INFO:teuthology.orchestra.run.smithi081.stderr:groupdel: group 'fsgqa' does not exist 2024-03-18T07:14:21.811 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-03-18T07:14:21.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:21.812 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.MYwjXdaX5wxfstests-dev/results) 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: File: /tmp/tmp.MYwjXdaX5wxfstests-dev/results 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 801h/2049d Inode: 423446 Links: 3 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-03-18 00:28:08.047119767 +0000 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-03-18 07:14:15.784838700 +0000 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-03-18 07:14:15.784838700 +0000 2024-03-18T07:14:21.902 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-03-18 00:28:08.047119767 +0000 2024-03-18T07:14:21.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:21.906 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-03-18T07:14:21.963 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:14:21.972 DEBUG:teuthology.orchestra.run.smithi136:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T07:14:21.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:21.994 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.MYwjXdaX5wxfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-03-18T07:14:22.028 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-03-18T07:14:22.022+0000 7f7e89a01640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 888377) UID: 0 2024-03-18T07:14:22.028 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-03-18T07:14:22.022+0000 7fb304c13640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 888377) UID: 0 2024-03-18T07:14:22.029 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-03-18T07:14:22.022+0000 7f221bd57640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 888377) UID: 0 2024-03-18T07:14:22.029 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-03-18T07:14:22.022+0000 7f951d6d3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 888377) UID: 0 2024-03-18T07:14:23.192 INFO:tasks.ceph.mds.d.smithi136.stderr:2024-03-18T07:14:23.186+0000 7fe0329af640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52722) UID: 0 2024-03-18T07:14:23.192 INFO:tasks.ceph.mds.b.smithi136.stderr:2024-03-18T07:14:23.186+0000 7fce4875e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52722) UID: 0 2024-03-18T07:14:23.800 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.MYwjXdaX5wxfstests-dev to /var/log/ceph. 2024-03-18T07:14:23.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf /tmp/tmp.MYwjXdaX5wxfstests-dev 2024-03-18T07:14:24.240 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-18T07:14:24.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T07:14:24.428 DEBUG:teuthology.orchestra.run.smithi136:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T07:14:24.709 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-18T07:14:24.709 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T07:14:24.709 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T07:14:24.709 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:24.766 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T07:14:24.766 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:24.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T07:14:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.682+0000 7f2995a7a640 1 Processor -- start 2024-03-18T07:14:25.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.682+0000 7f2995a7a640 1 -- start start 2024-03-18T07:14:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.685+0000 7f2995a7a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f299015ad40 0x7f29900ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.685+0000 7f2995a7a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f29900b3400 0x7f29900d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f2995a7a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f299015ee60 con 0x7f29900b3860 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f2995a7a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f299015f140 con 0x7f299015ad40 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f298f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f299015ad40 0x7f29900ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f2995a7a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f299015f420 con 0x7f29900b3400 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f298f7fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f299015ad40 0x7f29900ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33130/0 (socket says 172.21.15.81:33130) 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f298f7fe640 1 -- 172.21.15.81:0/1561811154 learned_addr learned my addr 172.21.15.81:0/1561811154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:25.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f298ffff640 1 --1- 172.21.15.81:0/1561811154 >> v1:172.21.15.136:6789/0 conn(0x7f29900b3860 0x7f299006dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:32832/0 (socket says 172.21.15.81:32832) 2024-03-18T07:14:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.686+0000 7f298effd640 1 --2- 172.21.15.81:0/1561811154 >> v2:172.21.15.136:3300/0 conn(0x7f29900b3400 0x7f29900d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.687+0000 7f298f7fe640 1 -- 172.21.15.81:0/1561811154 >> v2:172.21.15.136:3300/0 conn(0x7f29900b3400 msgr2=0x7f29900d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.687+0000 7f298f7fe640 1 --2- 172.21.15.81:0/1561811154 >> v2:172.21.15.136:3300/0 conn(0x7f29900b3400 0x7f29900d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.687+0000 7f298f7fe640 1 -- 172.21.15.81:0/1561811154 >> v1:172.21.15.136:6789/0 conn(0x7f29900b3860 legacy=0x7f299006dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:25.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.687+0000 7f298f7fe640 1 -- 172.21.15.81:0/1561811154 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f299015f700 con 0x7f299015ad40 2024-03-18T07:14:25.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.689+0000 7f298f7fe640 1 --2- 172.21.15.81:0/1561811154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29900ad800 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f299009e0d0 tx=0x7f298002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33e08836e49c3d69 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:25.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.703+0000 7f298e7fc640 1 -- 172.21.15.81:0/1561811154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980035020 con 0x7f299015ad40 2024-03-18T07:14:25.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.705+0000 7f298e7fc640 1 -- 172.21.15.81:0/1561811154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2980031870 con 0x7f299015ad40 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.705+0000 7f298e7fc640 1 -- 172.21.15.81:0/1561811154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2980031c40 con 0x7f299015ad40 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.706+0000 7f2995a7a640 1 -- 172.21.15.81:0/1561811154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 msgr2=0x7f29900ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.706+0000 7f2995a7a640 1 --2- 172.21.15.81:0/1561811154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29900ad800 secure :-1 s=READY pgs=3221 cs=0 l=1 rev1=1 crypto rx=0x7f299009e0d0 tx=0x7f298002b910 comp rx=0 tx=0).stop 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.709+0000 7f2995a7a640 1 -- 172.21.15.81:0/1561811154 shutdown_connections 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.709+0000 7f2995a7a640 1 --2- 172.21.15.81:0/1561811154 >> v2:172.21.15.136:3300/0 conn(0x7f29900b3400 0x7f29900d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.709+0000 7f2995a7a640 1 --2- 172.21.15.81:0/1561811154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29900ad800 unknown :-1 s=CLOSED pgs=3221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:25.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.709+0000 7f2995a7a640 1 -- 172.21.15.81:0/1561811154 >> 172.21.15.81:0/1561811154 conn(0x7f299006b5e0 msgr2=0x7f299006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.712+0000 7f2995a7a640 1 -- 172.21.15.81:0/1561811154 shutdown_connections 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.712+0000 7f2995a7a640 1 -- 172.21.15.81:0/1561811154 wait complete. 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.717+0000 7f2995a7a640 1 Processor -- start 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.718+0000 7f2995a7a640 1 -- start start 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29900b3400 0x7f299015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29900b3860 0x7f29900b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f299015eb90 con 0x7f299015ad40 2024-03-18T07:14:25.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f299015ea10 con 0x7f29900b3400 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.720+0000 7f2995a7a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f29900d0620 con 0x7f29900b3860 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.721+0000 7f298ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.721+0000 7f298ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33144/0 (socket says 172.21.15.81:33144) 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.721+0000 7f298ffff640 1 -- 172.21.15.81:0/2040362650 learned_addr learned my addr 172.21.15.81:0/2040362650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298f7fe640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29900b3400 0x7f299015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298ffff640 1 -- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29900b3860 msgr2=0x7f29900b0c00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298ffff640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29900b3860 0x7f29900b0c00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298ffff640 1 -- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29900b3400 msgr2=0x7f299015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298ffff640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29900b3400 0x7f299015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.722+0000 7f298ffff640 1 -- 172.21.15.81:0/2040362650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29900afb60 con 0x7f299015ad40 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.723+0000 7f298ffff640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f298800c760 tx=0x7f298800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.724+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2988017070 con 0x7f299015ad40 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.724+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f298800a5e0 con 0x7f299015ad40 2024-03-18T07:14:25.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.724+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f298800a990 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.724+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29900afe40 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.724+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29900b0400 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.732+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f298801a070 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.734+0000 7f2977fff640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 0x7f297c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.734+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f2988056480 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.737+0000 7f298f7fe640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 0x7f297c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.730+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2990153b10 con 0x7f299015ad40 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.746+0000 7f298f7fe640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 0x7f297c06e0e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2980036000 tx=0x7f298003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:25.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:25.785+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2990153b10 con 0x7f299015ad40 2024-03-18T07:14:26.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.679+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f299004f5b0 con 0x7f299015ad40 2024-03-18T07:14:26.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.683+0000 7f2977fff640 1 -- 172.21.15.81:0/2040362650 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f29880583e0 con 0x7f299015ad40 2024-03-18T07:14:26.690 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:26.690 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:16.273398+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T07:14:26.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 msgr2=0x7f297c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 0x7f297c06e0e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f2980036000 tx=0x7f298003c040 comp rx=0 tx=0).stop 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 msgr2=0x7f29901516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 secure :-1 s=READY pgs=3222 cs=0 l=1 rev1=1 crypto rx=0x7f298800c760 tx=0x7f298800cc20 comp rx=0 tx=0).stop 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 shutdown_connections 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f297c06bc20 0x7f297c06e0e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f299015ad40 0x7f29901516d0 unknown :-1 s=CLOSED pgs=3222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f29900b3860 0x7f29900b0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:26.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 --2- 172.21.15.81:0/2040362650 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f29900b3400 0x7f299015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.688+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 >> 172.21.15.81:0/2040362650 conn(0x7f299006b5e0 msgr2=0x7f29900ad800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.689+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 shutdown_connections 2024-03-18T07:14:26.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:26.689+0000 7f2995a7a640 1 -- 172.21.15.81:0/2040362650 wait complete. 2024-03-18T07:14:26.734 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:26:12.474281+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:26:13.585729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T07:14:26.734 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T07:14:27.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.146+0000 7fac70dff640 1 Processor -- start 2024-03-18T07:14:27.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.146+0000 7fac70dff640 1 -- start start 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac70dff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac6c06b8d0 0x7fac6c166230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac70dff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c0cee00 0x7fac6c166770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac70dff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac6c162b50 con 0x7fac6c162770 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac70dff640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fac6c0d0570 con 0x7fac6c06b8d0 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac70dff640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c0ce970 con 0x7fac6c0cee00 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac69d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac6c06b8d0 0x7fac6c166230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac69d9b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fac6c06b8d0 0x7fac6c166230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33146/0 (socket says 172.21.15.81:33146) 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac69d9b640 1 -- 172.21.15.81:0/4228347570 learned_addr learned my addr 172.21.15.81:0/4228347570 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.150+0000 7fac6ad9d640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c0cee00 0x7fac6c166770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.151+0000 7fac69d9b640 1 -- 172.21.15.81:0/4228347570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c0cee00 msgr2=0x7fac6c166770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.151+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c0cee00 0x7fac6c166770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.151+0000 7fac69d9b640 1 -- 172.21.15.81:0/4228347570 >> v1:172.21.15.81:6789/0 conn(0x7fac6c162770 legacy=0x7fac6c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:27.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.151+0000 7fac69d9b640 1 -- 172.21.15.81:0/4228347570 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c0c4650 con 0x7fac6c06b8d0 2024-03-18T07:14:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.154+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c06b8d0 0x7fac6c166230 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7fac60009870 tx=0x7fac6002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265b45964afe8a00 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.154+0000 7fac6959a640 1 -- 172.21.15.81:0/4228347570 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60034070 con 0x7fac6c06b8d0 2024-03-18T07:14:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.155+0000 7fac6959a640 1 -- 172.21.15.81:0/4228347570 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac60030840 con 0x7fac6c06b8d0 2024-03-18T07:14:27.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.155+0000 7fac6959a640 1 -- 172.21.15.81:0/4228347570 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac60030c10 con 0x7fac6c06b8d0 2024-03-18T07:14:27.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 -- 172.21.15.81:0/4228347570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c06b8d0 msgr2=0x7fac6c166230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:27.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c06b8d0 0x7fac6c166230 secure :-1 s=READY pgs=3224 cs=0 l=1 rev1=1 crypto rx=0x7fac60009870 tx=0x7fac6002b980 comp rx=0 tx=0).stop 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 -- 172.21.15.81:0/4228347570 shutdown_connections 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c0cee00 0x7fac6c166770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 --2- 172.21.15.81:0/4228347570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c06b8d0 0x7fac6c166230 unknown :-1 s=CLOSED pgs=3224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 -- 172.21.15.81:0/4228347570 >> 172.21.15.81:0/4228347570 conn(0x7fac6c0d0da0 msgr2=0x7fac6c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 -- 172.21.15.81:0/4228347570 shutdown_connections 2024-03-18T07:14:27.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.157+0000 7fac70dff640 1 -- 172.21.15.81:0/4228347570 wait complete. 2024-03-18T07:14:27.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.159+0000 7fac70dff640 1 Processor -- start 2024-03-18T07:14:27.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.159+0000 7fac70dff640 1 -- start start 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 0x7fac6c0b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac6c162770 0x7fac6c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c072910 con 0x7fac6c0cee00 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fac6c0d07a0 con 0x7fac6c162770 2024-03-18T07:14:27.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac70dff640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fac6c0d0a40 con 0x7fac6c06b8d0 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.160+0000 7fac6a59c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:38566/0 (socket says 172.21.15.81:38566) 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 -- 172.21.15.81:0/4160949798 learned_addr learned my addr 172.21.15.81:0/4160949798 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6ad9d640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac6c162770 0x7fac6c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 0x7fac6c0b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 -- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac6c162770 msgr2=0x7fac6c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac6c162770 0x7fac6c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 -- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 msgr2=0x7fac6c0b6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 0x7fac6c0b6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac6a59c640 1 -- 172.21.15.81:0/4160949798 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac6c15b530 con 0x7fac6c06b8d0 2024-03-18T07:14:27.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.161+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 0x7fac6c0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac6a59c640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac6400c730 tx=0x7fac6400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64003b70 con 0x7fac6c06b8d0 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac64003d10 con 0x7fac6c06b8d0 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6400aa70 con 0x7fac6c06b8d0 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac6c15b7d0 con 0x7fac6c06b8d0 2024-03-18T07:14:27.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.162+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fac6c15bd90 con 0x7fac6c06b8d0 2024-03-18T07:14:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.164+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac6c04f540 con 0x7fac6c06b8d0 2024-03-18T07:14:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.167+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fac6400ac10 con 0x7fac6c06b8d0 2024-03-18T07:14:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.168+0000 7fac5affd640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 0x7fac4c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:27.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.168+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fac6408a830 con 0x7fac6c06b8d0 2024-03-18T07:14:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.168+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 0x7fac4c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.170+0000 7fac69d9b640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 0x7fac4c06e090 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fac60036000 tx=0x7fac6003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:27.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:27.176+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fac6c162b50 con 0x7fac6c06b8d0 2024-03-18T07:14:28.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.113+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fac6c0b39e0 con 0x7fac6c06b8d0 2024-03-18T07:14:28.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.114+0000 7fac5affd640 1 -- 172.21.15.81:0/4160949798 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fac640593b0 con 0x7fac6c06b8d0 2024-03-18T07:14:28.120 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T07:14:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.123+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 msgr2=0x7fac4c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.123+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 0x7fac4c06e090 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fac60036000 tx=0x7fac6003b040 comp rx=0 tx=0).stop 2024-03-18T07:14:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.123+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 msgr2=0x7fac6c15a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:28.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.123+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac6400c730 tx=0x7fac6400cbf0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 shutdown_connections 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fac6c162770 0x7fac6c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fac4c06bbd0 0x7fac4c06e090 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac6c0cee00 0x7fac6c0b6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 --2- 172.21.15.81:0/4160949798 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fac6c06b8d0 0x7fac6c15a360 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 >> 172.21.15.81:0/4160949798 conn(0x7fac6c0d0da0 msgr2=0x7fac6c1611b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 shutdown_connections 2024-03-18T07:14:28.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.129+0000 7fac70dff640 1 -- 172.21.15.81:0/4160949798 wait complete. 2024-03-18T07:14:28.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T07:14:28.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.369+0000 7fb448826640 1 Processor -- start 2024-03-18T07:14:28.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.370+0000 7fb448826640 1 -- start start 2024-03-18T07:14:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.373+0000 7fb448826640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb43c050120 0x7fb43c054510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.374+0000 7fb4437fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb43c050120 0x7fb43c054510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.374+0000 7fb4437fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fb43c050120 0x7fb43c054510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47286/0 (socket says 172.21.15.81:47286) 2024-03-18T07:14:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.374+0000 7fb442ffd640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fb43c054d80 0x7fb43c050500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:32846/0 (socket says 172.21.15.81:32846) 2024-03-18T07:14:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.374+0000 7fb4437fe640 1 -- 172.21.15.81:0/18237977 learned_addr learned my addr 172.21.15.81:0/18237977 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.375+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0076d0 con 0x7fb43c0387f0 2024-03-18T07:14:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.375+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0079b0 con 0x7fb43c054d80 2024-03-18T07:14:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.375+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fb43c007480 con 0x7fb43c050120 2024-03-18T07:14:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.375+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717052379 0 0) 0x7fb43c0076d0 con 0x7fb43c0387f0 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb434003520 con 0x7fb43c0387f0 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578240678 0 0) 0x7fb43c0079b0 con 0x7fb43c054d80 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb43c0076d0 con 0x7fb43c054d80 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4437fe640 1 -- 172.21.15.81:0/18237977 >> v1:172.21.15.136:6789/0 conn(0x7fb43c054d80 legacy=0x7fb43c050500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4437fe640 1 -- 172.21.15.81:0/18237977 >> v1:172.21.15.81:6789/0 conn(0x7fb43c0387f0 legacy=0x7fb43c038c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:28.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.376+0000 7fb4437fe640 1 -- 172.21.15.81:0/18237977 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c007c90 con 0x7fb43c050120 2024-03-18T07:14:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.379+0000 7fb4437fe640 1 --2- 172.21.15.81:0/18237977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c050120 0x7fb43c054510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb43800aa10 tx=0x7fb43802ce60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a1e0bd9ecf4e97 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.379+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43803a070 con 0x7fb43c050120 2024-03-18T07:14:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.380+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb43802dc10 con 0x7fb43c050120 2024-03-18T07:14:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.380+0000 7fb4427fc640 1 -- 172.21.15.81:0/18237977 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43800b040 con 0x7fb43c050120 2024-03-18T07:14:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.381+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c050120 msgr2=0x7fb43c054510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.381+0000 7fb448826640 1 --2- 172.21.15.81:0/18237977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c050120 0x7fb43c054510 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb43800aa10 tx=0x7fb43802ce60 comp rx=0 tx=0).stop 2024-03-18T07:14:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.381+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 shutdown_connections 2024-03-18T07:14:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.381+0000 7fb448826640 1 --2- 172.21.15.81:0/18237977 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c050120 0x7fb43c054510 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.381+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 >> 172.21.15.81:0/18237977 conn(0x7fb43c055350 msgr2=0x7fb43c055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.386+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 shutdown_connections 2024-03-18T07:14:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.386+0000 7fb448826640 1 -- 172.21.15.81:0/18237977 wait complete. 2024-03-18T07:14:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.388+0000 7fb448826640 1 Processor -- start 2024-03-18T07:14:28.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.388+0000 7fb448826640 1 -- start start 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb43c0387f0 0x7fb43c0db730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c050120 0x7fb43c038bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0dfa10 con 0x7fb43c050120 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb43c0df890 con 0x7fb43c054d80 2024-03-18T07:14:28.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.390+0000 7fb448826640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb43c0061e0 con 0x7fb43c0387f0 2024-03-18T07:14:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.392+0000 7fb443fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.392+0000 7fb443fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:47302/0 (socket says 172.21.15.81:47302) 2024-03-18T07:14:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.392+0000 7fb443fff640 1 -- 172.21.15.81:0/1474940538 learned_addr learned my addr 172.21.15.81:0/1474940538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.393+0000 7fb443fff640 1 -- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb43c0387f0 msgr2=0x7fb43c0db730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T07:14:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.393+0000 7fb443fff640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb43c0387f0 0x7fb43c0db730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.393+0000 7fb443fff640 1 -- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c050120 msgr2=0x7fb43c038bd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T07:14:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.393+0000 7fb443fff640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c050120 0x7fb43c038bd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.393+0000 7fb443fff640 1 -- 172.21.15.81:0/1474940538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c04b040 con 0x7fb43c054d80 2024-03-18T07:14:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.394+0000 7fb443fff640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb44406a750 tx=0x7fb444068d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.394+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4440733c0 con 0x7fb43c054d80 2024-03-18T07:14:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.395+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb444073560 con 0x7fb43c054d80 2024-03-18T07:14:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.397+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444071830 con 0x7fb43c054d80 2024-03-18T07:14:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.397+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c04b320 con 0x7fb43c054d80 2024-03-18T07:14:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.397+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43c04b8e0 con 0x7fb43c054d80 2024-03-18T07:14:28.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.398+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb43c009280 con 0x7fb43c054d80 2024-03-18T07:14:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.401+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb4440719d0 con 0x7fb43c054d80 2024-03-18T07:14:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.403+0000 7fb42ffff640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 0x7fb42806e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.404+0000 7fb4437fe640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 0x7fb42806e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.404+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb444106160 con 0x7fb43c054d80 2024-03-18T07:14:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.404+0000 7fb4437fe640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 0x7fb42806e190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb438037000 tx=0x7fb43800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:28.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:28.409+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb44408f030 con 0x7fb43c054d80 2024-03-18T07:14:29.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.322+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb43c054b60 con 0x7fb43c054d80 2024-03-18T07:14:29.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.323+0000 7fb42ffff640 1 -- 172.21.15.81:0/1474940538 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7fb4440d4c30 con 0x7fb43c054d80 2024-03-18T07:14:29.329 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.329+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 msgr2=0x7fb42806e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.329+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 0x7fb42806e190 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb438037000 tx=0x7fb43800c040 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.329+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 msgr2=0x7fb43c039110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.329+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb44406a750 tx=0x7fb444068d00 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 shutdown_connections 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb43c054d80 0x7fb43c039110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb42806bcd0 0x7fb42806e190 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb43c050120 0x7fb43c038bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 --2- 172.21.15.81:0/1474940538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb43c0387f0 0x7fb43c0db730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 >> 172.21.15.81:0/1474940538 conn(0x7fb43c055350 msgr2=0x7fb43c0dd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 shutdown_connections 2024-03-18T07:14:29.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.330+0000 7fb448826640 1 -- 172.21.15.81:0/1474940538 wait complete. 2024-03-18T07:14:29.351 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T07:14:29.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.546+0000 7f1f61735640 1 Processor -- start 2024-03-18T07:14:29.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.547+0000 7f1f61735640 1 -- start start 2024-03-18T07:14:29.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f61735640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f61735640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1f5c0d4980 0x7f1f5c0b6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f61735640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f5c0c7220 con 0x7f1f5c0d0d80 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f61735640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f1f5c0b57b0 con 0x7f1f5c0d4980 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f61735640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0cf740 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f5bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f5bfff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:38578/0 (socket says 172.21.15.81:38578) 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f5bfff640 1 -- 172.21.15.81:0/2577501050 learned_addr learned my addr 172.21.15.81:0/2577501050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.548+0000 7f1f5bfff640 1 -- 172.21.15.81:0/2577501050 >> v2:172.21.15.81:3300/0 conn(0x7f1f5c0d4980 msgr2=0x7f1f5c0b6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.549+0000 7f1f5bfff640 1 --2- 172.21.15.81:0/2577501050 >> v2:172.21.15.81:3300/0 conn(0x7f1f5c0d4980 0x7f1f5c0b6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.549+0000 7f1f5bfff640 1 -- 172.21.15.81:0/2577501050 >> v1:172.21.15.81:6789/0 conn(0x7f1f5c0d0d80 legacy=0x7f1f5c0b71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:29.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.549+0000 7f1f5bfff640 1 -- 172.21.15.81:0/2577501050 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c0b51f0 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.550+0000 7f1f5bfff640 1 --2- 172.21.15.81:0/2577501050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009870 tx=0x7f1f5002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9f9376f896b84ce server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.550+0000 7f1f5affd640 1 -- 172.21.15.81:0/2577501050 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50034070 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.550+0000 7f1f5affd640 1 -- 172.21.15.81:0/2577501050 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f50030840 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.550+0000 7f1f5affd640 1 -- 172.21.15.81:0/2577501050 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f50030c10 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.553+0000 7f1f61735640 1 -- 172.21.15.81:0/2577501050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 msgr2=0x7f1f5c0cfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:29.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.553+0000 7f1f61735640 1 --2- 172.21.15.81:0/2577501050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009870 tx=0x7f1f5002b980 comp rx=0 tx=0).stop 2024-03-18T07:14:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.559+0000 7f1f61735640 1 -- 172.21.15.81:0/2577501050 shutdown_connections 2024-03-18T07:14:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.559+0000 7f1f61735640 1 --2- 172.21.15.81:0/2577501050 >> v2:172.21.15.81:3300/0 conn(0x7f1f5c0d4980 0x7f1f5c0b6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.559+0000 7f1f61735640 1 --2- 172.21.15.81:0/2577501050 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c0cfbd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.559+0000 7f1f61735640 1 -- 172.21.15.81:0/2577501050 >> 172.21.15.81:0/2577501050 conn(0x7f1f5c0d3e60 msgr2=0x7f1f5c0d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:29.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.560+0000 7f1f61735640 1 -- 172.21.15.81:0/2577501050 shutdown_connections 2024-03-18T07:14:29.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.560+0000 7f1f61735640 1 -- 172.21.15.81:0/2577501050 wait complete. 2024-03-18T07:14:29.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.566+0000 7f1f61735640 1 Processor -- start 2024-03-18T07:14:29.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.570+0000 7f1f61735640 1 -- start start 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c15f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f5c0d0d80 0x7f1f5c071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b4d70 con 0x7f1f5c0d4980 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5c0b7900 con 0x7f1f5c0d0d80 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f61735640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f1f5c0c7490 con 0x7f1f5c0d09a0 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f60f34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f60f34640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33174/0 (socket says 172.21.15.81:33174) 2024-03-18T07:14:29.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.571+0000 7f1f60f34640 1 -- 172.21.15.81:0/544604643 learned_addr learned my addr 172.21.15.81:0/544604643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 -- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 msgr2=0x7f1f5c15f7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c15f7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 -- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f5c0d0d80 msgr2=0x7f1f5c071dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f5c0d0d80 0x7f1f5c071dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 -- 172.21.15.81:0/544604643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f5c072310 con 0x7f1f5c0d4980 2024-03-18T07:14:29.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.572+0000 7f1f60f34640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c7a0 tx=0x7f1f5400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.573+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f54003b70 con 0x7f1f5c0d4980 2024-03-18T07:14:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.573+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f54003d30 con 0x7f1f5c0d4980 2024-03-18T07:14:29.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.573+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f5400aa90 con 0x7f1f5c0d4980 2024-03-18T07:14:29.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.573+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f5c0c9e00 con 0x7f1f5c0d4980 2024-03-18T07:14:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.576+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f5c1f8450 con 0x7f1f5c0d4980 2024-03-18T07:14:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.577+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1f5400ac30 con 0x7f1f5c0d4980 2024-03-18T07:14:29.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.578+0000 7f1f58ff9640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 0x7f1f4806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.578+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f1f5408a980 con 0x7f1f5c0d4980 2024-03-18T07:14:29.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.580+0000 7f1f5bfff640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 0x7f1f4806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:29.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.581+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c005290 con 0x7f1f5c0d4980 2024-03-18T07:14:29.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.582+0000 7f1f5bfff640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 0x7f1f4806e160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1f50036000 tx=0x7f1f5003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:29.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:29.607+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1f54059450 con 0x7f1f5c0d4980 2024-03-18T07:14:30.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.530+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f1f3c005d90 con 0x7f1f5c0d4980 2024-03-18T07:14:30.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.531+0000 7f1f58ff9640 1 -- 172.21.15.81:0/544604643 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7f1f54058d50 con 0x7f1f5c0d4980 2024-03-18T07:14:30.537 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 msgr2=0x7f1f4806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 0x7f1f4806e160 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f1f50036000 tx=0x7f1f5003b040 comp rx=0 tx=0).stop 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 msgr2=0x7f1f5c0b5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 secure :-1 s=READY pgs=3227 cs=0 l=1 rev1=1 crypto rx=0x7f1f5400c7a0 tx=0x7f1f5400cc60 comp rx=0 tx=0).stop 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 shutdown_connections 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f1f4806bca0 0x7f1f4806e160 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f5c0d4980 0x7f1f5c0b5930 unknown :-1 s=CLOSED pgs=3227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1f5c0d0d80 0x7f1f5c071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 --2- 172.21.15.81:0/544604643 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1f5c0d09a0 0x7f1f5c15f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.540+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 >> 172.21.15.81:0/544604643 conn(0x7f1f5c0d3e60 msgr2=0x7f1f5c0b7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.544+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 shutdown_connections 2024-03-18T07:14:30.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.544+0000 7f1f61735640 1 -- 172.21.15.81:0/544604643 wait complete. 2024-03-18T07:14:30.587 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T07:14:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.957+0000 7f3e12b89640 1 Processor -- start 2024-03-18T07:14:30.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.957+0000 7f3e12b89640 1 -- start start 2024-03-18T07:14:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e12b89640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e0c15e5a0 0x7f3e0c0d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e12b89640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3e0c0d1e40 0x7f3e0c0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e12b89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0c0d3010 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e12b89640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3e0c0cff90 con 0x7f3e0c0d1e40 2024-03-18T07:14:30.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e12b89640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b34d0 con 0x7f3e0c15e5a0 2024-03-18T07:14:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e11126640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f3e0c0d2b80 0x7f3e0c0ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46712/0 (socket says 172.21.15.81:46712) 2024-03-18T07:14:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e11126640 1 -- 172.21.15.81:0/360783709 learned_addr learned my addr 172.21.15.81:0/360783709 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.958+0000 7f3e0bfff640 1 --2- 172.21.15.81:0/360783709 >> v2:172.21.15.81:3300/0 conn(0x7f3e0c0d1e40 0x7f3e0c0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1139124054 0 0) 0x7f3e0c0d3010 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3df8003520 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e10925640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e0c15e5a0 0x7f3e0c0d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1739092010 0 0) 0x7f3df8003520 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e0c15e5a0 msgr2=0x7f3e0c0d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3e0c15e5a0 0x7f3e0c0d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 >> v2:172.21.15.81:3300/0 conn(0x7f3e0c0d1e40 msgr2=0x7f3e0c0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/360783709 >> v2:172.21.15.81:3300/0 conn(0x7f3e0c0d1e40 0x7f3e0c0d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0d1200 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f3e04001670 con 0x7f3e0c0d2b80 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.959+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 >> v1:172.21.15.81:6789/0 conn(0x7f3e0c0d2b80 legacy=0x7f3e0c0ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df8003a20 0x7f3df8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df8004800 0x7f3df8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df80051c0 0x7f3df800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df80051c0 0x7f3df800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b34d0 con 0x7f3df80051c0 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3df800c0c0 con 0x7f3df8003a20 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3df800c2c0 con 0x7f3df8004800 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 -- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df8004800 msgr2=0x7f3df8004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df8004800 0x7f3df8004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 -- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df8003a20 msgr2=0x7f3df8003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3df8003a20 0x7f3df8003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.960+0000 7f3e11126640 1 -- 172.21.15.81:0/360783709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df8003520 con 0x7f3df80051c0 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.961+0000 7f3e11126640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df80051c0 0x7f3df800b9c0 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c580 tx=0x7f3df8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdce1917d476d5d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.961+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04007cc0 con 0x7f3df80051c0 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.961+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e04030070 con 0x7f3df80051c0 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.961+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/360783709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e040058d0 con 0x7f3df80051c0 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.962+0000 7f3e12b89640 1 -- 172.21.15.81:0/360783709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df80051c0 msgr2=0x7f3df800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.962+0000 7f3e12b89640 1 --2- 172.21.15.81:0/360783709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3df80051c0 0x7f3df800b9c0 secure :-1 s=READY pgs=3229 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400c580 tx=0x7f3df8005830 comp rx=0 tx=0).stop 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.962+0000 7f3e11126640 1 -- 172.21.15.81:0/360783709 reap_dead start 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.963+0000 7f3e12b89640 1 -- 172.21.15.81:0/360783709 shutdown_connections 2024-03-18T07:14:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.963+0000 7f3e12b89640 1 -- 172.21.15.81:0/360783709 >> 172.21.15.81:0/360783709 conn(0x7f3e0c0d4060 msgr2=0x7f3e0c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.964+0000 7f3e12b89640 1 -- 172.21.15.81:0/360783709 shutdown_connections 2024-03-18T07:14:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.964+0000 7f3e12b89640 1 -- 172.21.15.81:0/360783709 wait complete. 2024-03-18T07:14:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.965+0000 7f3e12b89640 1 Processor -- start 2024-03-18T07:14:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.965+0000 7f3e12b89640 1 -- start start 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 0x7f3e0c0c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 0x7f3e0c0b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b4c50 con 0x7f3e0c0c9d10 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c0d17c0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e12b89640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3e0c0b4dd0 con 0x7f3df80051c0 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33192/0 (socket says 172.21.15.81:33192) 2024-03-18T07:14:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e0bfff640 1 -- 172.21.15.81:0/794580913 learned_addr learned my addr 172.21.15.81:0/794580913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:30.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.967+0000 7f3e11126640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 0x7f3e0c0b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e10925640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 0x7f3e0c0c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e11126640 1 -- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 msgr2=0x7f3e0c0c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e11126640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 0x7f3e0c0c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e11126640 1 -- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 msgr2=0x7f3e0c0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e11126640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e11126640 1 -- 172.21.15.81:0/794580913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0b6d60 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e10925640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 0x7f3e0c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:30.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.968+0000 7f3e0bfff640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.969+0000 7f3e11126640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 0x7f3e0c0b7b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e04031000 tx=0x7f3e04001970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.969+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04001ba0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.969+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e040047e0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.969+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e04004bd0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.969+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c0b7040 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.970+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c0b7600 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.974+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c04f5b0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.975+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3e0403f030 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.976+0000 7f3e097fa640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 0x7f3dec06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.977+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f3e040ab1a0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.977+0000 7f3e10925640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 0x7f3dec06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:30.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.978+0000 7f3e10925640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 0x7f3dec06e0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006fd0 tx=0x7f3df4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:30.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:30.983+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3e040795a0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.028+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e0c0d08d0 con 0x7f3e0c0ca6d0 2024-03-18T07:14:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.029+0000 7f3e097fa640 1 -- 172.21.15.81:0/794580913 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v32) ==== 80+0+0 (secure 0 0 0) 0x7f3e0407d640 con 0x7f3e0c0ca6d0 2024-03-18T07:14:32.035 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 msgr2=0x7f3dec06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 0x7f3dec06e0c0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006fd0 tx=0x7f3df4008040 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 msgr2=0x7f3e0c0b7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 0x7f3e0c0b7b20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f3e04031000 tx=0x7f3e04001970 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 shutdown_connections 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3e0c0ca6d0 0x7f3e0c0b7b20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3dec06bc00 0x7f3dec06e0c0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e0c0c9d10 0x7f3e0c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 --2- 172.21.15.81:0/794580913 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3df80051c0 0x7f3e0c0c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.035+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 >> 172.21.15.81:0/794580913 conn(0x7f3e0c0d4060 msgr2=0x7f3e0c06caa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:32.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.036+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 shutdown_connections 2024-03-18T07:14:32.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.036+0000 7f3e12b89640 1 -- 172.21.15.81:0/794580913 wait complete. 2024-03-18T07:14:32.074 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-18T07:14:32.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:32.074 DEBUG:teuthology.orchestra.run.smithi081:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-18T07:14:32.162 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:14:32.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:32.162 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-18T07:14:32.236 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T07:14:32.237 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T07:14:32.237 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:32.314 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056362,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18685 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T07:14:32.315 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T07:14:32.315 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T07:14:32.315 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:32.357 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056371,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16637 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T07:14:32.357 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T07:14:32.358 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T07:14:32.358 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:32.377 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056362,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18685 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T07:14:32.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T07:14:32.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.596+0000 7fad02f22640 1 Processor -- start 2024-03-18T07:14:32.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.596+0000 7fad02f22640 1 -- start start 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad02f22640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad02f22640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facfc0d07f0 0x7facfc0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad02f22640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facfc0ad9e0 con 0x7facfc0aea80 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad02f22640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7facfc0ad790 con 0x7facfc0d07f0 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad02f22640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7facfc0adcc0 con 0x7facfc14bdf0 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad00cbe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad014bf640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7facfc0d07f0 0x7facfc0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad00cbe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:38598/0 (socket says 172.21.15.81:38598) 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.597+0000 7fad00cbe640 1 -- 172.21.15.81:0/2840791793 learned_addr learned my addr 172.21.15.81:0/2840791793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.598+0000 7fad014bf640 1 -- 172.21.15.81:0/2840791793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 msgr2=0x7facfc0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.598+0000 7fad014bf640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.598+0000 7fad014bf640 1 -- 172.21.15.81:0/2840791793 >> v1:172.21.15.136:6789/0 conn(0x7facfc0aea80 legacy=0x7facfc0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.598+0000 7fad014bf640 1 -- 172.21.15.81:0/2840791793 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc0adfa0 con 0x7facfc0d07f0 2024-03-18T07:14:32.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.598+0000 7fad00cbe640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:32.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.601+0000 7fad014bf640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc0b34e0 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7facf40097a0 tx=0x7facf402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fd369dac26ba16 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:32.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.601+0000 7facfb7fe640 1 -- 172.21.15.81:0/2840791793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf40315a0 con 0x7facfc0d07f0 2024-03-18T07:14:32.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.602+0000 7facfb7fe640 1 -- 172.21.15.81:0/2840791793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facf4037070 con 0x7facfc0d07f0 2024-03-18T07:14:32.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.602+0000 7facfb7fe640 1 -- 172.21.15.81:0/2840791793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4031960 con 0x7facfc0d07f0 2024-03-18T07:14:32.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.603+0000 7fad02f22640 1 -- 172.21.15.81:0/2840791793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 msgr2=0x7facfc0b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.603+0000 7fad02f22640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc0b34e0 secure :-1 s=READY pgs=3230 cs=0 l=1 rev1=1 crypto rx=0x7facf40097a0 tx=0x7facf402b840 comp rx=0 tx=0).stop 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 -- 172.21.15.81:0/2840791793 shutdown_connections 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc0b34e0 unknown :-1 s=CLOSED pgs=3230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 --2- 172.21.15.81:0/2840791793 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc14bdf0 0x7facfc0b2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 -- 172.21.15.81:0/2840791793 >> 172.21.15.81:0/2840791793 conn(0x7facfc06b5e0 msgr2=0x7facfc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 -- 172.21.15.81:0/2840791793 shutdown_connections 2024-03-18T07:14:32.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.604+0000 7fad02f22640 1 -- 172.21.15.81:0/2840791793 wait complete. 2024-03-18T07:14:32.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.609+0000 7fad02f22640 1 Processor -- start 2024-03-18T07:14:32.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.609+0000 7fad02f22640 1 -- start start 2024-03-18T07:14:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.612+0000 7fad02f22640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.612+0000 7fad02f22640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc164990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad02f22640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facfc14bdf0 0x7facfc164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7facfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc164990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:38608/0 (socket says 172.21.15.81:38608) 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7facfbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc164990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33212/0 (socket says 172.21.15.81:33212) 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7facfbfff640 1 -- 172.21.15.81:0/988479484 learned_addr learned my addr 172.21.15.81:0/988479484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7facfc14c1d0 con 0x7facfc0d07f0 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7facfc0ae560 con 0x7facfc14bdf0 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7facfc14c350 con 0x7facfc0aea80 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad014bf640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facfc14bdf0 0x7facfc164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 -- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facfc14bdf0 msgr2=0x7facfc164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facfc14bdf0 0x7facfc164ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 -- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 msgr2=0x7facfc164990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.613+0000 7fad00cbe640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc164990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.614+0000 7fad00cbe640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facfc1f9b20 con 0x7facfc0aea80 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.614+0000 7fad00cbe640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facec00efb0 tx=0x7facec00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.614+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec00cda0 con 0x7facfc0aea80 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.615+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7facec003990 con 0x7facfc0aea80 2024-03-18T07:14:32.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.615+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facec003d60 con 0x7facfc0aea80 2024-03-18T07:14:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.615+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facfc163ab0 con 0x7facfc0aea80 2024-03-18T07:14:32.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.615+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7facfc164350 con 0x7facfc0aea80 2024-03-18T07:14:32.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.618+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facfc1f8610 con 0x7facfc0aea80 2024-03-18T07:14:32.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.619+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7facec005d10 con 0x7facfc0aea80 2024-03-18T07:14:32.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.620+0000 7facf97fa640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 0x7facdc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:32.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.620+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7facec08af60 con 0x7facfc0aea80 2024-03-18T07:14:32.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.621+0000 7facfbfff640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 0x7facdc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:32.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.623+0000 7facfbfff640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 0x7facdc06e090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7facfc146db0 tx=0x7face4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:32.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:32.628+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7facec022020 con 0x7facfc0aea80 2024-03-18T07:14:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.709+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7facfc163c80 con 0x7facfc0aea80 2024-03-18T07:14:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.711+0000 7facf97fa640 1 -- 172.21.15.81:0/988479484 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7facec010040 con 0x7facfc0aea80 2024-03-18T07:14:33.719 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:33.719 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T07:14:33.719 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T07:14:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 msgr2=0x7facdc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 0x7facdc06e090 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7facfc146db0 tx=0x7face4009040 comp rx=0 tx=0).stop 2024-03-18T07:14:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 msgr2=0x7facfc09c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:33.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facec00efb0 tx=0x7facec00c490 comp rx=0 tx=0).stop 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 shutdown_connections 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7facfc14bdf0 0x7facfc164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.719+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7facdc06bbd0 0x7facdc06e090 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.720+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facfc0d07f0 0x7facfc164990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.720+0000 7fad02f22640 1 --2- 172.21.15.81:0/988479484 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7facfc0aea80 0x7facfc09c530 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.720+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 >> 172.21.15.81:0/988479484 conn(0x7facfc06b5e0 msgr2=0x7facfc0b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.720+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 shutdown_connections 2024-03-18T07:14:33.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:33.720+0000 7fad02f22640 1 -- 172.21.15.81:0/988479484 wait complete. 2024-03-18T07:14:33.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T07:14:34.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.108+0000 7f127fd1b640 1 Processor -- start 2024-03-18T07:14:34.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.109+0000 7f127fd1b640 1 -- start start 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.112+0000 7f127fd1b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f127815ad80 0x7f12780cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.113+0000 7f127fd1b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12780cf700 con 0x7f127815ea30 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.113+0000 7f127fd1b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12780cf9e0 con 0x7f12780cd7a0 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.113+0000 7f127fd1b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f12780cbf40 con 0x7f127815ad80 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.113+0000 7f127d2b6640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f127815ea30 0x7f12780cee20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46718/0 (socket says 172.21.15.81:46718) 2024-03-18T07:14:34.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.113+0000 7f127d2b6640 1 -- 172.21.15.81:0/1847602242 learned_addr learned my addr 172.21.15.81:0/1847602242 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:34.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.114+0000 7f127dab7640 1 --2- 172.21.15.81:0/1847602242 >> v2:172.21.15.136:3300/0 conn(0x7f127815ad80 0x7f12780cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.115+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882369135 0 0) 0x7f12780cf700 con 0x7f127815ea30 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1264003520 con 0x7f127815ea30 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 65540859 0 0) 0x7f12780cf9e0 con 0x7f12780cd7a0 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12780cf700 con 0x7f12780cd7a0 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127dab7640 1 -- 172.21.15.81:0/1847602242 >> v1:172.21.15.136:6789/0 conn(0x7f12780cd7a0 legacy=0x7f127806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127dab7640 1 -- 172.21.15.81:0/1847602242 >> v1:172.21.15.81:6789/0 conn(0x7f127815ea30 legacy=0x7f12780cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:34.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.116+0000 7f127dab7640 1 -- 172.21.15.81:0/1847602242 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12780cfcc0 con 0x7f127815ad80 2024-03-18T07:14:34.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.119+0000 7f127dab7640 1 --2- 172.21.15.81:0/1847602242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f127815ad80 0x7f12780cba00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12740097a0 tx=0x7f127402dae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46dc4705340565ba server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.120+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127402f8a0 con 0x7f127815ad80 2024-03-18T07:14:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.120+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127402fa40 con 0x7f127815ad80 2024-03-18T07:14:34.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.120+0000 7f127cab5640 1 -- 172.21.15.81:0/1847602242 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f127402fe10 con 0x7f127815ad80 2024-03-18T07:14:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.122+0000 7f127fd1b640 1 -- 172.21.15.81:0/1847602242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f127815ad80 msgr2=0x7f12780cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.122+0000 7f127fd1b640 1 --2- 172.21.15.81:0/1847602242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f127815ad80 0x7f12780cba00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f12740097a0 tx=0x7f127402dae0 comp rx=0 tx=0).stop 2024-03-18T07:14:34.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.122+0000 7f127fd1b640 1 -- 172.21.15.81:0/1847602242 shutdown_connections 2024-03-18T07:14:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.122+0000 7f127fd1b640 1 --2- 172.21.15.81:0/1847602242 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f127815ad80 0x7f12780cba00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.122+0000 7f127fd1b640 1 -- 172.21.15.81:0/1847602242 >> 172.21.15.81:0/1847602242 conn(0x7f12780b2a40 msgr2=0x7f12780b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.123+0000 7f127fd1b640 1 -- 172.21.15.81:0/1847602242 shutdown_connections 2024-03-18T07:14:34.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.123+0000 7f127fd1b640 1 -- 172.21.15.81:0/1847602242 wait complete. 2024-03-18T07:14:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.127+0000 7f127fd1b640 1 Processor -- start 2024-03-18T07:14:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.127+0000 7f127fd1b640 1 -- start start 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.131+0000 7f127fd1b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12780cd7a0 0x7f12780afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.131+0000 7f127fd1b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.131+0000 7f127fd1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 0x7f127815b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.132+0000 7f127fd1b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f127815b160 con 0x7f127815ea30 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.132+0000 7f127fd1b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f127806eb20 con 0x7f12780cd7a0 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.132+0000 7f127fd1b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f12780cdc30 con 0x7f127815ad80 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.133+0000 7f127d2b6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.133+0000 7f127d2b6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:38612/0 (socket says 172.21.15.81:38612) 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.133+0000 7f127d2b6640 1 -- 172.21.15.81:0/2288011759 learned_addr learned my addr 172.21.15.81:0/2288011759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:34.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.133+0000 7f127dab7640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12780cd7a0 0x7f12780afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.134+0000 7f127e2b8640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 0x7f127815b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.134+0000 7f127d2b6640 1 -- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12780cd7a0 msgr2=0x7f12780afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.134+0000 7f127d2b6640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12780cd7a0 0x7f12780afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.134+0000 7f127d2b6640 1 -- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 msgr2=0x7f127815b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.135+0000 7f127d2b6640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 0x7f127815b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.135+0000 7f127d2b6640 1 -- 172.21.15.81:0/2288011759 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127815bb30 con 0x7f127815ad80 2024-03-18T07:14:34.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.135+0000 7f127e2b8640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 0x7f127815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:34.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.135+0000 7f127d2b6640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f126800c410 tx=0x7f126800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.135+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12680074e0 con 0x7f127815ad80 2024-03-18T07:14:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.136+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12680047e0 con 0x7f127815ad80 2024-03-18T07:14:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.136+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1268004bd0 con 0x7f127815ad80 2024-03-18T07:14:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.136+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127815be10 con 0x7f127815ad80 2024-03-18T07:14:34.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.136+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f127815c3d0 con 0x7f127815ad80 2024-03-18T07:14:34.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.137+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127804f5b0 con 0x7f127815ad80 2024-03-18T07:14:34.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.138+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1268011070 con 0x7f127815ad80 2024-03-18T07:14:34.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.140+0000 7f126e7fc640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.140+0000 7f127dab7640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.140+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f126808ad70 con 0x7f127815ad80 2024-03-18T07:14:34.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.141+0000 7f127dab7640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 0x7f125c06e090 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1274038000 tx=0x7f127403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:34.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:34.146+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1268059840 con 0x7f127815ad80 2024-03-18T07:14:35.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.107+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f127806e0d0 con 0x7f127815ad80 2024-03-18T07:14:35.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.109+0000 7f126e7fc640 1 -- 172.21.15.81:0/2288011759 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f126805f020 con 0x7f127815ad80 2024-03-18T07:14:35.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:35.116 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:16.273398+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T07:14:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.117+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 msgr2=0x7f125c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.117+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 0x7f125c06e090 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1274038000 tx=0x7f127403b040 comp rx=0 tx=0).stop 2024-03-18T07:14:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.118+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 msgr2=0x7f1278149490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.118+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f126800c410 tx=0x7f126800c8d0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 shutdown_connections 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f125c06bbd0 0x7f125c06e090 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127815ea30 0x7f127815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f127815ad80 0x7f1278149490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 --2- 172.21.15.81:0/2288011759 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f12780cd7a0 0x7f12780afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 >> 172.21.15.81:0/2288011759 conn(0x7f12780b2a40 msgr2=0x7f12780b09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 shutdown_connections 2024-03-18T07:14:35.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.124+0000 7f127fd1b640 1 -- 172.21.15.81:0/2288011759 wait complete. 2024-03-18T07:14:35.168 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T00:25:11.399670+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T00:26:12.474281+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T00:26:13.585729+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T07:14:35.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T07:14:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.353+0000 7fb41dfb7640 1 Processor -- start 2024-03-18T07:14:35.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.354+0000 7fb41dfb7640 1 -- start start 2024-03-18T07:14:35.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.357+0000 7fb41dfb7640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 0x7fb410054510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.357+0000 7fb41cfb5640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb410050120 0x7fb410050500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:46726/0 (socket says 172.21.15.81:46726) 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41cfb5640 1 -- 172.21.15.81:0/227004023 learned_addr learned my addr 172.21.15.81:0/227004023 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb417fff640 1 --2- 172.21.15.81:0/227004023 >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 0x7fb410054510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 0x7fb410038c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4100076d0 con 0x7fb410050120 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fb410007480 con 0x7fb410054d80 2024-03-18T07:14:35.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb4100079b0 con 0x7fb4100387f0 2024-03-18T07:14:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.358+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 0x7fb410038c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb4177fe640 1 -- 172.21.15.81:0/227004023 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3250641058 0 0) 0x7fb4100076d0 con 0x7fb410050120 2024-03-18T07:14:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb4177fe640 1 -- 172.21.15.81:0/227004023 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb408003520 con 0x7fb410050120 2024-03-18T07:14:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb41d7b6640 1 -- 172.21.15.81:0/227004023 >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 msgr2=0x7fb410054510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:35.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/227004023 >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 0x7fb410054510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb41d7b6640 1 -- 172.21.15.81:0/227004023 >> v1:172.21.15.81:6789/0 conn(0x7fb410050120 legacy=0x7fb410050500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb41d7b6640 1 -- 172.21.15.81:0/227004023 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb410007c90 con 0x7fb4100387f0 2024-03-18T07:14:35.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.359+0000 7fb417fff640 1 --2- 172.21.15.81:0/227004023 >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 0x7fb410054510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:35.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.374+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 0x7fb410038c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb418069fe0 tx=0x7fb418069cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9830f14889a0401c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:35.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.375+0000 7fb4177fe640 1 -- 172.21.15.81:0/227004023 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180ac5d0 con 0x7fb4100387f0 2024-03-18T07:14:35.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.375+0000 7fb4177fe640 1 -- 172.21.15.81:0/227004023 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4180ac7b0 con 0x7fb4100387f0 2024-03-18T07:14:35.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.375+0000 7fb4177fe640 1 -- 172.21.15.81:0/227004023 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180acc40 con 0x7fb4100387f0 2024-03-18T07:14:35.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.377+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 msgr2=0x7fb410038c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.377+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 0x7fb410038c40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb418069fe0 tx=0x7fb418069cc0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.379+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 shutdown_connections 2024-03-18T07:14:35.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.379+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/227004023 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb4100387f0 0x7fb410038c40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.379+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/227004023 >> v2:172.21.15.81:3300/0 conn(0x7fb410054d80 0x7fb410054510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.379+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 >> 172.21.15.81:0/227004023 conn(0x7fb410055350 msgr2=0x7fb410055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:35.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.383+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 shutdown_connections 2024-03-18T07:14:35.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.383+0000 7fb41dfb7640 1 -- 172.21.15.81:0/227004023 wait complete. 2024-03-18T07:14:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.388+0000 7fb41dfb7640 1 Processor -- start 2024-03-18T07:14:35.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.388+0000 7fb41dfb7640 1 -- start start 2024-03-18T07:14:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 0x7fb4101712f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb410050120 0x7fb410170490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4100dfa10 con 0x7fb410054d80 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fb4100df890 con 0x7fb4100387f0 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41dfb7640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fb4100061e0 con 0x7fb410050120 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41d7b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41d7b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33248/0 (socket says 172.21.15.81:33248) 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.390+0000 7fb41d7b6640 1 -- 172.21.15.81:0/296429704 learned_addr learned my addr 172.21.15.81:0/296429704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:35.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41cfb5640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 0x7fb4101712f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 -- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb410050120 msgr2=0x7fb410170490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb410050120 0x7fb410170490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 -- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 msgr2=0x7fb4101712f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:35.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 0x7fb4101712f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 -- 172.21.15.81:0/296429704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb410172fa0 con 0x7fb410054d80 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41cfb5640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 0x7fb4101712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.391+0000 7fb41d7b6640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7fb41807add0 tx=0x7fb418073ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.392+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180aec80 con 0x7fb410054d80 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.392+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4180aee20 con 0x7fb410054d80 2024-03-18T07:14:35.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.392+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb410171830 con 0x7fb410054d80 2024-03-18T07:14:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.393+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb410035c70 con 0x7fb410054d80 2024-03-18T07:14:35.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.393+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180c2610 con 0x7fb410054d80 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.394+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb4180c0020 con 0x7fb410054d80 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.395+0000 7fb4157fa640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 0x7fb3fc06e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.395+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fb4181289d0 con 0x7fb410054d80 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.395+0000 7fb41cfb5640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 0x7fb3fc06e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.395+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f8005290 con 0x7fb410054d80 2024-03-18T07:14:35.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.396+0000 7fb41cfb5640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 0x7fb3fc06e190 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0011e0 tx=0x7fb40c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:35.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:35.403+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb410172fa0 con 0x7fb410054d80 2024-03-18T07:14:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.403+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb3f8005d90 con 0x7fb410054d80 2024-03-18T07:14:36.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.404+0000 7fb4157fa640 1 -- 172.21.15.81:0/296429704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v32) ==== 93+0+10 (secure 0 0 0) 0x7fb4180f75c0 con 0x7fb410054d80 2024-03-18T07:14:36.410 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-03-18T07:14:36.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.408+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 msgr2=0x7fb3fc06e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.408+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 0x7fb3fc06e190 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fb40c0011e0 tx=0x7fb40c009040 comp rx=0 tx=0).stop 2024-03-18T07:14:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.409+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 msgr2=0x7fb4101709d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.409+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 secure :-1 s=READY pgs=3233 cs=0 l=1 rev1=1 crypto rx=0x7fb41807add0 tx=0x7fb418073ae0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 shutdown_connections 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fb3fc06bcd0 0x7fb3fc06e190 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410054d80 0x7fb4101709d0 unknown :-1 s=CLOSED pgs=3233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fb410050120 0x7fb410170490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 --2- 172.21.15.81:0/296429704 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fb4100387f0 0x7fb4101712f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 >> 172.21.15.81:0/296429704 conn(0x7fb410055350 msgr2=0x7fb41003ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 shutdown_connections 2024-03-18T07:14:36.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.410+0000 7fb41dfb7640 1 -- 172.21.15.81:0/296429704 wait complete. 2024-03-18T07:14:36.437 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T07:14:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.832+0000 7f357f660640 1 Processor -- start 2024-03-18T07:14:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.832+0000 7f357f660640 1 -- start start 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357f660640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f357815eaa0 0x7f35780c8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357f660640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35780d02f0 con 0x7f357815e6c0 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357f660640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35780d4c10 con 0x7f35780d10d0 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357f660640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f35780d4ef0 con 0x7f357815eaa0 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357cbfb640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f35780d10d0 0x7f35780c7c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:52608/0 (socket says 172.21.15.81:52608) 2024-03-18T07:14:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.833+0000 7f357cbfb640 1 -- 172.21.15.81:0/2260007435 learned_addr learned my addr 172.21.15.81:0/2260007435 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468195610 0 0) 0x7f35780d4c10 con 0x7f35780d10d0 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3564003520 con 0x7f35780d10d0 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1665492228 0 0) 0x7f3564003520 con 0x7f35780d10d0 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 >> v2:172.21.15.81:3300/0 conn(0x7f357815eaa0 msgr2=0x7f35780c8350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 --2- 172.21.15.81:0/2260007435 >> v2:172.21.15.81:3300/0 conn(0x7f357815eaa0 0x7f35780c8350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 >> v1:172.21.15.81:6789/0 conn(0x7f357815e6c0 legacy=0x7f35780d09c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780cfaf0 con 0x7f35780d10d0 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7f3574001670 con 0x7f35780d10d0 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 >> v1:172.21.15.136:6789/0 conn(0x7f35780d10d0 legacy=0x7f35780c7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35640039b0 0x7f3564003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 0x7f3564004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35640053c0 0x7f356400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35780d4ef0 con 0x7f35640053c0 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f356400c260 con 0x7f3564004800 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f356400c460 con 0x7f35640039b0 2024-03-18T07:14:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.834+0000 7f357cbfb640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 0x7f3564004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357cbfb640 1 -- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35640039b0 msgr2=0x7f3564003db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357cbfb640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f35640039b0 0x7f3564003db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357cbfb640 1 -- 172.21.15.81:0/2260007435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35640053c0 msgr2=0x7f356400b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357cbfb640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35640053c0 0x7f356400b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357cbfb640 1 -- 172.21.15.81:0/2260007435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3564003520 con 0x7f3564004800 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.835+0000 7f357dbfd640 1 -- 172.21.15.81:0/2260007435 reap_dead start 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.836+0000 7f357cbfb640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 0x7f3564004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f357400c240 tx=0x7f3564005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f3e58e32faba69 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.836+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574007d60 con 0x7f3564004800 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.836+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574030070 con 0x7f3564004800 2024-03-18T07:14:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.836+0000 7f356ffff640 1 -- 172.21.15.81:0/2260007435 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357402ce00 con 0x7f3564004800 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.837+0000 7f357f660640 1 -- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 msgr2=0x7f3564004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.837+0000 7f357f660640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 0x7f3564004c80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f357400c240 tx=0x7f3564005830 comp rx=0 tx=0).stop 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.838+0000 7f357f660640 1 -- 172.21.15.81:0/2260007435 shutdown_connections 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.838+0000 7f357f660640 1 --2- 172.21.15.81:0/2260007435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3564004800 0x7f3564004c80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.838+0000 7f357f660640 1 -- 172.21.15.81:0/2260007435 >> 172.21.15.81:0/2260007435 conn(0x7f35780d40f0 msgr2=0x7f35780d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:36.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.839+0000 7f357f660640 1 -- 172.21.15.81:0/2260007435 shutdown_connections 2024-03-18T07:14:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.839+0000 7f357f660640 1 -- 172.21.15.81:0/2260007435 wait complete. 2024-03-18T07:14:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.844+0000 7f357f660640 1 Processor -- start 2024-03-18T07:14:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.845+0000 7f357f660640 1 -- start start 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.846+0000 7f357f660640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357f660640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3578158880 0x7f3578161380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357f660640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 0x7f35781592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357f660640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35780d18b0 con 0x7f35781618c0 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357f660640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f35780cf7c0 con 0x7f3578158880 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357f660640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f35780d1a30 con 0x7f3564004800 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:58872/0 (socket says 172.21.15.81:58872) 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 -- 172.21.15.81:0/1663627819 learned_addr learned my addr 172.21.15.81:0/1663627819 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357cbfb640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3578158880 0x7f3578161380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357dbfd640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 0x7f35781592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 -- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3578158880 msgr2=0x7f3578161380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3578158880 0x7f3578161380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.847+0000 7f357d3fc640 1 -- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 msgr2=0x7f35781592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.848+0000 7f357d3fc640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 0x7f35781592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.848+0000 7f357d3fc640 1 -- 172.21.15.81:0/1663627819 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35780b6e40 con 0x7f3564004800 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.848+0000 7f357dbfd640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 0x7f35781592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.848+0000 7f357d3fc640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f356800b450 tx=0x7f356800b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.849+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568015020 con 0x7f3564004800 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.849+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3568011830 con 0x7f3564004800 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.849+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3568011c20 con 0x7f3564004800 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.849+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35780b7120 con 0x7f3564004800 2024-03-18T07:14:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.850+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35780b76e0 con 0x7f3564004800 2024-03-18T07:14:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.854+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3568018020 con 0x7f3564004800 2024-03-18T07:14:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.855+0000 7f356dffb640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 0x7f355c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.855+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f356808a5c0 con 0x7f3564004800 2024-03-18T07:14:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.855+0000 7f357cbfb640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 0x7f355c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.857+0000 7f357cbfb640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 0x7f355c06e090 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3574034000 tx=0x7f3574009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.859+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357804f540 con 0x7f3564004800 2024-03-18T07:14:36.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:36.867+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f356801f030 con 0x7f3564004800 2024-03-18T07:14:37.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.668+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3578161ca0 con 0x7f3564004800 2024-03-18T07:14:37.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.669+0000 7f356dffb640 1 -- 172.21.15.81:0/1663627819 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v32) ==== 104+0+11 (secure 0 0 0) 0x7f35680172c0 con 0x7f3564004800 2024-03-18T07:14:37.678 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.671+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 msgr2=0x7f355c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.671+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 0x7f355c06e090 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f3574034000 tx=0x7f3574009030 comp rx=0 tx=0).stop 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 msgr2=0x7f3578158180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f356800b450 tx=0x7f356800b910 comp rx=0 tx=0).stop 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 shutdown_connections 2024-03-18T07:14:37.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f355c06bbd0 0x7f355c06e090 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35781618c0 0x7f35781592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3578158880 0x7f3578161380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 --2- 172.21.15.81:0/1663627819 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3564004800 0x7f3578158180 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 >> 172.21.15.81:0/1663627819 conn(0x7f35780d40f0 msgr2=0x7f35780d2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 shutdown_connections 2024-03-18T07:14:37.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.672+0000 7f357f660640 1 -- 172.21.15.81:0/1663627819 wait complete. 2024-03-18T07:14:37.697 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T07:14:37.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.904+0000 7f5a87e60640 1 Processor -- start 2024-03-18T07:14:37.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.904+0000 7f5a87e60640 1 -- start start 2024-03-18T07:14:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a87e60640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5a8016be00 0x7f5a8016e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a87e60640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a800b4870 con 0x7f5a800d2940 2024-03-18T07:14:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a87e60640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a800b5690 con 0x7f5a800d2d20 2024-03-18T07:14:37.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a87e60640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5a800b5950 con 0x7f5a8016be00 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a853fb640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f5a800d2d20 0x7f5a800b4160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:52622/0 (socket says 172.21.15.81:52622) 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.908+0000 7f5a853fb640 1 -- 172.21.15.81:0/779943296 learned_addr learned my addr 172.21.15.81:0/779943296 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.909+0000 7f5a863fd640 1 --2- 172.21.15.81:0/779943296 >> v2:172.21.15.81:3300/0 conn(0x7f5a8016be00 0x7f5a8016e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.909+0000 7f5a863fd640 1 -- 172.21.15.81:0/779943296 >> v1:172.21.15.136:6789/0 conn(0x7f5a800d2d20 legacy=0x7f5a800b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.909+0000 7f5a863fd640 1 -- 172.21.15.81:0/779943296 >> v1:172.21.15.81:6789/0 conn(0x7f5a800d2940 legacy=0x7f5a800b3a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.909+0000 7f5a863fd640 1 -- 172.21.15.81:0/779943296 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a800c74b0 con 0x7f5a8016be00 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.910+0000 7f5a863fd640 1 --2- 172.21.15.81:0/779943296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8016be00 0x7f5a8016e1f0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009720 tx=0x7f5a7c02b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e69aefc971812b6d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:37.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.913+0000 7f5a84bfa640 1 -- 172.21.15.81:0/779943296 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c037070 con 0x7f5a8016be00 2024-03-18T07:14:37.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.913+0000 7f5a84bfa640 1 -- 172.21.15.81:0/779943296 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7c030710 con 0x7f5a8016be00 2024-03-18T07:14:37.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.913+0000 7f5a84bfa640 1 -- 172.21.15.81:0/779943296 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c030ae0 con 0x7f5a8016be00 2024-03-18T07:14:37.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.914+0000 7f5a87e60640 1 -- 172.21.15.81:0/779943296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8016be00 msgr2=0x7f5a8016e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.914+0000 7f5a87e60640 1 --2- 172.21.15.81:0/779943296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8016be00 0x7f5a8016e1f0 secure :-1 s=READY pgs=3234 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009720 tx=0x7f5a7c02b690 comp rx=0 tx=0).stop 2024-03-18T07:14:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.915+0000 7f5a87e60640 1 -- 172.21.15.81:0/779943296 shutdown_connections 2024-03-18T07:14:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.915+0000 7f5a87e60640 1 --2- 172.21.15.81:0/779943296 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a8016be00 0x7f5a8016e1f0 unknown :-1 s=CLOSED pgs=3234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.915+0000 7f5a87e60640 1 -- 172.21.15.81:0/779943296 >> 172.21.15.81:0/779943296 conn(0x7f5a800d40f0 msgr2=0x7f5a800d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:37.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.916+0000 7f5a87e60640 1 -- 172.21.15.81:0/779943296 shutdown_connections 2024-03-18T07:14:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.916+0000 7f5a87e60640 1 -- 172.21.15.81:0/779943296 wait complete. 2024-03-18T07:14:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.921+0000 7f5a87e60640 1 Processor -- start 2024-03-18T07:14:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.921+0000 7f5a87e60640 1 -- start start 2024-03-18T07:14:37.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.924+0000 7f5a87e60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.924+0000 7f5a85bfc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.924+0000 7f5a85bfc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45032/0 (socket says 172.21.15.81:45032) 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a85bfc640 1 -- 172.21.15.81:0/617663902 learned_addr learned my addr 172.21.15.81:0/617663902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a800d2d20 0x7f5a800ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a8016be00 0x7f5a800b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800d4ef0 con 0x7f5a800d2940 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5a800c71d0 con 0x7f5a8016be00 2024-03-18T07:14:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.925+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5a800cfd10 con 0x7f5a800d2d20 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a863fd640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a8016be00 0x7f5a800b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a85bfc640 1 -- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a800d2d20 msgr2=0x7f5a800ca310 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a85bfc640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a800d2d20 0x7f5a800ca310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a85bfc640 1 -- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a8016be00 msgr2=0x7f5a800b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a85bfc640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a8016be00 0x7f5a800b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.926+0000 7f5a85bfc640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a800ca9b0 con 0x7f5a800d2940 2024-03-18T07:14:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.927+0000 7f5a85bfc640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b480 tx=0x7f5a7000b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.928+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70014070 con 0x7f5a800d2940 2024-03-18T07:14:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.928+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a70010870 con 0x7f5a800d2940 2024-03-18T07:14:37.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.928+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70010c40 con 0x7f5a800d2940 2024-03-18T07:14:37.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.929+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a800ccae0 con 0x7f5a800d2940 2024-03-18T07:14:37.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.929+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a800cd0a0 con 0x7f5a800d2940 2024-03-18T07:14:37.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.933+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a8004f540 con 0x7f5a800d2940 2024-03-18T07:14:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.936+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5a70017070 con 0x7f5a800d2940 2024-03-18T07:14:37.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.937+0000 7f5a767fc640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 0x7f5a6406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:37.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.938+0000 7f5a853fb640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 0x7f5a6406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.939+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f5a70056da0 con 0x7f5a800d2940 2024-03-18T07:14:37.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.940+0000 7f5a853fb640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 0x7f5a6406e0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001e70 tx=0x7f5a78007d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:37.960+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5a70059400 con 0x7f5a800d2940 2024-03-18T07:14:38.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.894+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5a800b4520 con 0x7f5a800d2940 2024-03-18T07:14:38.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.896+0000 7f5a767fc640 1 -- 172.21.15.81:0/617663902 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v32) ==== 100+0+11 (secure 0 0 0) 0x7f5a70058d00 con 0x7f5a800d2940 2024-03-18T07:14:38.902 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-03-18T07:14:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.899+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 msgr2=0x7f5a6406e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.899+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 0x7f5a6406e0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f5a78001e70 tx=0x7f5a78007d20 comp rx=0 tx=0).stop 2024-03-18T07:14:38.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 msgr2=0x7f5a800c9dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 secure :-1 s=READY pgs=3235 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b480 tx=0x7f5a7000b940 comp rx=0 tx=0).stop 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 shutdown_connections 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5a8016be00 0x7f5a800b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5a800d2d20 0x7f5a800ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5a6406bc20 0x7f5a6406e0e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 --2- 172.21.15.81:0/617663902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a800d2940 0x7f5a800c9dd0 unknown :-1 s=CLOSED pgs=3235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 >> 172.21.15.81:0/617663902 conn(0x7f5a800d40f0 msgr2=0x7f5a800d44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 shutdown_connections 2024-03-18T07:14:38.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:38.900+0000 7f5a87e60640 1 -- 172.21.15.81:0/617663902 wait complete. 2024-03-18T07:14:38.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T07:14:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.295+0000 7fdad12f1640 1 Processor -- start 2024-03-18T07:14:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.296+0000 7fdad12f1640 1 -- start start 2024-03-18T07:14:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad12f1640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 0x7fdac4006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad12f1640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 0x7fdac4006760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad12f1640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac40e3900 con 0x7fdac40341e0 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad12f1640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdac40079a0 con 0x7fdac40e3520 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad12f1640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdac4006d90 con 0x7fdac4007e30 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad0af0640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdac40341e0 0x7fdac40542e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:52634/0 (socket says 172.21.15.81:52634) 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdad0af0640 1 -- 172.21.15.81:0/4270702577 learned_addr learned my addr 172.21.15.81:0/4270702577 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdacb7fe640 1 --2- 172.21.15.81:0/4270702577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 0x7fdac4006760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.299+0000 7fdacbfff640 1 --2- 172.21.15.81:0/4270702577 >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 0x7fdac4006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.300+0000 7fdacb7fe640 1 -- 172.21.15.81:0/4270702577 >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 msgr2=0x7fdac4006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.300+0000 7fdacb7fe640 1 --2- 172.21.15.81:0/4270702577 >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 0x7fdac4006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.300+0000 7fdacb7fe640 1 -- 172.21.15.81:0/4270702577 >> v1:172.21.15.136:6789/0 conn(0x7fdac40341e0 legacy=0x7fdac40542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.300+0000 7fdacb7fe640 1 -- 172.21.15.81:0/4270702577 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4007070 con 0x7fdac4007e30 2024-03-18T07:14:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.300+0000 7fdacbfff640 1 --2- 172.21.15.81:0/4270702577 >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 0x7fdac4006220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.303+0000 7fdacb7fe640 1 --2- 172.21.15.81:0/4270702577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 0x7fdac4006760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdab80097a0 tx=0x7fdab802b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54d9cf77fc21be52 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.303+0000 7fdacaffd640 1 -- 172.21.15.81:0/4270702577 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8031780 con 0x7fdac4007e30 2024-03-18T07:14:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.303+0000 7fdacaffd640 1 -- 172.21.15.81:0/4270702577 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab8037070 con 0x7fdac4007e30 2024-03-18T07:14:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.303+0000 7fdacaffd640 1 -- 172.21.15.81:0/4270702577 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8031b40 con 0x7fdac4007e30 2024-03-18T07:14:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 -- 172.21.15.81:0/4270702577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 msgr2=0x7fdac4006760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 --2- 172.21.15.81:0/4270702577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 0x7fdac4006760 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fdab80097a0 tx=0x7fdab802b820 comp rx=0 tx=0).stop 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 -- 172.21.15.81:0/4270702577 shutdown_connections 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 --2- 172.21.15.81:0/4270702577 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac4007e30 0x7fdac4006760 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 --2- 172.21.15.81:0/4270702577 >> v2:172.21.15.81:3300/0 conn(0x7fdac40e3520 0x7fdac4006220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.305+0000 7fdad12f1640 1 -- 172.21.15.81:0/4270702577 >> 172.21.15.81:0/4270702577 conn(0x7fdac401e6c0 msgr2=0x7fdac40553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.306+0000 7fdad12f1640 1 -- 172.21.15.81:0/4270702577 shutdown_connections 2024-03-18T07:14:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.306+0000 7fdad12f1640 1 -- 172.21.15.81:0/4270702577 wait complete. 2024-03-18T07:14:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.311+0000 7fdad12f1640 1 Processor -- start 2024-03-18T07:14:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.311+0000 7fdad12f1640 1 -- start start 2024-03-18T07:14:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.314+0000 7fdad12f1640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 0x7fdac4050430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.314+0000 7fdad12f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac40341e0 0x7fdac40518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdacbfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 0x7fdac4050430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdacbfff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 0x7fdac4050430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:57328/0 (socket says 172.21.15.81:57328) 2024-03-18T07:14:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdacbfff640 1 -- 172.21.15.81:0/3539914465 learned_addr learned my addr 172.21.15.81:0/3539914465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 0x7fdac40d9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdacb7fe640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac40341e0 0x7fdac40518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdac403a360 con 0x7fdac40341e0 2024-03-18T07:14:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdad0af0640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 0x7fdac40d9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdac4007630 con 0x7fdac4007e30 2024-03-18T07:14:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.315+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdac4034650 con 0x7fdac40e3520 2024-03-18T07:14:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.316+0000 7fdad0af0640 1 -- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 msgr2=0x7fdac4050430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.316+0000 7fdad0af0640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 0x7fdac4050430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.316+0000 7fdad0af0640 1 -- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac40341e0 msgr2=0x7fdac40518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.316+0000 7fdad0af0640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac40341e0 0x7fdac40518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.316+0000 7fdad0af0640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4050e10 con 0x7fdac40e3520 2024-03-18T07:14:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.317+0000 7fdad0af0640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 0x7fdac40d9030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdacc02d740 tx=0x7fdacc068d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.317+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc0733c0 con 0x7fdac40e3520 2024-03-18T07:14:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.317+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4050b30 con 0x7fdac40e3520 2024-03-18T07:14:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.317+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc073560 con 0x7fdac40e3520 2024-03-18T07:14:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.318+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc098020 con 0x7fdac40e3520 2024-03-18T07:14:39.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.318+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac404dfb0 con 0x7fdac40e3520 2024-03-18T07:14:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.321+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdacc071830 con 0x7fdac40e3520 2024-03-18T07:14:39.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.321+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac40057e0 con 0x7fdac40e3520 2024-03-18T07:14:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.321+0000 7fdac8ff9640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 0x7fdab006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.321+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fdacc106260 con 0x7fdac40e3520 2024-03-18T07:14:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.321+0000 7fdacbfff640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 0x7fdab006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.322+0000 7fdacbfff640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 0x7fdab006e090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdac404bab0 tx=0x7fdac0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:39.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:39.331+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdac4050e10 con 0x7fdac40e3520 2024-03-18T07:14:40.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.459+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdac404f680 con 0x7fdac40e3520 2024-03-18T07:14:40.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.460+0000 7fdac8ff9640 1 -- 172.21.15.81:0/3539914465 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7fdacc08f030 con 0x7fdac40e3520 2024-03-18T07:14:40.466 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:40.467 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T07:14:40.467 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T07:14:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.465+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 msgr2=0x7fdab006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.465+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 0x7fdab006e090 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fdac404bab0 tx=0x7fdac0009190 comp rx=0 tx=0).stop 2024-03-18T07:14:40.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.465+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 msgr2=0x7fdac40d9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.465+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 0x7fdac40d9030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdacc02d740 tx=0x7fdacc068d00 comp rx=0 tx=0).stop 2024-03-18T07:14:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 shutdown_connections 2024-03-18T07:14:40.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdac40e3520 0x7fdac40d9030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdab006bbd0 0x7fdab006e090 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdac40341e0 0x7fdac40518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 --2- 172.21.15.81:0/3539914465 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdac4007e30 0x7fdac4050430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 >> 172.21.15.81:0/3539914465 conn(0x7fdac401e6c0 msgr2=0x7fdac400afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 shutdown_connections 2024-03-18T07:14:40.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.468+0000 7fdad12f1640 1 -- 172.21.15.81:0/3539914465 wait complete. 2024-03-18T07:14:40.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T07:14:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.730+0000 7fe83c559640 1 Processor -- start 2024-03-18T07:14:40.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.730+0000 7fe83c559640 1 -- start start 2024-03-18T07:14:40.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83c559640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83c559640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe8340ceeb0 0x7fe834165f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83c559640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8340d2a00 con 0x7fe83415c510 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83c559640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe8340c5a30 con 0x7fe8340ceeb0 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83c559640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe8340c5d10 con 0x7fe8340cfc20 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe839af4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe839af4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:58910/0 (socket says 172.21.15.81:58910) 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe839af4640 1 -- 172.21.15.81:0/3449047094 learned_addr learned my addr 172.21.15.81:0/3449047094 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.733+0000 7fe83aaf6640 1 --2- 172.21.15.81:0/3449047094 >> v2:172.21.15.136:3300/0 conn(0x7fe8340ceeb0 0x7fe834165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.734+0000 7fe839af4640 1 -- 172.21.15.81:0/3449047094 >> v2:172.21.15.136:3300/0 conn(0x7fe8340ceeb0 msgr2=0x7fe834165f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.734+0000 7fe839af4640 1 --2- 172.21.15.81:0/3449047094 >> v2:172.21.15.136:3300/0 conn(0x7fe8340ceeb0 0x7fe834165f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.734+0000 7fe839af4640 1 -- 172.21.15.81:0/3449047094 >> v1:172.21.15.81:6789/0 conn(0x7fe83415c510 legacy=0x7fe8340ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.734+0000 7fe839af4640 1 -- 172.21.15.81:0/3449047094 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8340c5ff0 con 0x7fe8340cfc20 2024-03-18T07:14:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.748+0000 7fe839af4640 1 --2- 172.21.15.81:0/3449047094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe824009870 tx=0x7fe82402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5588b7e1afc8337 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.748+0000 7fe8392f3640 1 -- 172.21.15.81:0/3449047094 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824034070 con 0x7fe8340cfc20 2024-03-18T07:14:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.749+0000 7fe8392f3640 1 -- 172.21.15.81:0/3449047094 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe824030840 con 0x7fe8340cfc20 2024-03-18T07:14:40.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.749+0000 7fe8392f3640 1 -- 172.21.15.81:0/3449047094 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe824030c10 con 0x7fe8340cfc20 2024-03-18T07:14:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 -- 172.21.15.81:0/3449047094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 msgr2=0x7fe8340cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 --2- 172.21.15.81:0/3449047094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe824009870 tx=0x7fe82402b980 comp rx=0 tx=0).stop 2024-03-18T07:14:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 -- 172.21.15.81:0/3449047094 shutdown_connections 2024-03-18T07:14:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 --2- 172.21.15.81:0/3449047094 >> v2:172.21.15.136:3300/0 conn(0x7fe8340ceeb0 0x7fe834165f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 --2- 172.21.15.81:0/3449047094 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340cfc20 0x7fe8340cda60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.751+0000 7fe83c559640 1 -- 172.21.15.81:0/3449047094 >> 172.21.15.81:0/3449047094 conn(0x7fe8340d1e40 msgr2=0x7fe8340d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.752+0000 7fe83c559640 1 -- 172.21.15.81:0/3449047094 shutdown_connections 2024-03-18T07:14:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.752+0000 7fe83c559640 1 -- 172.21.15.81:0/3449047094 wait complete. 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.756+0000 7fe83c559640 1 Processor -- start 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.757+0000 7fe83c559640 1 -- start start 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.760+0000 7fe83c559640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340ceeb0 0x7fe8340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83c559640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 0x7fe834150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83c559640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 0x7fe8340b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83c559640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340cf7f0 con 0x7fe8340cfc20 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe839af4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 0x7fe834150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83c559640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8340cf670 con 0x7fe83415c510 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83c559640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe8340c8520 con 0x7fe8340ceeb0 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe83aaf6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 0x7fe8340b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe839af4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 0x7fe834150650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45042/0 (socket says 172.21.15.81:45042) 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.761+0000 7fe839af4640 1 -- 172.21.15.81:0/4259194028 learned_addr learned my addr 172.21.15.81:0/4259194028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83a2f5640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340ceeb0 0x7fe8340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83aaf6640 1 -- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340ceeb0 msgr2=0x7fe8340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83aaf6640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340ceeb0 0x7fe8340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83aaf6640 1 -- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 msgr2=0x7fe834150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83aaf6640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 0x7fe834150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:40.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.762+0000 7fe83aaf6640 1 -- 172.21.15.81:0/4259194028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8341542f0 con 0x7fe83415c510 2024-03-18T07:14:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.765+0000 7fe83aaf6640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 0x7fe8340b0200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00efc0 tx=0x7fe82c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.772+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c018020 con 0x7fe83415c510 2024-03-18T07:14:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.772+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe82c014480 con 0x7fe83415c510 2024-03-18T07:14:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.772+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe82c014870 con 0x7fe83415c510 2024-03-18T07:14:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.773+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe834150b90 con 0x7fe83415c510 2024-03-18T07:14:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.773+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe834154890 con 0x7fe83415c510 2024-03-18T07:14:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.775+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe82c005d10 con 0x7fe83415c510 2024-03-18T07:14:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.775+0000 7fe82affd640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 0x7fe81806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.775+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe82c08b690 con 0x7fe83415c510 2024-03-18T07:14:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.775+0000 7fe83a2f5640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 0x7fe81806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.776+0000 7fe83a2f5640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 0x7fe81806e110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe830007fd0 tx=0x7fe830009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.780+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83404f5b0 con 0x7fe83415c510 2024-03-18T07:14:40.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:40.790+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe82c022030 con 0x7fe83415c510 2024-03-18T07:14:41.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.749+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe8340d0200 con 0x7fe83415c510 2024-03-18T07:14:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.750+0000 7fe82affd640 1 -- 172.21.15.81:0/4259194028 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7fe82c010040 con 0x7fe83415c510 2024-03-18T07:14:41.757 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:41.757 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:16.273398+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 msgr2=0x7fe81806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 0x7fe81806e110 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fe830007fd0 tx=0x7fe830009040 comp rx=0 tx=0).stop 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 msgr2=0x7fe8340b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 0x7fe8340b0200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00efc0 tx=0x7fe82c00c490 comp rx=0 tx=0).stop 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 shutdown_connections 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe83415c510 0x7fe8340b0200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:41.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe81806bc50 0x7fe81806e110 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8340cfc20 0x7fe834150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 --2- 172.21.15.81:0/4259194028 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe8340ceeb0 0x7fe8340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 >> 172.21.15.81:0/4259194028 conn(0x7fe8340d1e40 msgr2=0x7fe8340d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 shutdown_connections 2024-03-18T07:14:41.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:41.756+0000 7fe83c559640 1 -- 172.21.15.81:0/4259194028 wait complete. 2024-03-18T07:14:41.788 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T07:14:41.789 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T07:14:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.147+0000 7f19fa6b2640 1 Processor -- start 2024-03-18T07:14:42.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.147+0000 7f19fa6b2640 1 -- start start 2024-03-18T07:14:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.151+0000 7f19fa6b2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19fa6b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19f3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45052/0 (socket says 172.21.15.81:45052) 2024-03-18T07:14:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19f3fff640 1 -- 172.21.15.81:0/4130803995 learned_addr learned my addr 172.21.15.81:0/4130803995 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f4154f90 con 0x7f19f406d1b0 2024-03-18T07:14:42.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f19f406d650 con 0x7f19f4154bb0 2024-03-18T07:14:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19f406d930 con 0x7f19f415e880 2024-03-18T07:14:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.152+0000 7f19f8c4f640 1 --2- 172.21.15.81:0/4130803995 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.153+0000 7f19f8c4f640 1 -- 172.21.15.81:0/4130803995 >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 msgr2=0x7f19f406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:42.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.153+0000 7f19f8c4f640 1 --2- 172.21.15.81:0/4130803995 >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.153+0000 7f19f8c4f640 1 -- 172.21.15.81:0/4130803995 >> v1:172.21.15.81:6789/0 conn(0x7f19f406d1b0 legacy=0x7f19f415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.154+0000 7f19f8c4f640 1 -- 172.21.15.81:0/4130803995 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f406dc10 con 0x7f19f415e880 2024-03-18T07:14:42.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.154+0000 7f19f3fff640 1 --2- 172.21.15.81:0/4130803995 >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:14:42.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.156+0000 7f19f8c4f640 1 --2- 172.21.15.81:0/4130803995 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 0x7f19f4071500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009d90 tx=0x7f19ec02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa2940894bf57e55 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.157+0000 7f19f2ffd640 1 -- 172.21.15.81:0/4130803995 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec039070 con 0x7f19f415e880 2024-03-18T07:14:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.157+0000 7f19f2ffd640 1 -- 172.21.15.81:0/4130803995 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19ec02cc50 con 0x7f19f415e880 2024-03-18T07:14:42.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.157+0000 7f19f2ffd640 1 -- 172.21.15.81:0/4130803995 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19ec034440 con 0x7f19f415e880 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 msgr2=0x7f19f4071500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 --2- 172.21.15.81:0/4130803995 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 0x7f19f4071500 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f19ec009d90 tx=0x7f19ec02bea0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 shutdown_connections 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 --2- 172.21.15.81:0/4130803995 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 --2- 172.21.15.81:0/4130803995 >> v2:172.21.15.81:3300/0 conn(0x7f19f4154bb0 0x7f19f406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 >> 172.21.15.81:0/4130803995 conn(0x7f19f406b5e0 msgr2=0x7f19f406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:42.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 shutdown_connections 2024-03-18T07:14:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.159+0000 7f19fa6b2640 1 -- 172.21.15.81:0/4130803995 wait complete. 2024-03-18T07:14:42.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.166+0000 7f19fa6b2640 1 Processor -- start 2024-03-18T07:14:42.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.166+0000 7f19fa6b2640 1 -- start start 2024-03-18T07:14:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f406d1b0 0x7f19f4140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45068/0 (socket says 172.21.15.81:45068) 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19f406e6f0 con 0x7f19f4154bb0 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f19f406e1d0 con 0x7f19f415e880 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.170+0000 7f19fa6b2640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f19f415ee60 con 0x7f19f406d1b0 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 -- 172.21.15.81:0/547279521 learned_addr learned my addr 172.21.15.81:0/547279521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 -- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f406d1b0 msgr2=0x7f19f4140850 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f406d1b0 0x7f19f4140850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 -- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f415e880 msgr2=0x7f19f4071500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 -- 172.21.15.81:0/547279521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f40ae310 con 0x7f19f4154bb0 2024-03-18T07:14:42.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.171+0000 7f19f37fe640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c3f0 tx=0x7f19e400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.172+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e40052d0 con 0x7f19f4154bb0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.172+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e4005470 con 0x7f19f4154bb0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.172+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19e4007260 con 0x7f19f4154bb0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.173+0000 7f19fa6b2640 1 -- 172.21.15.81:0/547279521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f40ae5f0 con 0x7f19f4154bb0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.173+0000 7f19fa6b2640 1 -- 172.21.15.81:0/547279521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f40aebb0 con 0x7f19f4154bb0 2024-03-18T07:14:42.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.174+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f40712e0 con 0x7f19f4154bb0 2024-03-18T07:14:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.175+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f19e4007400 con 0x7f19f4154bb0 2024-03-18T07:14:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.176+0000 7f19f0ff9640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 0x7f19e006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.176+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f19e4089ec0 con 0x7f19f4154bb0 2024-03-18T07:14:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.176+0000 7f19f3fff640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 0x7f19e006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:42.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.177+0000 7f19f3fff640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 0x7f19e006e110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:42.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:42.182+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f19e4058a00 con 0x7f19f4154bb0 2024-03-18T07:14:43.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.230+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19f404f590 con 0x7f19f4154bb0 2024-03-18T07:14:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.250+0000 7f19f0ff9640 1 -- 172.21.15.81:0/547279521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7f19e4058300 con 0x7f19f4154bb0 2024-03-18T07:14:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:43.256 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T07:14:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T07:14:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.252+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 msgr2=0x7f19e006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.252+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 0x7f19e006e110 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f19e8006fd0 tx=0x7f19e8008040 comp rx=0 tx=0).stop 2024-03-18T07:14:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.253+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 msgr2=0x7f19f41411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.253+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 secure :-1 s=READY pgs=3238 cs=0 l=1 rev1=1 crypto rx=0x7f19e400c3f0 tx=0x7f19e400c8b0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 shutdown_connections 2024-03-18T07:14:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f19f415e880 0x7f19f4071500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f19e006bc50 0x7f19e006e110 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19f4154bb0 0x7f19f41411c0 unknown :-1 s=CLOSED pgs=3238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 --2- 172.21.15.81:0/547279521 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f19f406d1b0 0x7f19f4140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.254+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 >> 172.21.15.81:0/547279521 conn(0x7f19f406b5e0 msgr2=0x7f19f415bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:43.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.257+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 shutdown_connections 2024-03-18T07:14:43.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.257+0000 7f19da7fc640 1 -- 172.21.15.81:0/547279521 wait complete. 2024-03-18T07:14:43.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T07:14:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.457+0000 7f1118e75640 1 Processor -- start 2024-03-18T07:14:43.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.457+0000 7f1118e75640 1 -- start start 2024-03-18T07:14:43.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.461+0000 7f1118e75640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1114072e20 0x7f11140b4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.461+0000 7f111259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f111415b060 0x7f11140af4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:51548/0 (socket says 172.21.15.81:51548) 2024-03-18T07:14:43.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.462+0000 7f111259c640 1 -- 172.21.15.81:0/492858403 learned_addr learned my addr 172.21.15.81:0/492858403 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:43.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.462+0000 7f1118e75640 1 --2- 172.21.15.81:0/492858403 >> v2:172.21.15.136:3300/0 conn(0x7f1114071ed0 0x7f1114072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.462+0000 7f1112d9d640 1 --2- 172.21.15.81:0/492858403 >> v2:172.21.15.136:3300/0 conn(0x7f1114071ed0 0x7f1114072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.462+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11140ae770 con 0x7f111415b060 2024-03-18T07:14:43.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.462+0000 7f1111d9b640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1114072e20 0x7f11140b4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.463+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f11140afbc0 con 0x7f1114071ed0 2024-03-18T07:14:43.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.463+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11140af020 con 0x7f1114072e20 2024-03-18T07:14:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.467+0000 7f1112d9d640 1 -- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1114072e20 msgr2=0x7f11140b4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:43.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.467+0000 7f1112d9d640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1114072e20 0x7f11140b4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.467+0000 7f1112d9d640 1 -- 172.21.15.81:0/492858403 >> v1:172.21.15.81:6789/0 conn(0x7f111415b060 legacy=0x7f11140af4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.467+0000 7f1112d9d640 1 -- 172.21.15.81:0/492858403 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11140aea10 con 0x7f1114071ed0 2024-03-18T07:14:43.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.471+0000 7f1112d9d640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114072360 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f110c009d90 tx=0x7f110c02be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7284c03109430e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.472+0000 7f111159a640 1 -- 172.21.15.81:0/492858403 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c039070 con 0x7f1114071ed0 2024-03-18T07:14:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.472+0000 7f111159a640 1 -- 172.21.15.81:0/492858403 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f110c02cbe0 con 0x7f1114071ed0 2024-03-18T07:14:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.472+0000 7f111159a640 1 -- 172.21.15.81:0/492858403 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f110c034440 con 0x7f1114071ed0 2024-03-18T07:14:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 msgr2=0x7f1114072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114072360 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f110c009d90 tx=0x7f110c02be30 comp rx=0 tx=0).stop 2024-03-18T07:14:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 shutdown_connections 2024-03-18T07:14:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114072360 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 --2- 172.21.15.81:0/492858403 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1114072e20 0x7f11140b4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.473+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 >> 172.21.15.81:0/492858403 conn(0x7f11140b2a40 msgr2=0x7f11140b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.479+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 shutdown_connections 2024-03-18T07:14:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.479+0000 7f1118e75640 1 -- 172.21.15.81:0/492858403 wait complete. 2024-03-18T07:14:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.485+0000 7f1118e75640 1 Processor -- start 2024-03-18T07:14:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.485+0000 7f1118e75640 1 -- start start 2024-03-18T07:14:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.489+0000 7f1118e75640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f1118e75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1114072e20 0x7f1114159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f111259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f111259c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:57364/0 (socket says 172.21.15.81:57364) 2024-03-18T07:14:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f111259c640 1 -- 172.21.15.81:0/1880571812 learned_addr learned my addr 172.21.15.81:0/1880571812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f111415b060 0x7f1114159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.490+0000 7f1111d9b640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1114072e20 0x7f1114159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.491+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11140b5590 con 0x7f1114072e20 2024-03-18T07:14:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.491+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11140aecb0 con 0x7f1114071ed0 2024-03-18T07:14:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.491+0000 7f1112d9d640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f111415b060 0x7f1114159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.491+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11140b5710 con 0x7f111415b060 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 -- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f111415b060 msgr2=0x7f1114159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f111415b060 0x7f1114159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 -- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1114072e20 msgr2=0x7f1114159710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1114072e20 0x7f1114159710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111415ec50 con 0x7f1114071ed0 2024-03-18T07:14:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.492+0000 7f111259c640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f110400c4b0 tx=0x7f110400c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.493+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104017070 con 0x7f1114071ed0 2024-03-18T07:14:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.493+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1104005ce0 con 0x7f1114071ed0 2024-03-18T07:14:43.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.495+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f111415ef30 con 0x7f1114071ed0 2024-03-18T07:14:43.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.495+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1104007270 con 0x7f1114071ed0 2024-03-18T07:14:43.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.496+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f111415de40 con 0x7f1114071ed0 2024-03-18T07:14:43.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.497+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111409ca60 con 0x7f1114071ed0 2024-03-18T07:14:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.505+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f110401a070 con 0x7f1114071ed0 2024-03-18T07:14:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.506+0000 7f1102ffd640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 0x7f10f40703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.506+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f110408a140 con 0x7f1114071ed0 2024-03-18T07:14:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.506+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f110408a550 con 0x7f1114071ed0 2024-03-18T07:14:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.506+0000 7f1111d9b640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 0x7f10f40703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:43.508+0000 7f1111d9b640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 0x7f10f40703a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f111409c2d0 tx=0x7f1108008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:44.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.436+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f111404f5b0 con 0x7f1114071ed0 2024-03-18T07:14:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.444+0000 7f1102ffd640 1 -- 172.21.15.81:0/1880571812 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5184 (secure 0 0 0) 0x7f1104058650 con 0x7f1114071ed0 2024-03-18T07:14:44.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:44.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T00:26:14.611226+0000","modified":"2024-03-18T00:26:16.618155+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5070},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5070":{"gid":5070,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.136:6834/1616882519","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1616882519},{"type":"v1","addr":"172.21.15.136:6834","nonce":1616882519}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5070,"qdb_cluster":[5070]},"id":2}]} 2024-03-18T07:14:44.450 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-03-18T07:14:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.451+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 msgr2=0x7f10f40703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.451+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 0x7f10f40703a0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f111409c2d0 tx=0x7f1108008040 comp rx=0 tx=0).stop 2024-03-18T07:14:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.451+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 msgr2=0x7f1114149970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.451+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f110400c4b0 tx=0x7f110400c970 comp rx=0 tx=0).stop 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 shutdown_connections 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f111415b060 0x7f1114159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f10f406dee0 0x7f10f40703a0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1114072e20 0x7f1114159710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 --2- 172.21.15.81:0/1880571812 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1114071ed0 0x7f1114149970 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 >> 172.21.15.81:0/1880571812 conn(0x7f11140b2a40 msgr2=0x7f11140af4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 shutdown_connections 2024-03-18T07:14:44.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.452+0000 7f1118e75640 1 -- 172.21.15.81:0/1880571812 wait complete. 2024-03-18T07:14:44.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T07:14:44.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.865+0000 7f1175f89640 1 Processor -- start 2024-03-18T07:14:44.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.865+0000 7f1175f89640 1 -- start start 2024-03-18T07:14:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.868+0000 7f1175f89640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1170154a50 0x7f117015b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.868+0000 7f1175f89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117015bb50 con 0x7f1170154e30 2024-03-18T07:14:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.868+0000 7f1175f89640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f117006df40 con 0x7f11700b4760 2024-03-18T07:14:44.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.868+0000 7f1175f89640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f117006e220 con 0x7f1170154a50 2024-03-18T07:14:44.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.869+0000 7f116ffff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f11700b4760 0x7f11700af510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:52640/0 (socket says 172.21.15.81:52640) 2024-03-18T07:14:44.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.869+0000 7f116ffff640 1 -- 172.21.15.81:0/2287757151 learned_addr learned my addr 172.21.15.81:0/2287757151 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:44.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.869+0000 7f116f7fe640 1 --2- 172.21.15.81:0/2287757151 >> v2:172.21.15.81:3300/0 conn(0x7f1170154a50 0x7f117015b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:44.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.869+0000 7f116e7fc640 1 -- 172.21.15.81:0/2287757151 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719044812 0 0) 0x7f117006df40 con 0x7f11700b4760 2024-03-18T07:14:44.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.869+0000 7f116e7fc640 1 -- 172.21.15.81:0/2287757151 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1158003520 con 0x7f11700b4760 2024-03-18T07:14:44.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.870+0000 7f116f7fe640 1 -- 172.21.15.81:0/2287757151 >> v1:172.21.15.136:6789/0 conn(0x7f11700b4760 legacy=0x7f11700af510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.870+0000 7f116f7fe640 1 -- 172.21.15.81:0/2287757151 >> v1:172.21.15.81:6789/0 conn(0x7f1170154e30 legacy=0x7f11700b4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.870+0000 7f116f7fe640 1 -- 172.21.15.81:0/2287757151 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117006e500 con 0x7f1170154a50 2024-03-18T07:14:44.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.873+0000 7f116f7fe640 1 --2- 172.21.15.81:0/2287757151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f117015b610 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7f11600097a0 tx=0x7f116002db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772752ad10ae2f79 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.874+0000 7f116e7fc640 1 -- 172.21.15.81:0/2287757151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116003b070 con 0x7f1170154a50 2024-03-18T07:14:44.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.875+0000 7f116e7fc640 1 -- 172.21.15.81:0/2287757151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f116002e920 con 0x7f1170154a50 2024-03-18T07:14:44.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.875+0000 7f116e7fc640 1 -- 172.21.15.81:0/2287757151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f116002ecf0 con 0x7f1170154a50 2024-03-18T07:14:44.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.876+0000 7f1175f89640 1 -- 172.21.15.81:0/2287757151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 msgr2=0x7f117015b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.876+0000 7f1175f89640 1 --2- 172.21.15.81:0/2287757151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f117015b610 secure :-1 s=READY pgs=3241 cs=0 l=1 rev1=1 crypto rx=0x7f11600097a0 tx=0x7f116002db70 comp rx=0 tx=0).stop 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.877+0000 7f1175f89640 1 -- 172.21.15.81:0/2287757151 shutdown_connections 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.877+0000 7f1175f89640 1 --2- 172.21.15.81:0/2287757151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f117015b610 unknown :-1 s=CLOSED pgs=3241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.877+0000 7f1175f89640 1 -- 172.21.15.81:0/2287757151 >> 172.21.15.81:0/2287757151 conn(0x7f11700d0580 msgr2=0x7f11700d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.877+0000 7f1175f89640 1 -- 172.21.15.81:0/2287757151 shutdown_connections 2024-03-18T07:14:44.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.877+0000 7f1175f89640 1 -- 172.21.15.81:0/2287757151 wait complete. 2024-03-18T07:14:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.880+0000 7f1175f89640 1 Processor -- start 2024-03-18T07:14:44.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.881+0000 7f1175f89640 1 -- start start 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700b4760 0x7f1170147060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1170154e30 0x7f1170071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f117006c1d0 con 0x7f1170154a50 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f117006eac0 con 0x7f1170154e30 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f1175f89640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f117006c350 con 0x7f11700b4760 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f116effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f116effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45094/0 (socket says 172.21.15.81:45094) 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f116effd640 1 -- 172.21.15.81:0/1399545917 learned_addr learned my addr 172.21.15.81:0/1399545917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.884+0000 7f116f7fe640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700b4760 0x7f1170147060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116ffff640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1170154e30 0x7f1170071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 -- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700b4760 msgr2=0x7f1170147060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700b4760 0x7f1170147060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 -- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1170154e30 msgr2=0x7f1170071c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:44.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1170154e30 0x7f1170071c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:44.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 -- 172.21.15.81:0/1399545917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11701f7700 con 0x7f1170154a50 2024-03-18T07:14:44.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f116effd640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7f116400c480 tx=0x7f116400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:44.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11640052d0 con 0x7f1170154a50 2024-03-18T07:14:44.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1164005470 con 0x7f1170154a50 2024-03-18T07:14:44.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1164012870 con 0x7f1170154a50 2024-03-18T07:14:44.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.885+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11701475a0 con 0x7f1170154a50 2024-03-18T07:14:44.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.886+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11701f7f60 con 0x7f1170154a50 2024-03-18T07:14:44.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.887+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1164012a10 con 0x7f1170154a50 2024-03-18T07:14:44.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.889+0000 7f1157fff640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 0x7f115c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:44.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.889+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7f116408a660 con 0x7f1170154a50 2024-03-18T07:14:44.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.889+0000 7f116f7fe640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 0x7f115c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:44.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.890+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117004f5b0 con 0x7f1170154a50 2024-03-18T07:14:44.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.892+0000 7f116f7fe640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 0x7f115c06e090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1160038000 tx=0x7f1160032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:44.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:44.917+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1164059140 con 0x7f1170154a50 2024-03-18T07:14:45.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.870+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f117006d840 con 0x7f1170154a50 2024-03-18T07:14:45.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.874+0000 7f1157fff640 1 -- 172.21.15.81:0/1399545917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) ==== 74+0+16681 (secure 0 0 0) 0x7f1164058a40 con 0x7f1170154a50 2024-03-18T07:14:45.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:45.886 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T00:26:16.273398+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T00:26:12.474281+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T00:26:13.585729+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T07:14:45.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.885+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 msgr2=0x7f115c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.885+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 0x7f115c06e090 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1160038000 tx=0x7f1160032000 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.885+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 msgr2=0x7f11700ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.885+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 secure :-1 s=READY pgs=3242 cs=0 l=1 rev1=1 crypto rx=0x7f116400c480 tx=0x7f116400c940 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 shutdown_connections 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1170154e30 0x7f1170071c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f115c06bbd0 0x7f115c06e090 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1170154a50 0x7f11700ca0f0 unknown :-1 s=CLOSED pgs=3242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 --2- 172.21.15.81:0/1399545917 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f11700b4760 0x7f1170147060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 >> 172.21.15.81:0/1399545917 conn(0x7f11700d0580 msgr2=0x7f1170158ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:45.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 shutdown_connections 2024-03-18T07:14:45.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:45.886+0000 7f1175f89640 1 -- 172.21.15.81:0/1399545917 wait complete. 2024-03-18T07:14:45.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T07:14:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 Processor -- start 2024-03-18T07:14:46.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 -- start start 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe71815bf30 0x7fe71815f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71815f710 con 0x7fe7180afbe0 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71806ef60 con 0x7fe71806b1c0 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.150+0000 7fe71ef5b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe718070850 con 0x7fe71815bf30 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.151+0000 7fe717fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fe7180afbe0 0x7fe71806e850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33770/0 (socket says 172.21.15.81:33770) 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.151+0000 7fe717fff640 1 -- 172.21.15.81:0/2912819153 learned_addr learned my addr 172.21.15.81:0/2912819153 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:46.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.151+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe71815bf30 0x7fe71815f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.151+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903392824 0 0) 0x7fe71806ef60 con 0x7fe71806b1c0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.151+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe708003520 con 0x7fe71806b1c0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1129878208 0 0) 0x7fe704001040 con 0x7fe7180afbe0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe71806ef60 con 0x7fe7180afbe0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.1 v1:172.21.15.136:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3744653806 0 0) 0x7fe708003520 con 0x7fe71806b1c0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe71815bf30 msgr2=0x7fe71815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe71815bf30 0x7fe71815f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 >> v1:172.21.15.81:6789/0 conn(0x7fe7180afbe0 legacy=0x7fe71806e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> v1:172.21.15.136:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7180b0080 con 0x7fe71806b1c0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.1 v1:172.21.15.136:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2809608137 0 0) 0x7fe710001970 con 0x7fe71806b1c0 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 >> v1:172.21.15.136:6789/0 conn(0x7fe71806b1c0 legacy=0x7fe71806b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708003c00 0x7fe708004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe708004800 0x7fe708004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7080051c0 0x7fe70800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe718070850 con 0x7fe708003c00 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe70800c090 con 0x7fe7080051c0 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.152+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe70800c290 con 0x7fe708004800 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe708004800 0x7fe708004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe71815bf30 0x7fe71815f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe71d4f8640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7080051c0 0x7fe70800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 -- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7080051c0 msgr2=0x7fe70800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7080051c0 0x7fe70800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 -- 172.21.15.81:0/2912819153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708003c00 msgr2=0x7fe708004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708003c00 0x7fe708004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708003c00 0x7fe708004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.153+0000 7fe717fff640 1 -- 172.21.15.81:0/2912819153 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe708003520 con 0x7fe708004800 2024-03-18T07:14:46.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.154+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708003c00 0x7fe708004000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T07:14:46.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.155+0000 7fe717fff640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe708004800 0x7fe708004c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe704001a80 tx=0x7fe708005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782b20764e15c943 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:46.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.155+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704034030 con 0x7fe708004800 2024-03-18T07:14:46.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.155+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7040048a0 con 0x7fe708004800 2024-03-18T07:14:46.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.155+0000 7fe7177fe640 1 -- 172.21.15.81:0/2912819153 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040016d0 con 0x7fe708004800 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.156+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe708004800 msgr2=0x7fe708004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2912819153 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe708004800 0x7fe708004c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe704001a80 tx=0x7fe708005830 comp rx=0 tx=0).stop 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71d4f8640 1 -- 172.21.15.81:0/2912819153 reap_dead start 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2912819153 shutdown_connections 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2912819153 >> 172.21.15.81:0/2912819153 conn(0x7fe7180d0d30 msgr2=0x7fe7180d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2912819153 shutdown_connections 2024-03-18T07:14:46.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.157+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2912819153 wait complete. 2024-03-18T07:14:46.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.162+0000 7fe71ef5b640 1 Processor -- start 2024-03-18T07:14:46.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.162+0000 7fe71ef5b640 1 -- start start 2024-03-18T07:14:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71ef5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 0x7fe71814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71ef5b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 0x7fe7180cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71ef5b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 0x7fe7180cf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71ccf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 0x7fe71814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71ef5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe71806e050 con 0x7fe708004800 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.166+0000 7fe71d4f8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 0x7fe7180cf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.167+0000 7fe71d4f8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 0x7fe7180cf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55338/0 (socket says 172.21.15.81:55338) 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.167+0000 7fe71d4f8640 1 -- 172.21.15.81:0/2715168707 learned_addr learned my addr 172.21.15.81:0/2715168707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:46.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.167+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe71806e3c0 con 0x7fe7180cdb00 2024-03-18T07:14:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.167+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe71815f1d0 con 0x7fe7180cf340 2024-03-18T07:14:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.167+0000 7fe717fff640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 0x7fe7180cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 -- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 msgr2=0x7fe7180cf7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 0x7fe7180cf7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 -- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 msgr2=0x7fe71814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 0x7fe71814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7180ce5a0 con 0x7fe7180cdb00 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 0x7fe71814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe717fff640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 0x7fe7180cdf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe70800c460 tx=0x7fe7040013d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.168+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7040016d0 con 0x7fe7180cdb00 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.169+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7180ce880 con 0x7fe7180cdb00 2024-03-18T07:14:46.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.169+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181f8420 con 0x7fe7180cdb00 2024-03-18T07:14:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.169+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe704001040 con 0x7fe7180cdb00 2024-03-18T07:14:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.169+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe704007b00 con 0x7fe7180cdb00 2024-03-18T07:14:46.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.170+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6f8005290 con 0x7fe7180cdb00 2024-03-18T07:14:46.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.173+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe704037070 con 0x7fe7180cdb00 2024-03-18T07:14:46.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.174+0000 7fe7157fa640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 0x7fe6fc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:46.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.174+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5709+0+0 (secure 0 0 0) 0x7fe7040ac840 con 0x7fe7180cdb00 2024-03-18T07:14:46.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.175+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 0x7fe6fc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:46.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.177+0000 7fe71ccf7640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 0x7fe6fc06e0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7180731a0 tx=0x7fe70c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:46.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:46.179+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe71815f710 con 0x7fe7180cdb00 2024-03-18T07:14:47.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.283+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fe6f8005850 con 0x7fe7180cdb00 2024-03-18T07:14:47.819 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-03-18T07:14:47.812+0000 7fb7ce611640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-18T07:14:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.834+0000 7fe7157fa640 1 -- 172.21.15.81:0/2715168707 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7fe704004870 con 0x7fe7180cdb00 2024-03-18T07:14:47.840 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T07:14:47.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.838+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 msgr2=0x7fe6fc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:47.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.838+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 0x7fe6fc06e0c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe7180731a0 tx=0x7fe70c008040 comp rx=0 tx=0).stop 2024-03-18T07:14:47.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.838+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 msgr2=0x7fe7180cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:47.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.838+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 0x7fe7180cdf80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe70800c460 tx=0x7fe7040013d0 comp rx=0 tx=0).stop 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 shutdown_connections 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe7180cf340 0x7fe7180cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe7180cdb00 0x7fe7180cdf80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe6fc06bc00 0x7fe6fc06e0c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 --2- 172.21.15.81:0/2715168707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe708004800 0x7fe71814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 >> 172.21.15.81:0/2715168707 conn(0x7fe7180d0d30 msgr2=0x7fe7180b0760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.839+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 shutdown_connections 2024-03-18T07:14:47.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:47.840+0000 7fe71ef5b640 1 -- 172.21.15.81:0/2715168707 wait complete. 2024-03-18T07:14:47.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T07:14:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.149+0000 7f368bf5b640 1 Processor -- start 2024-03-18T07:14:48.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.150+0000 7f368bf5b640 1 -- start start 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368bf5b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36840b0150 0x7f36840ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368bf5b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f368406b8d0 0x7f368415da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368bf5b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3684071ee0 con 0x7f36840ceeb0 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368bf5b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3684072af0 con 0x7f368406b8d0 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368bf5b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f36840721c0 con 0x7f36840b0150 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36840b0150 0x7f36840ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f368a4f8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f368406b8d0 0x7f368415da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f36840b0150 0x7f36840ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:46524/0 (socket says 172.21.15.81:46524) 2024-03-18T07:14:48.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 -- 172.21.15.81:0/172120294 learned_addr learned my addr 172.21.15.81:0/172120294 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:48.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f36894f6640 1 --1- 172.21.15.81:0/172120294 >> v1:172.21.15.136:6789/0 conn(0x7f36840ceeb0 0x7f368406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:33554/0 (socket says 172.21.15.81:33554) 2024-03-18T07:14:48.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 -- 172.21.15.81:0/172120294 >> v2:172.21.15.81:3300/0 conn(0x7f368406b8d0 msgr2=0x7f368415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 --2- 172.21.15.81:0/172120294 >> v2:172.21.15.81:3300/0 conn(0x7f368406b8d0 0x7f368415da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 -- 172.21.15.81:0/172120294 >> v1:172.21.15.136:6789/0 conn(0x7f36840ceeb0 legacy=0x7f368406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.152+0000 7f3689cf7640 1 -- 172.21.15.81:0/172120294 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36840724a0 con 0x7f36840b0150 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.153+0000 7f3689cf7640 1 --2- 172.21.15.81:0/172120294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36840ce970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36840c7e20 tx=0x7f368002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2408062185759271 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.153+0000 7f3688cf5640 1 -- 172.21.15.81:0/172120294 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f368002ca80 con 0x7f36840b0150 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f3688cf5640 1 -- 172.21.15.81:0/172120294 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368002cc20 con 0x7f36840b0150 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f3688cf5640 1 -- 172.21.15.81:0/172120294 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36800343f0 con 0x7f36840b0150 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 -- 172.21.15.81:0/172120294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 msgr2=0x7f36840ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 --2- 172.21.15.81:0/172120294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36840ce970 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f36840c7e20 tx=0x7f368002bee0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 -- 172.21.15.81:0/172120294 shutdown_connections 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 --2- 172.21.15.81:0/172120294 >> v2:172.21.15.81:3300/0 conn(0x7f368406b8d0 0x7f368415da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 --2- 172.21.15.81:0/172120294 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36840ce970 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 -- 172.21.15.81:0/172120294 >> 172.21.15.81:0/172120294 conn(0x7f36840d0da0 msgr2=0x7f36840d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 -- 172.21.15.81:0/172120294 shutdown_connections 2024-03-18T07:14:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.154+0000 7f368bf5b640 1 -- 172.21.15.81:0/172120294 wait complete. 2024-03-18T07:14:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.155+0000 7f368bf5b640 1 Processor -- start 2024-03-18T07:14:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 -- start start 2024-03-18T07:14:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36841f43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36840ceeb0 0x7f36841501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36840b0530 con 0x7f36840ceeb0 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f36840d0900 con 0x7f36840b0150 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368bf5b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f36840b06b0 con 0x7f368406b8d0 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f36894f6640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36841f43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55350/0 (socket says 172.21.15.81:55350) 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 -- 172.21.15.81:0/1868512663 learned_addr learned my addr 172.21.15.81:0/1868512663 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.156+0000 7f368a4f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36840ceeb0 0x7f36841501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 -- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 msgr2=0x7f36841f43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36841f43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 -- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36840ceeb0 msgr2=0x7f36841501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36840ceeb0 0x7f36841501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 -- 172.21.15.81:0/1868512663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36841f4b40 con 0x7f368406b8d0 2024-03-18T07:14:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f3689cf7640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3680036040 tx=0x7f3680004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:48.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680043020 con 0x7f368406b8d0 2024-03-18T07:14:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f368003e450 con 0x7f368406b8d0 2024-03-18T07:14:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36841f4e20 con 0x7f368406b8d0 2024-03-18T07:14:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.157+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3680009510 con 0x7f368406b8d0 2024-03-18T07:14:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.158+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f36840c4ae0 con 0x7f368406b8d0 2024-03-18T07:14:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.159+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3684062e10 con 0x7f368406b8d0 2024-03-18T07:14:48.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.160+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3680046020 con 0x7f368406b8d0 2024-03-18T07:14:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.161+0000 7f367a7fc640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 0x7f366806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:48.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.162+0000 7f36894f6640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 0x7f366806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.162+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f36800ad0b0 con 0x7f368406b8d0 2024-03-18T07:14:48.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.162+0000 7f36894f6640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 0x7f366806e0c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36840afab0 tx=0x7f3674000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:48.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.166+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3684062e10 con 0x7f368406b8d0 2024-03-18T07:14:48.267 INFO:tasks.ceph.mds.d.smithi136.stdout:starting mds.d at 2024-03-18T07:14:48.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:48.385+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f368404f540 con 0x7f368406b8d0 2024-03-18T07:14:49.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.109+0000 7f367a7fc640 1 -- 172.21.15.81:0/1868512663 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f368004d030 con 0x7f368406b8d0 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 msgr2=0x7f366806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 0x7f366806e0c0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f36840afab0 tx=0x7f3674000ed0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 msgr2=0x7f368415caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3680036040 tx=0x7f3680004a40 comp rx=0 tx=0).stop 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 shutdown_connections 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f366806bc00 0x7f366806e0c0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36840ceeb0 0x7f36841501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f36840b0150 0x7f36841f43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 --2- 172.21.15.81:0/1868512663 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f368406b8d0 0x7f368415caa0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 >> 172.21.15.81:0/1868512663 conn(0x7f36840d0da0 msgr2=0x7f36840b14e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 shutdown_connections 2024-03-18T07:14:49.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.113+0000 7f368bf5b640 1 -- 172.21.15.81:0/1868512663 wait complete. 2024-03-18T07:14:49.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T07:14:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.389+0000 7f3fa9819640 1 Processor -- start 2024-03-18T07:14:49.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.389+0000 7f3fa9819640 1 -- start start 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa9819640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa9819640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f3fa40afe80 0x7f3fa4151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa9819640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa406e1f0 con 0x7f3fa415f020 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa9819640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa406e4d0 con 0x7f3fa40afe80 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa9819640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa406e7b0 con 0x7f3fa415ec40 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55358/0 (socket says 172.21.15.81:55358) 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/362447061 learned_addr learned my addr 172.21.15.81:0/362447061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:49.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa27fc640 1 --2- 172.21.15.81:0/362447061 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40afe80 0x7f3fa4151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/362447061 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40afe80 msgr2=0x7f3fa4151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 --2- 172.21.15.81:0/362447061 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40afe80 0x7f3fa4151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/362447061 >> v1:172.21.15.81:6789/0 conn(0x7f3fa415f020 legacy=0x7f3fa4151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.392+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/362447061 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa406ea90 con 0x7f3fa415ec40 2024-03-18T07:14:49.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.393+0000 7f3fa2ffd640 1 --2- 172.21.15.81:0/362447061 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009e50 tx=0x7f3f9402bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2c846bdaa1b3672 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.394+0000 7f3fa1ffb640 1 -- 172.21.15.81:0/362447061 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f9402ca80 con 0x7f3fa415ec40 2024-03-18T07:14:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.394+0000 7f3fa1ffb640 1 -- 172.21.15.81:0/362447061 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9402cc20 con 0x7f3fa415ec40 2024-03-18T07:14:49.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.394+0000 7f3fa1ffb640 1 -- 172.21.15.81:0/362447061 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f940343f0 con 0x7f3fa415ec40 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 -- 172.21.15.81:0/362447061 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 msgr2=0x7f3fa40af940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 --2- 172.21.15.81:0/362447061 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3f94009e50 tx=0x7f3f9402bee0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 -- 172.21.15.81:0/362447061 shutdown_connections 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 --2- 172.21.15.81:0/362447061 >> v2:172.21.15.136:3300/0 conn(0x7f3fa40afe80 0x7f3fa4151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 --2- 172.21.15.81:0/362447061 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa40af940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 -- 172.21.15.81:0/362447061 >> 172.21.15.81:0/362447061 conn(0x7f3fa40d0540 msgr2=0x7f3fa40d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:49.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 -- 172.21.15.81:0/362447061 shutdown_connections 2024-03-18T07:14:49.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.395+0000 7f3fa9819640 1 -- 172.21.15.81:0/362447061 wait complete. 2024-03-18T07:14:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.398+0000 7f3fa9819640 1 Processor -- start 2024-03-18T07:14:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.399+0000 7f3fa9819640 1 -- start start 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.400+0000 7f3fa9819640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.400+0000 7f3fa9819640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa9819640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fa415f020 0x7f3fa41f0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa9819640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa415f7d0 con 0x7f3fa415f020 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa9819640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa415f650 con 0x7f3fa40afe80 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa9819640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa40b35f0 con 0x7f3fa415ec40 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa27fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:46552/0 (socket says 172.21.15.81:46552) 2024-03-18T07:14:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa27fc640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55370/0 (socket says 172.21.15.81:55370) 2024-03-18T07:14:49.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/3184028215 learned_addr learned my addr 172.21.15.81:0/3184028215 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:49.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa37fe640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fa415f020 0x7f3fa41f0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 msgr2=0x7f3fa415b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fa415f020 msgr2=0x7f3fa41f0db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fa415f020 0x7f3fa41f0db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa2ffd640 1 -- 172.21.15.81:0/3184028215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa415d130 con 0x7f3fa40afe80 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.401+0000 7f3fa27fc640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3fa2ffd640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036040 tx=0x7f3f94004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94043020 con 0x7f3fa40afe80 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f9403e450 con 0x7f3fa40afe80 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f94009510 con 0x7f3fa40afe80 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa415c090 con 0x7f3fa40afe80 2024-03-18T07:14:49.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.402+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa415c650 con 0x7f3fa40afe80 2024-03-18T07:14:49.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.404+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa404f540 con 0x7f3fa40afe80 2024-03-18T07:14:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.405+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3f94005d10 con 0x7f3fa40afe80 2024-03-18T07:14:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.406+0000 7f3f8bfff640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 0x7f3f9006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:49.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.406+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5795+0+0 (secure 0 0 0) 0x7f3f940ad320 con 0x7f3fa40afe80 2024-03-18T07:14:49.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.406+0000 7f3fa27fc640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 0x7f3f9006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:49.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.407+0000 7f3fa27fc640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 0x7f3f9006e0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40cfd40 tx=0x7f3f98009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:49.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.410+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3f9407b890 con 0x7f3fa40afe80 2024-03-18T07:14:49.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:49.587+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3fa40d1370 con 0x7f3fa40afe80 2024-03-18T07:14:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.121+0000 7f3f8bfff640 1 -- 172.21.15.81:0/3184028215 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v34) ==== 181+0+0 (secure 0 0 0) 0x7f3f9407f930 con 0x7f3fa40afe80 2024-03-18T07:14:50.127 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 msgr2=0x7f3f9006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 0x7f3f9006e0c0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3fa40cfd40 tx=0x7f3f98009190 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 msgr2=0x7f3fa4150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3f94036040 tx=0x7f3f94004a40 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 shutdown_connections 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3f9006bc00 0x7f3f9006e0c0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3fa415f020 0x7f3fa41f0db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3fa415ec40 0x7f3fa415b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 --2- 172.21.15.81:0/3184028215 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3fa40afe80 0x7f3fa4150590 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.126+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 >> 172.21.15.81:0/3184028215 conn(0x7f3fa40d0540 msgr2=0x7f3fa40ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.127+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 shutdown_connections 2024-03-18T07:14:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.127+0000 7f3fa9819640 1 -- 172.21.15.81:0/3184028215 wait complete. 2024-03-18T07:14:50.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T07:14:50.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.520+0000 7f011d51b640 1 Processor -- start 2024-03-18T07:14:50.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.521+0000 7f011d51b640 1 -- start start 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f011d51b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0118072320 0x7f0118165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f0116ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f011815dc40 0x7f01180b3560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33788/0 (socket says 172.21.15.81:33788) 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f0116ffd640 1 -- 172.21.15.81:0/517979701 learned_addr learned my addr 172.21.15.81:0/517979701 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011806b3d0 con 0x7f011815dc40 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011806b6b0 con 0x7f01180afce0 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f01177fe640 1 --2- 172.21.15.81:0/517979701 >> v2:172.21.15.136:3300/0 conn(0x7f0118072320 0x7f0118165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f011806c190 con 0x7f0118072320 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f0115ffb640 1 -- 172.21.15.81:0/517979701 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209500885 0 0) 0x7f011806b3d0 con 0x7f011815dc40 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.524+0000 7f0115ffb640 1 -- 172.21.15.81:0/517979701 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0100003520 con 0x7f011815dc40 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.525+0000 7f01177fe640 1 -- 172.21.15.81:0/517979701 >> v1:172.21.15.136:6789/0 conn(0x7f01180afce0 legacy=0x7f0118071c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.525+0000 7f01177fe640 1 -- 172.21.15.81:0/517979701 >> v1:172.21.15.81:6789/0 conn(0x7f011815dc40 legacy=0x7f01180b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.525+0000 7f01177fe640 1 -- 172.21.15.81:0/517979701 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011806b990 con 0x7f0118072320 2024-03-18T07:14:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.526+0000 7f01177fe640 1 --2- 172.21.15.81:0/517979701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f0118165370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0110009d90 tx=0x7f011002bf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68486bfab432191f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.526+0000 7f0115ffb640 1 -- 172.21.15.81:0/517979701 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110039070 con 0x7f0118072320 2024-03-18T07:14:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.526+0000 7f0115ffb640 1 -- 172.21.15.81:0/517979701 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011002ccf0 con 0x7f0118072320 2024-03-18T07:14:50.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.526+0000 7f0115ffb640 1 -- 172.21.15.81:0/517979701 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0110034660 con 0x7f0118072320 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 msgr2=0x7f0118165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 --2- 172.21.15.81:0/517979701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f0118165370 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0110009d90 tx=0x7f011002bf40 comp rx=0 tx=0).stop 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 shutdown_connections 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 --2- 172.21.15.81:0/517979701 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f0118165370 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 >> 172.21.15.81:0/517979701 conn(0x7f01180b2680 msgr2=0x7f01180b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 shutdown_connections 2024-03-18T07:14:50.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.527+0000 7f011d51b640 1 -- 172.21.15.81:0/517979701 wait complete. 2024-03-18T07:14:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.528+0000 7f011d51b640 1 Processor -- start 2024-03-18T07:14:50.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.528+0000 7f011d51b640 1 -- start start 2024-03-18T07:14:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f011813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 0x7f011814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:50.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 0x7f01181599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0118066f10 con 0x7f011815dc40 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f011806bd00 con 0x7f0118072320 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.529+0000 7f011d51b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0118067090 con 0x7f01180afce0 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 0x7f01181599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 0x7f01181599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35760/0 (socket says 172.21.15.81:35760) 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f0116ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f011813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01177fe640 1 -- 172.21.15.81:0/1139266155 learned_addr learned my addr 172.21.15.81:0/1139266155 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:50.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 0x7f011814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 -- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 msgr2=0x7f011813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f011813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 -- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 msgr2=0x7f01181599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 0x7f01181599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 -- 172.21.15.81:0/1139266155 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011813be50 con 0x7f01180afce0 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.530+0000 7f01167fc640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 0x7f011814fec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f010c0016e0 tx=0x7f010c001ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.531+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c0050d0 con 0x7f01180afce0 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.531+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f010c005270 con 0x7f01180afce0 2024-03-18T07:14:50.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.531+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010c010630 con 0x7f01180afce0 2024-03-18T07:14:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.531+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011813c0f0 con 0x7f01180afce0 2024-03-18T07:14:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.531+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f011813c6b0 con 0x7f01180afce0 2024-03-18T07:14:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.532+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011804f540 con 0x7f01180afce0 2024-03-18T07:14:50.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.533+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f010c0107d0 con 0x7f01180afce0 2024-03-18T07:14:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.533+0000 7f00ff7fe640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 0x7f010406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.533+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(34..34 src has 1..34) ==== 5357+0+0 (secure 0 0 0) 0x7f010c08e210 con 0x7f01180afce0 2024-03-18T07:14:50.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.533+0000 7f0116ffd640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 0x7f010406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:50.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.534+0000 7f0116ffd640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 0x7f010406e090 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f01080011e0 tx=0x7f0108007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:50.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.538+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f010c05c8a0 con 0x7f01180afce0 2024-03-18T07:14:50.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:50.840+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0118067a10 con 0x7f01180afce0 2024-03-18T07:14:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.128+0000 7f00ff7fe640 1 -- 172.21.15.81:0/1139266155 <== mon.2 v2:172.21.15.136:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v35) ==== 169+0+0 (secure 0 0 0) 0x7f010c060940 con 0x7f01180afce0 2024-03-18T07:14:51.135 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 msgr2=0x7f010406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 0x7f010406e090 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f01080011e0 tx=0x7f0108007d30 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 msgr2=0x7f011814fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 0x7f011814fec0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f010c0016e0 tx=0x7f010c001ba0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 shutdown_connections 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f010406bbd0 0x7f010406e090 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f011815dc40 0x7f01181599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f01180afce0 0x7f011814fec0 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f010c0016e0 tx=0x7f010c001ba0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 --2- 172.21.15.81:0/1139266155 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0118072320 0x7f011813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.136+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 >> 172.21.15.81:0/1139266155 conn(0x7f01180b2680 msgr2=0x7f01180b3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:51.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.137+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 shutdown_connections 2024-03-18T07:14:51.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.137+0000 7f011d51b640 1 -- 172.21.15.81:0/1139266155 wait complete. 2024-03-18T07:14:51.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-18T07:14:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.375+0000 7f79dc085640 1 Processor -- start 2024-03-18T07:14:51.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.375+0000 7f79dc085640 1 -- start start 2024-03-18T07:14:51.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.378+0000 7f79dc085640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.378+0000 7f79dc085640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.378+0000 7f79d9e21640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f79d406bbd0 0x7f79d406bfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:33564/0 (socket says 172.21.15.81:33564) 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79d9620640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79da622640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79d9620640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55398/0 (socket says 172.21.15.81:55398) 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79da622640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35764/0 (socket says 172.21.15.81:35764) 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79dc085640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79d415ad10 con 0x7f79d406bbd0 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79dc085640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f79d40cab60 con 0x7f79d40ccd90 2024-03-18T07:14:51.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79d9e21640 1 -- 172.21.15.81:0/3872425043 learned_addr learned my addr 172.21.15.81:0/3872425043 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:51.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.379+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40b1b40 con 0x7f79d40732a0 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.380+0000 7f79d9620640 1 -- 172.21.15.81:0/3872425043 >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 msgr2=0x7f79d40cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.380+0000 7f79d9620640 1 --2- 172.21.15.81:0/3872425043 >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.380+0000 7f79d9620640 1 -- 172.21.15.81:0/3872425043 >> v1:172.21.15.136:6789/0 conn(0x7f79d406bbd0 legacy=0x7f79d406bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.380+0000 7f79d9620640 1 -- 172.21.15.81:0/3872425043 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d40b0c90 con 0x7f79d40732a0 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.381+0000 7f79da622640 1 --2- 172.21.15.81:0/3872425043 >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.383+0000 7f79d9620640 1 --2- 172.21.15.81:0/3872425043 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c400dbc0 tx=0x7f79c402fc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=599acfed9f28474f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.384+0000 7f79d8e1f640 1 -- 172.21.15.81:0/3872425043 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c40307e0 con 0x7f79d40732a0 2024-03-18T07:14:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.384+0000 7f79d8e1f640 1 -- 172.21.15.81:0/3872425043 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79c4030980 con 0x7f79d40732a0 2024-03-18T07:14:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.384+0000 7f79d8e1f640 1 -- 172.21.15.81:0/3872425043 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c4030d50 con 0x7f79d40732a0 2024-03-18T07:14:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.386+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 msgr2=0x7f79d40d1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.386+0000 7f79dc085640 1 --2- 172.21.15.81:0/3872425043 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79c400dbc0 tx=0x7f79c402fc40 comp rx=0 tx=0).stop 2024-03-18T07:14:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.392+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 shutdown_connections 2024-03-18T07:14:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.392+0000 7f79dc085640 1 --2- 172.21.15.81:0/3872425043 >> v2:172.21.15.81:3300/0 conn(0x7f79d40ccd90 0x7f79d40cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.392+0000 7f79dc085640 1 --2- 172.21.15.81:0/3872425043 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40d1030 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.392+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 >> 172.21.15.81:0/3872425043 conn(0x7f79d40d0510 msgr2=0x7f79d40d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:51.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.395+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 shutdown_connections 2024-03-18T07:14:51.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.395+0000 7f79dc085640 1 -- 172.21.15.81:0/3872425043 wait complete. 2024-03-18T07:14:51.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.400+0000 7f79dc085640 1 Processor -- start 2024-03-18T07:14:51.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.403+0000 7f79dc085640 1 -- start start 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79d406bbd0 0x7f79d40c6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 0x7f79d40c60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40b1210 con 0x7f79d406bbd0 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f79d40736c0 con 0x7f79d40ccd90 2024-03-18T07:14:51.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.407+0000 7f79dc085640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f79d40b14f0 con 0x7f79d40732a0 2024-03-18T07:14:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.408+0000 7f79d9620640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.408+0000 7f79d9620640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:55404/0 (socket says 172.21.15.81:55404) 2024-03-18T07:14:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.408+0000 7f79d9620640 1 -- 172.21.15.81:0/531046564 learned_addr learned my addr 172.21.15.81:0/531046564 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:51.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.408+0000 7f79da622640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 0x7f79d40c60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 -- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 msgr2=0x7f79d40c5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40c5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 -- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79d406bbd0 msgr2=0x7f79d40c6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79d406bbd0 0x7f79d40c6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 -- 172.21.15.81:0/531046564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79d40c7240 con 0x7f79d40ccd90 2024-03-18T07:14:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79da622640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 0x7f79d40c60e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79cc007e60 tx=0x7f79cc00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc01a070 con 0x7f79d40ccd90 2024-03-18T07:14:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79cc003b90 con 0x7f79d40ccd90 2024-03-18T07:14:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.409+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79cc004030 con 0x7f79d40ccd90 2024-03-18T07:14:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.410+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d415af00 con 0x7f79d40ccd90 2024-03-18T07:14:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.410+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79d415b4c0 con 0x7f79d40ccd90 2024-03-18T07:14:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.412+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f79cc01d070 con 0x7f79d40ccd90 2024-03-18T07:14:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.412+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79d404f540 con 0x7f79d40ccd90 2024-03-18T07:14:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.412+0000 7f79ca7fc640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 0x7f79b806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:51.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.412+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f79cc08a930 con 0x7f79d40ccd90 2024-03-18T07:14:51.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.415+0000 7f79d9e21640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 0x7f79b806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:51.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.416+0000 7f79d9e21640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 0x7f79b806e090 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007230 tx=0x7f79d0006b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:51.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.420+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f79cc010070 con 0x7f79d40ccd90 2024-03-18T07:14:51.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.764+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f79d40b49e0 con 0x7f79d40ccd90 2024-03-18T07:14:51.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.792+0000 7f79ca7fc640 1 -- 172.21.15.81:0/531046564 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f79cc0590c0 con 0x7f79d40ccd90 2024-03-18T07:14:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.800+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 msgr2=0x7f79b806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.800+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 0x7f79b806e090 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007230 tx=0x7f79d0006b80 comp rx=0 tx=0).stop 2024-03-18T07:14:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.800+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 msgr2=0x7f79d40c60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:51.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.800+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 0x7f79d40c60e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79cc007e60 tx=0x7f79cc00d4a0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 shutdown_connections 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f79d40ccd90 0x7f79d40c60e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f79d40732a0 0x7f79d40c5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f79b806bbd0 0x7f79b806e090 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 --2- 172.21.15.81:0/531046564 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79d406bbd0 0x7f79d40c6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 >> 172.21.15.81:0/531046564 conn(0x7f79d40d0510 msgr2=0x7f79d406bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 shutdown_connections 2024-03-18T07:14:51.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:51.801+0000 7f79dc085640 1 -- 172.21.15.81:0/531046564 wait complete. 2024-03-18T07:14:51.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-18T07:14:52.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.065+0000 7fe982d37640 1 Processor -- start 2024-03-18T07:14:52.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.065+0000 7fe982d37640 1 -- start start 2024-03-18T07:14:52.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.070+0000 7fe982d37640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe97c0b32d0 0x7fe97c06bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.070+0000 7fe982d37640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe97c0cf850 0x7fe97c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.070+0000 7fe982d37640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe97c0d15f0 con 0x7fe97c15e500 2024-03-18T07:14:52.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.070+0000 7fe982d37640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c0cf3c0 con 0x7fe97c0cf850 2024-03-18T07:14:52.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.070+0000 7fe982d37640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe97c0d18d0 con 0x7fe97c0b32d0 2024-03-18T07:14:52.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.071+0000 7fe97bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe97c0b32d0 0x7fe97c06bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.071+0000 7fe97bfff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe97c0b32d0 0x7fe97c06bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:46580/0 (socket says 172.21.15.81:46580) 2024-03-18T07:14:52.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.071+0000 7fe97bfff640 1 -- 172.21.15.81:0/2288843521 learned_addr learned my addr 172.21.15.81:0/2288843521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:52.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.071+0000 7fe9812d4640 1 --2- 172.21.15.81:0/2288843521 >> v2:172.21.15.81:3300/0 conn(0x7fe97c0cf850 0x7fe97c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.073+0000 7fe97bfff640 1 -- 172.21.15.81:0/2288843521 >> v2:172.21.15.81:3300/0 conn(0x7fe97c0cf850 msgr2=0x7fe97c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:52.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.073+0000 7fe97bfff640 1 --2- 172.21.15.81:0/2288843521 >> v2:172.21.15.81:3300/0 conn(0x7fe97c0cf850 0x7fe97c0cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.073+0000 7fe97bfff640 1 -- 172.21.15.81:0/2288843521 >> v1:172.21.15.81:6789/0 conn(0x7fe97c15e500 legacy=0x7fe97c0d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:52.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.073+0000 7fe97bfff640 1 -- 172.21.15.81:0/2288843521 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0cf050 con 0x7fe97c0b32d0 2024-03-18T07:14:52.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.082+0000 7fe97bfff640 1 --2- 172.21.15.81:0/2288843521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c0b32d0 0x7fe97c06bf90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe97c08e8c0 tx=0x7fe96402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1d225d7f038e0e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:52.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.082+0000 7fe97b7fe640 1 -- 172.21.15.81:0/2288843521 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964034070 con 0x7fe97c0b32d0 2024-03-18T07:14:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.083+0000 7fe97b7fe640 1 -- 172.21.15.81:0/2288843521 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964030870 con 0x7fe97c0b32d0 2024-03-18T07:14:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.083+0000 7fe97b7fe640 1 -- 172.21.15.81:0/2288843521 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964030c40 con 0x7fe97c0b32d0 2024-03-18T07:14:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.085+0000 7fe982d37640 1 -- 172.21.15.81:0/2288843521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c0b32d0 msgr2=0x7fe97c06bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:52.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.085+0000 7fe982d37640 1 --2- 172.21.15.81:0/2288843521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c0b32d0 0x7fe97c06bf90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe97c08e8c0 tx=0x7fe96402b9b0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.089+0000 7fe982d37640 1 -- 172.21.15.81:0/2288843521 shutdown_connections 2024-03-18T07:14:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.089+0000 7fe982d37640 1 --2- 172.21.15.81:0/2288843521 >> v2:172.21.15.81:3300/0 conn(0x7fe97c0cf850 0x7fe97c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.089+0000 7fe982d37640 1 --2- 172.21.15.81:0/2288843521 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c0b32d0 0x7fe97c06bf90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.089+0000 7fe982d37640 1 -- 172.21.15.81:0/2288843521 >> 172.21.15.81:0/2288843521 conn(0x7fe97c0d40f0 msgr2=0x7fe97c0d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:52.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.090+0000 7fe982d37640 1 -- 172.21.15.81:0/2288843521 shutdown_connections 2024-03-18T07:14:52.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.091+0000 7fe982d37640 1 -- 172.21.15.81:0/2288843521 wait complete. 2024-03-18T07:14:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.095+0000 7fe982d37640 1 Processor -- start 2024-03-18T07:14:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.095+0000 7fe982d37640 1 -- start start 2024-03-18T07:14:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.098+0000 7fe982d37640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe97c0b32d0 0x7fe97c14f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.098+0000 7fe982d37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe982d37640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c15e500 0x7fe97c14e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe982d37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d13b0 con 0x7fe97c0cf850 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe982d37640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c0d1230 con 0x7fe97c15e500 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe982d37640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c0d2700 con 0x7fe97c0b32d0 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe97bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35792/0 (socket says 172.21.15.81:35792) 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe97bfff640 1 -- 172.21.15.81:0/3876507498 learned_addr learned my addr 172.21.15.81:0/3876507498 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe9812d4640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c15e500 0x7fe97c14e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.099+0000 7fe980ad3640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe97c0b32d0 0x7fe97c14f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.100+0000 7fe97bfff640 1 -- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe97c0b32d0 msgr2=0x7fe97c14f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.100+0000 7fe97bfff640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe97c0b32d0 0x7fe97c14f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.100+0000 7fe97bfff640 1 -- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c15e500 msgr2=0x7fe97c14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.100+0000 7fe97bfff640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c15e500 0x7fe97c14e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.100+0000 7fe97bfff640 1 -- 172.21.15.81:0/3876507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c0c6aa0 con 0x7fe97c0cf850 2024-03-18T07:14:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.105+0000 7fe97bfff640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fe96402b9f0 tx=0x7fe9640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.106+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964034040 con 0x7fe97c0cf850 2024-03-18T07:14:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.106+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97c0c6d70 con 0x7fe97c0cf850 2024-03-18T07:14:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.106+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe97c0c7330 con 0x7fe97c0cf850 2024-03-18T07:14:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.106+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964039d90 con 0x7fe97c0cf850 2024-03-18T07:14:52.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.106+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964043610 con 0x7fe97c0cf850 2024-03-18T07:14:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.114+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe96404a060 con 0x7fe97c0cf850 2024-03-18T07:14:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.115+0000 7fe9797fa640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 0x7fe95c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.116+0000 7fe980ad3640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 0x7fe95c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:52.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.118+0000 7fe980ad3640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 0x7fe95c06e090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0ca960 tx=0x7fe96c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:52.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.119+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe964078ef0 con 0x7fe97c0cf850 2024-03-18T07:14:52.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.121+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe960005290 con 0x7fe97c0cf850 2024-03-18T07:14:52.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:52.147+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe96403e070 con 0x7fe97c0cf850 2024-03-18T07:14:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:53.609+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7fe960005580 con 0x7fe97c0cf850 2024-03-18T07:14:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.176+0000 7fe9797fa640 1 -- 172.21.15.81:0/3876507498 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v12360) ==== 144+0+0 (secure 0 0 0) 0x7fe96403e070 con 0x7fe97c0cf850 2024-03-18T07:14:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.191+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 msgr2=0x7fe95c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.191+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 0x7fe95c06e090 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0ca960 tx=0x7fe96c009040 comp rx=0 tx=0).stop 2024-03-18T07:14:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.191+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 msgr2=0x7fe97c0c6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:54.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.191+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 secure :-1 s=READY pgs=3248 cs=0 l=1 rev1=1 crypto rx=0x7fe96402b9f0 tx=0x7fe9640046c0 comp rx=0 tx=0).stop 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 shutdown_connections 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe97c15e500 0x7fe97c14e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe95c06bbd0 0x7fe95c06e090 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe97c0cf850 0x7fe97c0c6560 unknown :-1 s=CLOSED pgs=3248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 --2- 172.21.15.81:0/3876507498 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe97c0b32d0 0x7fe97c14f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:54.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.192+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 >> 172.21.15.81:0/3876507498 conn(0x7fe97c0d40f0 msgr2=0x7fe97c0b5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.195+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 shutdown_connections 2024-03-18T07:14:54.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:54.195+0000 7fe982d37640 1 -- 172.21.15.81:0/3876507498 wait complete. 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner: 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-18T07:14:54.477 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:Ran 1 test in 24542.667s 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner: 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-18T07:14:54.478 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-03-18T07:14:54.479 INFO:tasks.cephfs_test_runner: 2024-03-18T07:14:54.479 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T07:14:55.011 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=8bdcef48c45d495eb116e188eff77e0d Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c382027d5c66ef4e0aa1131ea3e8080c658d3184/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T07:14:55.013 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-18T07:14:55.023 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-18T07:14:55.033 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-18T07:14:55.033 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T07:14:55.033 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:55.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056371,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16637 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T07:14:55.089 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-03-18T07:14:55.089 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:55.159 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056371,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=16637 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T07:14:55.160 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T07:14:55.160 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:55.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056362,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18685 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T07:14:55.175 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-03-18T07:14:55.175 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T07:14:55.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056362,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18685 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T07:14:55.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.231 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T07:14:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-18T07:14:55.568 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T07:14:55.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T07:14:55.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T07:14:55.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.796 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-03-18T07:14:55.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.921 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-03-18T07:14:55.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:55.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-03-18T07:14:56.174 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-03-18T07:14:56.176 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:14:56.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.176 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T07:14:56.235 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-18T07:14:56.235 INFO:teuthology.orchestra.run.smithi136.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-18T07:14:56.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.235 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-18T07:14:56.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.263 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T07:14:56.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.333 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-03-18T07:14:56.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.492 DEBUG:teuthology.orchestra.run.smithi136:> ip netns list 2024-03-18T07:14:56.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T07:14:56.507 DEBUG:teuthology.orchestra.run.smithi136:> sudo ip link delete ceph-brx 2024-03-18T07:14:56.781 INFO:teuthology.orchestra.run.smithi136.stderr:Cannot find device "ceph-brx" 2024-03-18T07:14:56.782 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:14:56.783 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-18T07:14:56.792 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T07:14:56.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T07:14:57.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.082+0000 7f6b09310640 1 Processor -- start 2024-03-18T07:14:57.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.082+0000 7f6b09310640 1 -- start start 2024-03-18T07:14:57.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b09310640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6b0406fab0 0x7f6b0406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b09310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 0x7f6b040cc530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b09310640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b040b1750 con 0x7f6b0406f2b0 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b09310640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f6b041629b0 con 0x7f6b0406fab0 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b09310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6b04162ee0 con 0x7f6b040d2a00 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.084+0000 7f6b02ffd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f6b0406fab0 0x7f6b0406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6afa7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6b0406f2b0 0x7f6b040d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34904/0 (socket says 172.21.15.81:34904) 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6afa7fc640 1 -- 172.21.15.81:0/4108694127 learned_addr learned my addr 172.21.15.81:0/4108694127 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6b037fe640 1 --2- 172.21.15.81:0/4108694127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 0x7f6b040cc530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6b037fe640 1 -- 172.21.15.81:0/4108694127 >> v2:172.21.15.136:3300/0 conn(0x7f6b0406fab0 msgr2=0x7f6b0406fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6b037fe640 1 --2- 172.21.15.81:0/4108694127 >> v2:172.21.15.136:3300/0 conn(0x7f6b0406fab0 0x7f6b0406fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6b037fe640 1 -- 172.21.15.81:0/4108694127 >> v1:172.21.15.81:6789/0 conn(0x7f6b0406f2b0 legacy=0x7f6b040d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.085+0000 7f6b037fe640 1 -- 172.21.15.81:0/4108694127 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b040703d0 con 0x7f6b040d2a00 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.086+0000 7f6b037fe640 1 --2- 172.21.15.81:0/4108694127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 0x7f6b040cc530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0097a0 tx=0x7f6afc02b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4ea16fc55714560 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.086+0000 7f6b027fc640 1 -- 172.21.15.81:0/4108694127 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc035020 con 0x7f6b040d2a00 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.087+0000 7f6b027fc640 1 -- 172.21.15.81:0/4108694127 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6afc031810 con 0x7f6b040d2a00 2024-03-18T07:14:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.087+0000 7f6b027fc640 1 -- 172.21.15.81:0/4108694127 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6afc031be0 con 0x7f6b040d2a00 2024-03-18T07:14:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 -- 172.21.15.81:0/4108694127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 msgr2=0x7f6b040cc530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 --2- 172.21.15.81:0/4108694127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 0x7f6b040cc530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0097a0 tx=0x7f6afc02b8b0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 -- 172.21.15.81:0/4108694127 shutdown_connections 2024-03-18T07:14:57.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 --2- 172.21.15.81:0/4108694127 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b040d2a00 0x7f6b040cc530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 --2- 172.21.15.81:0/4108694127 >> v2:172.21.15.136:3300/0 conn(0x7f6b0406fab0 0x7f6b0406fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 -- 172.21.15.81:0/4108694127 >> 172.21.15.81:0/4108694127 conn(0x7f6b040d1ee0 msgr2=0x7f6b040d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 -- 172.21.15.81:0/4108694127 shutdown_connections 2024-03-18T07:14:57.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.088+0000 7f6b09310640 1 -- 172.21.15.81:0/4108694127 wait complete. 2024-03-18T07:14:57.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.091+0000 7f6b09310640 1 Processor -- start 2024-03-18T07:14:57.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.092+0000 7f6b09310640 1 -- start start 2024-03-18T07:14:57.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0406f2b0 0x7f6b04155730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b040d2a00 0x7f6b041ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04162c00 con 0x7f6b0406fab0 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f6b04161d70 con 0x7f6b040d2a00 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b09310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f6b040d02e0 con 0x7f6b0406f2b0 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6afa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6afa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56346/0 (socket says 172.21.15.81:56346) 2024-03-18T07:14:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6afa7fc640 1 -- 172.21.15.81:0/2885012253 learned_addr learned my addr 172.21.15.81:0/2885012253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b02ffd640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0406f2b0 0x7f6b04155730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.094+0000 7f6b037fe640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b040d2a00 0x7f6b041ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 -- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0406f2b0 msgr2=0x7f6b04155730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0406f2b0 0x7f6b04155730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 -- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b040d2a00 msgr2=0x7f6b041ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b040d2a00 0x7f6b041ea690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 -- 172.21.15.81:0/2885012253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b04155c70 con 0x7f6b0406fab0 2024-03-18T07:14:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afa7fc640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c3c0 tx=0x7f6aec00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:57.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.095+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec017070 con 0x7f6b0406fab0 2024-03-18T07:14:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.096+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6aec005ce0 con 0x7f6b0406fab0 2024-03-18T07:14:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.096+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b040c69b0 con 0x7f6b0406fab0 2024-03-18T07:14:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.096+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6aec0072f0 con 0x7f6b0406fab0 2024-03-18T07:14:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.096+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b040c6f70 con 0x7f6b0406fab0 2024-03-18T07:14:57.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.098+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b0404f5b0 con 0x7f6b0406fab0 2024-03-18T07:14:57.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.099+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6aec01a070 con 0x7f6b0406fab0 2024-03-18T07:14:57.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.100+0000 7f6afbfff640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 0x7f6ae406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:57.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.101+0000 7f6b02ffd640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 0x7f6ae406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:57.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.101+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f6aec089a10 con 0x7f6b0406fab0 2024-03-18T07:14:57.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.101+0000 7f6b02ffd640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 0x7f6ae406e0c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6af40113e0 tx=0x7f6af400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:57.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.124+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6aec0581b0 con 0x7f6b0406fab0 2024-03-18T07:14:57.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.717+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6b0415b980 con 0x7f6ae406bc00 2024-03-18T07:14:57.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.719+0000 7f6afbfff640 1 -- 172.21.15.81:0/2885012253 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13727 (secure 0 0 0) 0x7f6b0415b980 con 0x7f6ae406bc00 2024-03-18T07:14:57.725 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T07:14:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 msgr2=0x7f6ae406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 0x7f6ae406e0c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6af40113e0 tx=0x7f6af400b040 comp rx=0 tx=0).stop 2024-03-18T07:14:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 msgr2=0x7f6b041ea150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 secure :-1 s=READY pgs=3250 cs=0 l=1 rev1=1 crypto rx=0x7f6aec00c3c0 tx=0x7f6aec00c880 comp rx=0 tx=0).stop 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 shutdown_connections 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f6b040d2a00 0x7f6b041ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f6ae406bc00 0x7f6ae406e0c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b0406fab0 0x7f6b041ea150 unknown :-1 s=CLOSED pgs=3250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 --2- 172.21.15.81:0/2885012253 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f6b0406f2b0 0x7f6b04155730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 >> 172.21.15.81:0/2885012253 conn(0x7f6b040d1ee0 msgr2=0x7f6b0406d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:57.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 shutdown_connections 2024-03-18T07:14:57.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:57.724+0000 7f6b09310640 1 -- 172.21.15.81:0/2885012253 wait complete. 2024-03-18T07:14:57.753 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":12319,"stamp":"2024-03-18T07:14:57.695503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":21727912,"kb_used_data":9276532,"kb_used_omap":35044,"kb_used_meta":12395035,"kb_avail":733246808,"statfs":{"total":773094113280,"available":750844731392,"internally_reserved":0,"allocated":9499168768,"data_stored":9493625399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35885454,"internal_metadata":12692516466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":470,"apply_latency_ms":470,"commit_latency_ns":470000000,"apply_latency_ns":470000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48085295578,"num_objects":-32864,"num_object_clones":0,"num_object_copies":-65728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32864,"num_whiteouts":0,"num_read":-1516405,"num_read_kb":-400696163,"num_write":-3176375,"num_write_kb":-601318631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002391"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":401,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T07:14:52.850454+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T07:14:52.850454+0000","last_peered":"2024-03-18T07:14:52.850454+0000","last_clean":"2024-03-18T07:14:52.850454+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T07:14:52.850454+0000","last_undegraded":"2024-03-18T07:14:52.850454+0000","last_fullsized":"2024-03-18T07:14:52.850454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1730460,"kb_used_data":976,"kb_used_omap":2540,"kb_used_meta":1726931,"kb_avail":92641380,"statfs":{"total":96636764160,"available":94864773120,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2601338,"internal_metadata":1768377990},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834579766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670748,"kb_used_data":396,"kb_used_omap":4049,"kb_used_meta":1666286,"kb_avail":92701092,"statfs":{"total":96636764160,"available":94925918208,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4146349,"internal_metadata":1706277715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834579749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1229336,"kb_used_data":396,"kb_used_omap":4155,"kb_used_meta":1224772,"kb_avail":93142504,"statfs":{"total":96636764160,"available":95377924096,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4255044,"internal_metadata":1254167228},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834579747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883608,"kb_used_data":396,"kb_used_omap":7579,"kb_used_meta":1875620,"kb_avail":92488232,"statfs":{"total":96636764160,"available":94707949568,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7761481,"internal_metadata":1920635319},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834579732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3295776,"kb_used_data":1826044,"kb_used_omap":7694,"kb_used_meta":1440817,"kb_avail":91076064,"statfs":{"total":96636764160,"available":93261889536,"internally_reserved":0,"allocated":1869869056,"data_stored":1868909474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7878685,"internal_metadata":1475397603},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":95,"apply_latency_ms":95,"commit_latency_ns":95000000,"apply_latency_ns":95000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834579748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3678140,"kb_used_data":2440304,"kb_used_omap":1523,"kb_used_meta":1236300,"kb_avail":90693700,"statfs":{"total":96636764160,"available":92870348800,"internally_reserved":0,"allocated":2498871296,"data_stored":2497624023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560274,"internal_metadata":1265971502},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834579742,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6650928,"kb_used_data":4926952,"kb_used_omap":5638,"kb_used_meta":1718329,"kb_avail":87720912,"statfs":{"total":96636764160,"available":89826213888,"internally_reserved":0,"allocated":5045198848,"data_stored":5043139119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5774261,"internal_metadata":1759568971},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":129,"apply_latency_ms":129,"commit_latency_ns":129000000,"apply_latency_ns":129000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579759,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588916,"kb_used_data":81068,"kb_used_omap":1863,"kb_used_meta":1505976,"kb_avail":92782924,"statfs":{"total":96636764160,"available":95009714176,"internally_reserved":0,"allocated":83013632,"data_stored":82729487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1908022,"internal_metadata":1542120138},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T07:14:57.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T07:14:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.015+0000 7feac947a640 1 Processor -- start 2024-03-18T07:14:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.016+0000 7feac947a640 1 -- start start 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac947a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feac415e5a0 0x7feac40d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac947a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac40d1200 con 0x7feac40d2d50 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac947a640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac40d14e0 con 0x7feac40d1e40 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac947a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7feac40cff90 con 0x7feac415e5a0 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac2ffd640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7feac415e5a0 0x7feac40d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7feac40d2d50 0x7feac40b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34906/0 (socket says 172.21.15.81:34906) 2024-03-18T07:14:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feabbfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7feac40d1e40 0x7feac40d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:60348/0 (socket says 172.21.15.81:60348) 2024-03-18T07:14:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.018+0000 7feac37fe640 1 -- 172.21.15.81:0/3015513593 learned_addr learned my addr 172.21.15.81:0/3015513593 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.019+0000 7feac2ffd640 1 -- 172.21.15.81:0/3015513593 >> v1:172.21.15.136:6789/0 conn(0x7feac40d1e40 legacy=0x7feac40d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.019+0000 7feac2ffd640 1 -- 172.21.15.81:0/3015513593 >> v1:172.21.15.81:6789/0 conn(0x7feac40d2d50 legacy=0x7feac40b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.019+0000 7feac27fc640 1 -- 172.21.15.81:0/3015513593 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437194127 0 0) 0x7feac40d14e0 con 0x7feac40d1e40 2024-03-18T07:14:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.019+0000 7feac2ffd640 1 -- 172.21.15.81:0/3015513593 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac40d17c0 con 0x7feac415e5a0 2024-03-18T07:14:58.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.021+0000 7feac2ffd640 1 --2- 172.21.15.81:0/3015513593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac415e5a0 0x7feac40d4b80 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d90 tx=0x7feab402bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=324cefbde8ec3dd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.021+0000 7feac27fc640 1 -- 172.21.15.81:0/3015513593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4039070 con 0x7feac415e5a0 2024-03-18T07:14:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.021+0000 7feac27fc640 1 -- 172.21.15.81:0/3015513593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab402ca20 con 0x7feac415e5a0 2024-03-18T07:14:58.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.021+0000 7feac27fc640 1 -- 172.21.15.81:0/3015513593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab402cdf0 con 0x7feac415e5a0 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.022+0000 7feac947a640 1 -- 172.21.15.81:0/3015513593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac415e5a0 msgr2=0x7feac40d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.022+0000 7feac947a640 1 --2- 172.21.15.81:0/3015513593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac415e5a0 0x7feac40d4b80 secure :-1 s=READY pgs=3252 cs=0 l=1 rev1=1 crypto rx=0x7feab4009d90 tx=0x7feab402bcf0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.022+0000 7feac947a640 1 -- 172.21.15.81:0/3015513593 shutdown_connections 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.023+0000 7feac947a640 1 --2- 172.21.15.81:0/3015513593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac415e5a0 0x7feac40d4b80 unknown :-1 s=CLOSED pgs=3252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.023+0000 7feac947a640 1 -- 172.21.15.81:0/3015513593 >> 172.21.15.81:0/3015513593 conn(0x7feac40d4060 msgr2=0x7feac40d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.023+0000 7feac947a640 1 -- 172.21.15.81:0/3015513593 shutdown_connections 2024-03-18T07:14:58.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.023+0000 7feac947a640 1 -- 172.21.15.81:0/3015513593 wait complete. 2024-03-18T07:14:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.026+0000 7feac947a640 1 Processor -- start 2024-03-18T07:14:58.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.026+0000 7feac947a640 1 -- start start 2024-03-18T07:14:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feac40d1e40 0x7feac40ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 0x7feac40b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feac40b47a0 con 0x7feac40d2d50 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7feac40b4620 con 0x7feac415e5a0 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac947a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7feac40b4920 con 0x7feac40d1e40 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56356/0 (socket says 172.21.15.81:56356) 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 -- 172.21.15.81:0/3721653670 learned_addr learned my addr 172.21.15.81:0/3721653670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac2ffd640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feac40d1e40 0x7feac40ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac37fe640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 0x7feac40b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 -- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feac40d1e40 msgr2=0x7feac40ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feac40d1e40 0x7feac40ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 -- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 msgr2=0x7feac40b1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 0x7feac40b1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feabbfff640 1 -- 172.21.15.81:0/3721653670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac40b28b0 con 0x7feac40d2d50 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.028+0000 7feac37fe640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 0x7feac40b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feabbfff640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 secure :-1 s=READY pgs=3253 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c4d0 tx=0x7feaac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac018070 con 0x7feac40d2d50 2024-03-18T07:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaac0074e0 con 0x7feac40d2d50 2024-03-18T07:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaac004a20 con 0x7feac40d2d50 2024-03-18T07:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac40b25d0 con 0x7feac40d2d50 2024-03-18T07:14:58.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.029+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac415f730 con 0x7feac40d2d50 2024-03-18T07:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.032+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac404f5b0 con 0x7feac40d2d50 2024-03-18T07:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.032+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feaac01b070 con 0x7feac40d2d50 2024-03-18T07:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.033+0000 7feabb7fe640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 0x7feaa406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.033+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7feaac089a60 con 0x7feac40d2d50 2024-03-18T07:14:58.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.033+0000 7feac2ffd640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 0x7feaa406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.034+0000 7feac2ffd640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 0x7feaa406e090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feab4036000 tx=0x7feab4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.037+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7feaac058850 con 0x7feac40d2d50 2024-03-18T07:14:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.566+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feac406c2f0 con 0x7feaa406bbd0 2024-03-18T07:14:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.567+0000 7feabb7fe640 1 -- 172.21.15.81:0/3721653670 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13727 (secure 0 0 0) 0x7feac406c2f0 con 0x7feaa406bbd0 2024-03-18T07:14:58.574 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T07:14:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 msgr2=0x7feaa406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 0x7feaa406e090 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7feab4036000 tx=0x7feab4030000 comp rx=0 tx=0).stop 2024-03-18T07:14:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 msgr2=0x7feac40b19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 secure :-1 s=READY pgs=3253 cs=0 l=1 rev1=1 crypto rx=0x7feaac00c4d0 tx=0x7feaac00c990 comp rx=0 tx=0).stop 2024-03-18T07:14:58.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 shutdown_connections 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7feac415e5a0 0x7feac40b1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7feaa406bbd0 0x7feaa406e090 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feac40d2d50 0x7feac40b19a0 unknown :-1 s=CLOSED pgs=3253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 --2- 172.21.15.81:0/3721653670 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7feac40d1e40 0x7feac40ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 >> 172.21.15.81:0/3721653670 conn(0x7feac40d4060 msgr2=0x7feac40b2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 shutdown_connections 2024-03-18T07:14:58.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.572+0000 7feac947a640 1 -- 172.21.15.81:0/3721653670 wait complete. 2024-03-18T07:14:58.604 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":12319,"stamp":"2024-03-18T07:14:57.695503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":21727912,"kb_used_data":9276532,"kb_used_omap":35044,"kb_used_meta":12395035,"kb_avail":733246808,"statfs":{"total":773094113280,"available":750844731392,"internally_reserved":0,"allocated":9499168768,"data_stored":9493625399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35885454,"internal_metadata":12692516466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":470,"apply_latency_ms":470,"commit_latency_ns":470000000,"apply_latency_ns":470000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48085295578,"num_objects":-32864,"num_object_clones":0,"num_object_copies":-65728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32864,"num_whiteouts":0,"num_read":-1516405,"num_read_kb":-400696163,"num_write":-3176375,"num_write_kb":-601318631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002391"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":401,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T07:14:52.850454+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T07:14:52.850454+0000","last_peered":"2024-03-18T07:14:52.850454+0000","last_clean":"2024-03-18T07:14:52.850454+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T07:14:52.850454+0000","last_undegraded":"2024-03-18T07:14:52.850454+0000","last_fullsized":"2024-03-18T07:14:52.850454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1730460,"kb_used_data":976,"kb_used_omap":2540,"kb_used_meta":1726931,"kb_avail":92641380,"statfs":{"total":96636764160,"available":94864773120,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2601338,"internal_metadata":1768377990},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834579766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670748,"kb_used_data":396,"kb_used_omap":4049,"kb_used_meta":1666286,"kb_avail":92701092,"statfs":{"total":96636764160,"available":94925918208,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4146349,"internal_metadata":1706277715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834579749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1229336,"kb_used_data":396,"kb_used_omap":4155,"kb_used_meta":1224772,"kb_avail":93142504,"statfs":{"total":96636764160,"available":95377924096,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4255044,"internal_metadata":1254167228},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834579747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883608,"kb_used_data":396,"kb_used_omap":7579,"kb_used_meta":1875620,"kb_avail":92488232,"statfs":{"total":96636764160,"available":94707949568,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7761481,"internal_metadata":1920635319},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834579732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3295776,"kb_used_data":1826044,"kb_used_omap":7694,"kb_used_meta":1440817,"kb_avail":91076064,"statfs":{"total":96636764160,"available":93261889536,"internally_reserved":0,"allocated":1869869056,"data_stored":1868909474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7878685,"internal_metadata":1475397603},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":95,"apply_latency_ms":95,"commit_latency_ns":95000000,"apply_latency_ns":95000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834579748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3678140,"kb_used_data":2440304,"kb_used_omap":1523,"kb_used_meta":1236300,"kb_avail":90693700,"statfs":{"total":96636764160,"available":92870348800,"internally_reserved":0,"allocated":2498871296,"data_stored":2497624023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560274,"internal_metadata":1265971502},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834579742,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6650928,"kb_used_data":4926952,"kb_used_omap":5638,"kb_used_meta":1718329,"kb_avail":87720912,"statfs":{"total":96636764160,"available":89826213888,"internally_reserved":0,"allocated":5045198848,"data_stored":5043139119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5774261,"internal_metadata":1759568971},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":129,"apply_latency_ms":129,"commit_latency_ns":129000000,"apply_latency_ns":129000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579759,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588916,"kb_used_data":81068,"kb_used_omap":1863,"kb_used_meta":1505976,"kb_avail":92782924,"statfs":{"total":96636764160,"available":95009714176,"internally_reserved":0,"allocated":83013632,"data_stored":82729487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1908022,"internal_metadata":1542120138},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T07:14:58.604 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T07:14:58.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T07:14:58.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.757+0000 7fe73c9fe640 1 Processor -- start 2024-03-18T07:14:58.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.758+0000 7fe73c9fe640 1 -- start start 2024-03-18T07:14:58.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 0x7fe73815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe738071d60 0x7fe7380721a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe73815e9c0 0x7fe73815ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe7380726e0 con 0x7fe738071d60 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe7380b4af0 con 0x7fe7380cd090 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73c9fe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe7380b4dd0 con 0x7fe73815e9c0 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe738071d60 0x7fe7380721a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe736d9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 0x7fe73815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73659c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe738071d60 0x7fe7380721a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56362/0 (socket says 172.21.15.81:56362) 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73659c640 1 -- 172.21.15.81:0/391977419 learned_addr learned my addr 172.21.15.81:0/391977419 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.760+0000 7fe73759e640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe73815e9c0 0x7fe73815ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe73659c640 1 -- 172.21.15.81:0/391977419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe73815e9c0 msgr2=0x7fe73815ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe73659c640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe73815e9c0 0x7fe73815ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe73659c640 1 -- 172.21.15.81:0/391977419 >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 msgr2=0x7fe73815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe73659c640 1 --2- 172.21.15.81:0/391977419 >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 0x7fe73815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe73659c640 1 -- 172.21.15.81:0/391977419 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7380b50b0 con 0x7fe738071d60 2024-03-18T07:14:58.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.761+0000 7fe736d9d640 1 --2- 172.21.15.81:0/391977419 >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 0x7fe73815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.763+0000 7fe73659c640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738071d60 0x7fe7380721a0 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7fe7380b36e0 tx=0x7fe72c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c377632e18468e49 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.763+0000 7fe735d9b640 1 -- 172.21.15.81:0/391977419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c02e070 con 0x7fe738071d60 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.763+0000 7fe735d9b640 1 -- 172.21.15.81:0/391977419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c037070 con 0x7fe738071d60 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.763+0000 7fe735d9b640 1 -- 172.21.15.81:0/391977419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c031a00 con 0x7fe738071d60 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 -- 172.21.15.81:0/391977419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738071d60 msgr2=0x7fe7380721a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738071d60 0x7fe7380721a0 secure :-1 s=READY pgs=3254 cs=0 l=1 rev1=1 crypto rx=0x7fe7380b36e0 tx=0x7fe72c02b880 comp rx=0 tx=0).stop 2024-03-18T07:14:58.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 -- 172.21.15.81:0/391977419 shutdown_connections 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe73815e9c0 0x7fe73815ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/391977419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738071d60 0x7fe7380721a0 unknown :-1 s=CLOSED pgs=3254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/391977419 >> v2:172.21.15.136:3300/0 conn(0x7fe7380cd090 0x7fe73815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 -- 172.21.15.81:0/391977419 >> 172.21.15.81:0/391977419 conn(0x7fe7380b2910 msgr2=0x7fe7380b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 -- 172.21.15.81:0/391977419 shutdown_connections 2024-03-18T07:14:58.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.764+0000 7fe73c9fe640 1 -- 172.21.15.81:0/391977419 wait complete. 2024-03-18T07:14:58.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.765+0000 7fe73c9fe640 1 Processor -- start 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.765+0000 7fe73c9fe640 1 -- start start 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe738071d60 0x7fe7381f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe73815e9c0 0x7fe738152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380cd470 con 0x7fe7380cd090 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe7380b4800 con 0x7fe73815e9c0 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73c9fe640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe73815c290 con 0x7fe738071d60 2024-03-18T07:14:58.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56366/0 (socket says 172.21.15.81:56366) 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73659c640 1 -- 172.21.15.81:0/3527440979 learned_addr learned my addr 172.21.15.81:0/3527440979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe736d9d640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe738071d60 0x7fe7381f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.766+0000 7fe73759e640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe73815e9c0 0x7fe738152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 -- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe738071d60 msgr2=0x7fe7381f4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe738071d60 0x7fe7381f4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 -- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe73815e9c0 msgr2=0x7fe738152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe73815e9c0 0x7fe738152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 -- 172.21.15.81:0/3527440979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7381f4ea0 con 0x7fe7380cd090 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.767+0000 7fe73659c640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7fe72c02b8c0 tx=0x7fe72c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.768+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c032670 con 0x7fe7380cd090 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.768+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7380cfd40 con 0x7fe7380cd090 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.768+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe72c032830 con 0x7fe7380cd090 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.768+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72c032c20 con 0x7fe7380cd090 2024-03-18T07:14:58.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.768+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7380ae5e0 con 0x7fe7380cd090 2024-03-18T07:14:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.769+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7380b6ed0 con 0x7fe7380cd090 2024-03-18T07:14:58.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.771+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe72c04c060 con 0x7fe7380cd090 2024-03-18T07:14:58.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.772+0000 7fe71f7fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 0x7fe72406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.773+0000 7fe736d9d640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 0x7fe72406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.773+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe72c0abd20 con 0x7fe7380cd090 2024-03-18T07:14:58.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.774+0000 7fe736d9d640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 0x7fe72406e0c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe728009580 tx=0x7fe728009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:58.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.786+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe7380b6ed0 con 0x7fe7380cd090 2024-03-18T07:14:58.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.961+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe738072a40 con 0x7fe72406bc00 2024-03-18T07:14:58.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.962+0000 7fe71f7fe640 1 -- 172.21.15.81:0/3527440979 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13727 (secure 0 0 0) 0x7fe738072a40 con 0x7fe72406bc00 2024-03-18T07:14:58.968 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:58.969 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T07:14:58.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 msgr2=0x7fe72406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 0x7fe72406e0c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fe728009580 tx=0x7fe728009190 comp rx=0 tx=0).stop 2024-03-18T07:14:58.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 msgr2=0x7fe7380cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:58.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 secure :-1 s=READY pgs=3255 cs=0 l=1 rev1=1 crypto rx=0x7fe72c02b8c0 tx=0x7fe72c0046c0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 shutdown_connections 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe73815e9c0 0x7fe738152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe72406bc00 0x7fe72406e0c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7380cd090 0x7fe7380cf800 unknown :-1 s=CLOSED pgs=3255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 --2- 172.21.15.81:0/3527440979 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe738071d60 0x7fe7381f4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 >> 172.21.15.81:0/3527440979 conn(0x7fe7380b2910 msgr2=0x7fe73815a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 shutdown_connections 2024-03-18T07:14:58.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:58.965+0000 7fe73c9fe640 1 -- 172.21.15.81:0/3527440979 wait complete. 2024-03-18T07:14:58.985 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":12319,"stamp":"2024-03-18T07:14:57.695503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":72,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":21727912,"kb_used_data":9276532,"kb_used_omap":35044,"kb_used_meta":12395035,"kb_avail":733246808,"statfs":{"total":773094113280,"available":750844731392,"internally_reserved":0,"allocated":9499168768,"data_stored":9493625399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35885454,"internal_metadata":12692516466},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":470,"apply_latency_ms":470,"commit_latency_ns":470000000,"apply_latency_ns":470000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-48085295578,"num_objects":-32864,"num_object_clones":0,"num_object_copies":-65728,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-32864,"num_whiteouts":0,"num_read":-1516405,"num_read_kb":-400696163,"num_write":-3176375,"num_write_kb":-601318631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2133,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002391"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":401,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T07:14:52.850454+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T07:14:52.850454+0000","last_peered":"2024-03-18T07:14:52.850454+0000","last_clean":"2024-03-18T07:14:52.850454+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T07:14:52.850454+0000","last_undegraded":"2024-03-18T07:14:52.850454+0000","last_fullsized":"2024-03-18T07:14:52.850454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579754,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1730460,"kb_used_data":976,"kb_used_omap":2540,"kb_used_meta":1726931,"kb_avail":92641380,"statfs":{"total":96636764160,"available":94864773120,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2601338,"internal_metadata":1768377990},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834579766,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670748,"kb_used_data":396,"kb_used_omap":4049,"kb_used_meta":1666286,"kb_avail":92701092,"statfs":{"total":96636764160,"available":94925918208,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4146349,"internal_metadata":1706277715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834579749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1229336,"kb_used_data":396,"kb_used_omap":4155,"kb_used_meta":1224772,"kb_avail":93142504,"statfs":{"total":96636764160,"available":95377924096,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4255044,"internal_metadata":1254167228},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834579747,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883608,"kb_used_data":396,"kb_used_omap":7579,"kb_used_meta":1875620,"kb_avail":92488232,"statfs":{"total":96636764160,"available":94707949568,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7761481,"internal_metadata":1920635319},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834579732,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3295776,"kb_used_data":1826044,"kb_used_omap":7694,"kb_used_meta":1440817,"kb_avail":91076064,"statfs":{"total":96636764160,"available":93261889536,"internally_reserved":0,"allocated":1869869056,"data_stored":1868909474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7878685,"internal_metadata":1475397603},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":95,"apply_latency_ms":95,"commit_latency_ns":95000000,"apply_latency_ns":95000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834579748,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3678140,"kb_used_data":2440304,"kb_used_omap":1523,"kb_used_meta":1236300,"kb_avail":90693700,"statfs":{"total":96636764160,"available":92870348800,"internally_reserved":0,"allocated":2498871296,"data_stored":2497624023,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560274,"internal_metadata":1265971502},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":67,"apply_latency_ms":67,"commit_latency_ns":67000000,"apply_latency_ns":67000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834579742,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6650928,"kb_used_data":4926952,"kb_used_omap":5638,"kb_used_meta":1718329,"kb_avail":87720912,"statfs":{"total":96636764160,"available":89826213888,"internally_reserved":0,"allocated":5045198848,"data_stored":5043139119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5774261,"internal_metadata":1759568971},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":129,"apply_latency_ms":129,"commit_latency_ns":129000000,"apply_latency_ns":129000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579759,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1588916,"kb_used_data":81068,"kb_used_omap":1863,"kb_used_meta":1505976,"kb_avail":92782924,"statfs":{"total":96636764160,"available":95009714176,"internally_reserved":0,"allocated":83013632,"data_stored":82729487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1908022,"internal_metadata":1542120138},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":81,"apply_latency_ms":81,"commit_latency_ns":81000000,"apply_latency_ns":81000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T07:14:58.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T07:14:59.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.228+0000 7fce8b310640 1 Processor -- start 2024-03-18T07:14:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.229+0000 7fce8b310640 1 -- start start 2024-03-18T07:14:59.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce8b310640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fce8415f370 0x7fce8406dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce8b310640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce840b5cd0 con 0x7fce840b57f0 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce8b310640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce8415e890 con 0x7fce8406b1c0 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce8b310640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fce8406fe10 con 0x7fce8415f370 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce888ab640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fce840b57f0 0x7fce8406f700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34910/0 (socket says 172.21.15.81:34910) 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce888ab640 1 -- 172.21.15.81:0/1351858522 learned_addr learned my addr 172.21.15.81:0/1351858522 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:14:59.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce898ad640 1 --2- 172.21.15.81:0/1351858522 >> v2:172.21.15.81:3300/0 conn(0x7fce8415f370 0x7fce8406dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338522650 0 0) 0x7fce8415e890 con 0x7fce8406b1c0 2024-03-18T07:14:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce6c003520 con 0x7fce8406b1c0 2024-03-18T07:14:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253082505 0 0) 0x7fce840b5cd0 con 0x7fce840b57f0 2024-03-18T07:14:59.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce8415e890 con 0x7fce840b57f0 2024-03-18T07:14:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce898ad640 1 -- 172.21.15.81:0/1351858522 >> v1:172.21.15.136:6789/0 conn(0x7fce8406b1c0 legacy=0x7fce8406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce898ad640 1 -- 172.21.15.81:0/1351858522 >> v1:172.21.15.81:6789/0 conn(0x7fce840b57f0 legacy=0x7fce8406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.230+0000 7fce898ad640 1 -- 172.21.15.81:0/1351858522 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8415eb70 con 0x7fce8415f370 2024-03-18T07:14:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.233+0000 7fce898ad640 1 --2- 172.21.15.81:0/1351858522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8415f370 0x7fce8406dc50 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fce780097a0 tx=0x7fce7802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ea79d1141fddb7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:59.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce78034070 con 0x7fce8415f370 2024-03-18T07:14:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce78030610 con 0x7fce8415f370 2024-03-18T07:14:59.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce83fff640 1 -- 172.21.15.81:0/1351858522 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce780309e0 con 0x7fce8415f370 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce8b310640 1 -- 172.21.15.81:0/1351858522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8415f370 msgr2=0x7fce8406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce8b310640 1 --2- 172.21.15.81:0/1351858522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8415f370 0x7fce8406dc50 secure :-1 s=READY pgs=3257 cs=0 l=1 rev1=1 crypto rx=0x7fce780097a0 tx=0x7fce7802b960 comp rx=0 tx=0).stop 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce8b310640 1 -- 172.21.15.81:0/1351858522 shutdown_connections 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce8b310640 1 --2- 172.21.15.81:0/1351858522 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8415f370 0x7fce8406dc50 unknown :-1 s=CLOSED pgs=3257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.234+0000 7fce8b310640 1 -- 172.21.15.81:0/1351858522 >> 172.21.15.81:0/1351858522 conn(0x7fce840b2a40 msgr2=0x7fce840b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.235+0000 7fce8b310640 1 -- 172.21.15.81:0/1351858522 shutdown_connections 2024-03-18T07:14:59.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.235+0000 7fce8b310640 1 -- 172.21.15.81:0/1351858522 wait complete. 2024-03-18T07:14:59.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.236+0000 7fce8b310640 1 Processor -- start 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.236+0000 7fce8b310640 1 -- start start 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.236+0000 7fce8b310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 0x7fce841f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.236+0000 7fce8b310640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 0x7fce84155c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce8b310640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 0x7fce84151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce8b310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce840b5fb0 con 0x7fce8406b1c0 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce8b310640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fce840b40b0 con 0x7fce840b57f0 2024-03-18T07:14:59.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce8b310640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fce8415e450 con 0x7fce8415f370 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce890ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 0x7fce841f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 0x7fce84155c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce898ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 0x7fce84151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce898ad640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 0x7fce84151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52758/0 (socket says 172.21.15.81:52758) 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce898ad640 1 -- 172.21.15.81:0/1072532589 learned_addr learned my addr 172.21.15.81:0/1072532589 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:14:59.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce890ac640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 0x7fce841f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56380/0 (socket says 172.21.15.81:56380) 2024-03-18T07:14:59.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 -- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 msgr2=0x7fce84151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 0x7fce84151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 -- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 msgr2=0x7fce841f40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 0x7fce841f40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.237+0000 7fce888ab640 1 -- 172.21.15.81:0/1072532589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce841f46c0 con 0x7fce840b57f0 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.238+0000 7fce888ab640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 0x7fce84155c30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce7400cae0 tx=0x7fce7400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.238+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74017070 con 0x7fce840b57f0 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.238+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce7400abe0 con 0x7fce840b57f0 2024-03-18T07:14:59.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.238+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce74012600 con 0x7fce840b57f0 2024-03-18T07:14:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.238+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce841f49a0 con 0x7fce840b57f0 2024-03-18T07:14:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.239+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce8414f8f0 con 0x7fce840b57f0 2024-03-18T07:14:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.240+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce841f4b70 con 0x7fce840b57f0 2024-03-18T07:14:59.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.241+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fce7401a070 con 0x7fce840b57f0 2024-03-18T07:14:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.241+0000 7fce81ffb640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 0x7fce7006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:14:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.241+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fce7408a410 con 0x7fce840b57f0 2024-03-18T07:14:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.241+0000 7fce890ac640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 0x7fce7006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:14:59.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.242+0000 7fce890ac640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 0x7fce7006e090 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0017b0 tx=0x7fce7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:14:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.246+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fce74058bb0 con 0x7fce840b57f0 2024-03-18T07:14:59.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.788+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce8404f5b0 con 0x7fce840b57f0 2024-03-18T07:14:59.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.789+0000 7fce81ffb640 1 -- 172.21.15.81:0/1072532589 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+13034 (secure 0 0 0) 0x7fce7405cc50 con 0x7fce840b57f0 2024-03-18T07:14:59.795 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:14:59.795 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":35,"fsid":"a215fc89-10fc-4af5-b2ff-78f3e4709ee3","created":"2024-03-18T00:24:59.173069+0000","modified":"2024-03-18T07:14:51.119659+0000","last_up_change":"2024-03-18T00:25:09.873874+0000","last_in_change":"2024-03-18T00:25:01.452616+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T00:25:11.399670+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"f75e6efa-51fa-499c-8e82-9d6f8d7dc6da","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6803","nonce":1556273579}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6808","nonce":1556273579}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6815","nonce":1556273579}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6811","nonce":1556273579},{"type":"v1","addr":"172.21.15.81:6813","nonce":1556273579}]},"public_addr":"172.21.15.81:6803/1556273579","cluster_addr":"172.21.15.81:6808/1556273579","heartbeat_back_addr":"172.21.15.81:6815/1556273579","heartbeat_front_addr":"172.21.15.81:6813/1556273579","state":["exists","up"]},{"osd":1,"uuid":"67848bf7-60fb-49ac-80b5-268b08e9dfed","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6801","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6802","nonce":2697389687}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6805","nonce":2697389687}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6812","nonce":2697389687}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6807","nonce":2697389687},{"type":"v1","addr":"172.21.15.81:6809","nonce":2697389687}]},"public_addr":"172.21.15.81:6802/2697389687","cluster_addr":"172.21.15.81:6805/2697389687","heartbeat_back_addr":"172.21.15.81:6812/2697389687","heartbeat_front_addr":"172.21.15.81:6809/2697389687","state":["exists","up"]},{"osd":2,"uuid":"c3d419eb-c604-4be5-9cdd-c767d1be2f01","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6817","nonce":1596798397}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6819","nonce":1596798397}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6823","nonce":1596798397}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":1596798397},{"type":"v1","addr":"172.21.15.81:6821","nonce":1596798397}]},"public_addr":"172.21.15.81:6817/1596798397","cluster_addr":"172.21.15.81:6819/1596798397","heartbeat_back_addr":"172.21.15.81:6823/1596798397","heartbeat_front_addr":"172.21.15.81:6821/1596798397","state":["exists","up"]},{"osd":3,"uuid":"b7849768-b9cc-4ba3-8c7e-4cd4d215d1bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6825","nonce":2792020926}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6827","nonce":2792020926}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6831","nonce":2792020926}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2792020926},{"type":"v1","addr":"172.21.15.81:6829","nonce":2792020926}]},"public_addr":"172.21.15.81:6825/2792020926","cluster_addr":"172.21.15.81:6827/2792020926","heartbeat_back_addr":"172.21.15.81:6831/2792020926","heartbeat_front_addr":"172.21.15.81:6829/2792020926","state":["exists","up"]},{"osd":4,"uuid":"257fd9a3-e594-4e73-81ad-bc398662a7aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6801","nonce":1798639050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6803","nonce":1798639050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6807","nonce":1798639050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":1798639050},{"type":"v1","addr":"172.21.15.136:6805","nonce":1798639050}]},"public_addr":"172.21.15.136:6801/1798639050","cluster_addr":"172.21.15.136:6803/1798639050","heartbeat_back_addr":"172.21.15.136:6807/1798639050","heartbeat_front_addr":"172.21.15.136:6805/1798639050","state":["exists","up"]},{"osd":5,"uuid":"6bf1ecd1-0ded-410d-b4e8-d522113a8d20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6825","nonce":4148726140}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6827","nonce":4148726140}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6831","nonce":4148726140}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":4148726140},{"type":"v1","addr":"172.21.15.136:6829","nonce":4148726140}]},"public_addr":"172.21.15.136:6825/4148726140","cluster_addr":"172.21.15.136:6827/4148726140","heartbeat_back_addr":"172.21.15.136:6831/4148726140","heartbeat_front_addr":"172.21.15.136:6829/4148726140","state":["exists","up"]},{"osd":6,"uuid":"bb68e6b0-8faf-465e-a370-3bfe99a965ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6816","nonce":2186134377}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6819","nonce":2186134377}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6823","nonce":2186134377}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":2186134377},{"type":"v1","addr":"172.21.15.136:6821","nonce":2186134377}]},"public_addr":"172.21.15.136:6816/2186134377","cluster_addr":"172.21.15.136:6819/2186134377","heartbeat_back_addr":"172.21.15.136:6823/2186134377","heartbeat_front_addr":"172.21.15.136:6821/2186134377","state":["exists","up"]},{"osd":7,"uuid":"e0a2b0d1-4b40-4946-8042-870c4989b8b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6809","nonce":3828864915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6811","nonce":3828864915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6815","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6817","nonce":3828864915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3828864915},{"type":"v1","addr":"172.21.15.136:6813","nonce":3828864915}]},"public_addr":"172.21.15.136:6809/3828864915","cluster_addr":"172.21.15.136:6811/3828864915","heartbeat_back_addr":"172.21.15.136:6817/3828864915","heartbeat_front_addr":"172.21.15.136:6813/3828864915","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.633511+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.646607+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.658902+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.681848+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.675449+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.656351+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.676918+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T00:25:06.625406+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.136:6834/1616882519":"2024-03-19T07:14:47.406414+0000","172.21.15.136:6832/1616882519":"2024-03-19T07:14:47.406414+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T07:14:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 msgr2=0x7fce7006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 0x7fce7006e090 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fce7c0017b0 tx=0x7fce7c009040 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 msgr2=0x7fce84155c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 0x7fce84155c30 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fce7400cae0 tx=0x7fce7400a060 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 shutdown_connections 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fce8415f370 0x7fce84151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fce840b57f0 0x7fce84155c30 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fce7006bbd0 0x7fce7006e090 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 --2- 172.21.15.81:0/1072532589 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce8406b1c0 0x7fce841f40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 >> 172.21.15.81:0/1072532589 conn(0x7fce840b2a40 msgr2=0x7fce840b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:14:59.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 shutdown_connections 2024-03-18T07:14:59.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:14:59.794+0000 7fce8b310640 1 -- 172.21.15.81:0/1072532589 wait complete. 2024-03-18T07:15:00.826 INFO:tasks.ceph:Scrubbing osd.0 2024-03-18T07:15:00.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.093+0000 7fecfd174640 1 Processor -- start 2024-03-18T07:15:01.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.094+0000 7fecfd174640 1 -- start start 2024-03-18T07:15:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecfd174640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fecf8152f90 0x7fecf815cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecfd174640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecfd174640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecf815fe00 con 0x7fecf80720b0 2024-03-18T07:15:01.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecfd174640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fecf815d450 con 0x7fecf8152f90 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecfd174640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fecf80d0040 con 0x7fecf806ed20 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecf659c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecf6d9d640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fecf8152f90 0x7fecf815cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecf659c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52762/0 (socket says 172.21.15.81:52762) 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecf659c640 1 -- 172.21.15.81:0/1398123315 learned_addr learned my addr 172.21.15.81:0/1398123315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:01.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.096+0000 7fecf759e640 1 --1- 172.21.15.81:0/1398123315 >> v1:172.21.15.81:6789/0 conn(0x7fecf80720b0 0x7fecf806d750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34926/0 (socket says 172.21.15.81:34926) 2024-03-18T07:15:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.097+0000 7fecf659c640 1 -- 172.21.15.81:0/1398123315 >> v2:172.21.15.136:3300/0 conn(0x7fecf8152f90 msgr2=0x7fecf815cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.097+0000 7fecf659c640 1 --2- 172.21.15.81:0/1398123315 >> v2:172.21.15.136:3300/0 conn(0x7fecf8152f90 0x7fecf815cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.097+0000 7fecf659c640 1 -- 172.21.15.81:0/1398123315 >> v1:172.21.15.81:6789/0 conn(0x7fecf80720b0 legacy=0x7fecf806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.097+0000 7fecf659c640 1 -- 172.21.15.81:0/1398123315 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf81600e0 con 0x7fecf806ed20 2024-03-18T07:15:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.098+0000 7fecf659c640 1 --2- 172.21.15.81:0/1398123315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fece00098a0 tx=0x7fece002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=498f340b0b07fe3b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.098+0000 7fecf5d9b640 1 -- 172.21.15.81:0/1398123315 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0034070 con 0x7fecf806ed20 2024-03-18T07:15:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.098+0000 7fecf5d9b640 1 -- 172.21.15.81:0/1398123315 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece0030840 con 0x7fecf806ed20 2024-03-18T07:15:01.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.098+0000 7fecf5d9b640 1 -- 172.21.15.81:0/1398123315 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0030c10 con 0x7fecf806ed20 2024-03-18T07:15:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.099+0000 7fecfd174640 1 -- 172.21.15.81:0/1398123315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 msgr2=0x7fecf8071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.099+0000 7fecfd174640 1 --2- 172.21.15.81:0/1398123315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fece00098a0 tx=0x7fece002b980 comp rx=0 tx=0).stop 2024-03-18T07:15:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.099+0000 7fecfd174640 1 -- 172.21.15.81:0/1398123315 shutdown_connections 2024-03-18T07:15:01.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.099+0000 7fecfd174640 1 --2- 172.21.15.81:0/1398123315 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf806ed20 0x7fecf8071b70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.099+0000 7fecfd174640 1 --2- 172.21.15.81:0/1398123315 >> v2:172.21.15.136:3300/0 conn(0x7fecf8152f90 0x7fecf815cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.100+0000 7fecfd174640 1 -- 172.21.15.81:0/1398123315 >> 172.21.15.81:0/1398123315 conn(0x7fecf80b2680 msgr2=0x7fecf80b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.100+0000 7fecfd174640 1 -- 172.21.15.81:0/1398123315 shutdown_connections 2024-03-18T07:15:01.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.100+0000 7fecfd174640 1 -- 172.21.15.81:0/1398123315 wait complete. 2024-03-18T07:15:01.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.104+0000 7fecfd174640 1 Processor -- start 2024-03-18T07:15:01.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.104+0000 7fecfd174640 1 -- start start 2024-03-18T07:15:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 0x7fecf80b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 0x7fecf8155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf8152f90 0x7fecf8155a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fecf8153370 con 0x7fecf80720b0 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fecf81606a0 con 0x7fecf806ed20 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecfd174640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fecf815fab0 con 0x7fecf8152f90 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 0x7fecf8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 0x7fecf80b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf6d9d640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 0x7fecf80b4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55858/0 (socket says 172.21.15.81:55858) 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf6d9d640 1 -- 172.21.15.81:0/2455341785 learned_addr learned my addr 172.21.15.81:0/2455341785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:01.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 0x7fecf8155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56394/0 (socket says 172.21.15.81:56394) 2024-03-18T07:15:01.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.106+0000 7fecf759e640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf8152f90 0x7fecf8155a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 -- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf8152f90 msgr2=0x7fecf8155a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fecf8152f90 0x7fecf8155a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 -- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 msgr2=0x7fecf8155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 0x7fecf8155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf8153920 con 0x7fecf806ed20 2024-03-18T07:15:01.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf659c640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf80720b0 0x7fecf8155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecf6d9d640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 0x7fecf80b4e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fece800e870 tx=0x7fece800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.107+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8017070 con 0x7fecf806ed20 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.108+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fece800c940 con 0x7fecf806ed20 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.108+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf8153c60 con 0x7fecf806ed20 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.108+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece800cd30 con 0x7fecf806ed20 2024-03-18T07:15:01.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.108+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf81544a0 con 0x7fecf806ed20 2024-03-18T07:15:01.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.109+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fecf804f540 con 0x7fecf806ed20 2024-03-18T07:15:01.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.110+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fece801a070 con 0x7fecf806ed20 2024-03-18T07:15:01.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.111+0000 7fecef7fe640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fecdc06bc00 0x7fecdc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.112+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fece808a540 con 0x7fecf806ed20 2024-03-18T07:15:01.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.112+0000 7fecf659c640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fecdc06bc00 0x7fecdc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.112+0000 7fecef7fe640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7fecdc071ac0 0x7fecdc073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.112+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecdc074590 con 0x7fecdc071ac0 2024-03-18T07:15:01.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.112+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fece8091050 con 0x7fecf806ed20 2024-03-18T07:15:01.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.113+0000 7fecf759e640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7fecdc071ac0 0x7fecdc073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.113+0000 7fecf659c640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fecdc06bc00 0x7fecdc06e0c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fece0036000 tx=0x7fece0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.113+0000 7fecf759e640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7fecdc071ac0 0x7fecdc073ee0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.148+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== osd.0 v2:172.21.15.81:6800/1556273579 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fecdc074590 con 0x7fecdc071ac0 2024-03-18T07:15:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.186+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 --> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fecf806f350 con 0x7fecdc071ac0 2024-03-18T07:15:01.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.201+0000 7fecef7fe640 1 -- 172.21.15.81:0/2455341785 <== osd.0 v2:172.21.15.81:6800/1556273579 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fecf806f350 con 0x7fecdc071ac0 2024-03-18T07:15:01.206 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:01.206 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:01.207 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.201+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7fecdc071ac0 msgr2=0x7fecdc073ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.201+0000 7fecfd174640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6800/1556273579,v1:172.21.15.81:6803/1556273579] conn(0x7fecdc071ac0 0x7fecdc073ee0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fecdc06bc00 msgr2=0x7fecdc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fecdc06bc00 0x7fecdc06e0c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fece0036000 tx=0x7fece0008030 comp rx=0 tx=0).stop 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 msgr2=0x7fecf80b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 --2- 172.21.15.81:0/2455341785 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fecf806ed20 0x7fecf80b4e40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fece800e870 tx=0x7fece800ed30 comp rx=0 tx=0).stop 2024-03-18T07:15:01.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecf759e640 1 -- 172.21.15.81:0/2455341785 reap_dead start 2024-03-18T07:15:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 shutdown_connections 2024-03-18T07:15:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 >> 172.21.15.81:0/2455341785 conn(0x7fecf80b2680 msgr2=0x7fecf815d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 shutdown_connections 2024-03-18T07:15:01.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.202+0000 7fecfd174640 1 -- 172.21.15.81:0/2455341785 wait complete. 2024-03-18T07:15:01.232 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-18T07:15:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.501+0000 7fdcda44b640 1 Processor -- start 2024-03-18T07:15:01.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.501+0000 7fdcda44b640 1 -- start start 2024-03-18T07:15:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.502+0000 7fdcda44b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcd41598e0 0x7fdcd40b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.502+0000 7fdcda44b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 0x7fdcd40ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.502+0000 7fdcda44b640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd415fc70 con 0x7fdcd4159cc0 2024-03-18T07:15:01.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.502+0000 7fdcda44b640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd40b3c80 con 0x7fdcd40d07f0 2024-03-18T07:15:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.502+0000 7fdcda44b640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd415ff50 con 0x7fdcd41598e0 2024-03-18T07:15:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcd41598e0 0x7fdcd40b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fdcd41598e0 0x7fdcd40b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55864/0 (socket says 172.21.15.81:55864) 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdccbfff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fdcd4159cc0 0x7fdcd40d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:60362/0 (socket says 172.21.15.81:60362) 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 -- 172.21.15.81:0/171069460 learned_addr learned my addr 172.21.15.81:0/171069460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd89e8640 1 --2- 172.21.15.81:0/171069460 >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 0x7fdcd40ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 -- 172.21.15.81:0/171069460 >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 msgr2=0x7fdcd40ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 --2- 172.21.15.81:0/171069460 >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 0x7fdcd40ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 -- 172.21.15.81:0/171069460 >> v1:172.21.15.136:6789/0 conn(0x7fdcd4159cc0 legacy=0x7fdcd40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd3fff640 1 -- 172.21.15.81:0/171069460 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4160230 con 0x7fdcd41598e0 2024-03-18T07:15:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.503+0000 7fdcd89e8640 1 --2- 172.21.15.81:0/171069460 >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 0x7fdcd40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.504+0000 7fdcd3fff640 1 --2- 172.21.15.81:0/171069460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd41598e0 0x7fdcd40b3740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406e4e0 tx=0x7fdcc402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc1639bbbdfab277 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.504+0000 7fdcd37fe640 1 -- 172.21.15.81:0/171069460 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4034070 con 0x7fdcd41598e0 2024-03-18T07:15:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.504+0000 7fdcd37fe640 1 -- 172.21.15.81:0/171069460 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4030870 con 0x7fdcd41598e0 2024-03-18T07:15:01.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.504+0000 7fdcd37fe640 1 -- 172.21.15.81:0/171069460 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4030c40 con 0x7fdcd41598e0 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 -- 172.21.15.81:0/171069460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd41598e0 msgr2=0x7fdcd40b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 --2- 172.21.15.81:0/171069460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd41598e0 0x7fdcd40b3740 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406e4e0 tx=0x7fdcc402b9b0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 -- 172.21.15.81:0/171069460 shutdown_connections 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 --2- 172.21.15.81:0/171069460 >> v2:172.21.15.81:3300/0 conn(0x7fdcd40d07f0 0x7fdcd40ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 --2- 172.21.15.81:0/171069460 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd41598e0 0x7fdcd40b3740 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 -- 172.21.15.81:0/171069460 >> 172.21.15.81:0/171069460 conn(0x7fdcd406b5e0 msgr2=0x7fdcd406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 -- 172.21.15.81:0/171069460 shutdown_connections 2024-03-18T07:15:01.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.505+0000 7fdcda44b640 1 -- 172.21.15.81:0/171069460 wait complete. 2024-03-18T07:15:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.507+0000 7fdcda44b640 1 Processor -- start 2024-03-18T07:15:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.507+0000 7fdcda44b640 1 -- start start 2024-03-18T07:15:01.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.507+0000 7fdcda44b640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcda44b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd41598e0 0x7fdcd409d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcda44b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcd4159cc0 0x7fdcd414a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcda44b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd406cc70 con 0x7fdcd41598e0 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcda44b640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd41607f0 con 0x7fdcd40d07f0 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcda44b640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd406cdf0 con 0x7fdcd4159cc0 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55878/0 (socket says 172.21.15.81:55878) 2024-03-18T07:15:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 -- 172.21.15.81:0/1327490989 learned_addr learned my addr 172.21.15.81:0/1327490989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdccbfff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd41598e0 0x7fdcd409d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd89e8640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcd4159cc0 0x7fdcd414a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 -- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcd4159cc0 msgr2=0x7fdcd414a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcd4159cc0 0x7fdcd414a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 -- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd41598e0 msgr2=0x7fdcd409d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd41598e0 0x7fdcd409d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.508+0000 7fdcd3fff640 1 -- 172.21.15.81:0/1327490989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd409d870 con 0x7fdcd40d07f0 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcd3fff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdcc402b9f0 tx=0x7fdcc4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4048070 con 0x7fdcd40d07f0 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc4030670 con 0x7fdcd40d07f0 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd409c290 con 0x7fdcd40d07f0 2024-03-18T07:15:01.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4034040 con 0x7fdcd40d07f0 2024-03-18T07:15:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.509+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd409cb30 con 0x7fdcd40d07f0 2024-03-18T07:15:01.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.511+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdcc404b070 con 0x7fdcd40d07f0 2024-03-18T07:15:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.512+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd409dea0 con 0x7fdcd40d07f0 2024-03-18T07:15:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.512+0000 7fdcd17fa640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 0x7fdcb406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.512+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fdcc40ac7d0 con 0x7fdcd40d07f0 2024-03-18T07:15:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.512+0000 7fdccbfff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 0x7fdcb406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:01.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.513+0000 7fdccbfff640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 0x7fdcb406e090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40aeca0 tx=0x7fdcbc000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:01.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:01.517+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdcd409dea0 con 0x7fdcd40d07f0 2024-03-18T07:15:02.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.057+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdcd404f5b0 con 0x7fdcb406bbd0 2024-03-18T07:15:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.058+0000 7fdcd17fa640 1 -- 172.21.15.81:0/1327490989 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdcd404f5b0 con 0x7fdcb406bbd0 2024-03-18T07:15:02.064 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-03-18T07:15:02.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 msgr2=0x7fdcb406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 0x7fdcb406e090 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40aeca0 tx=0x7fdcbc000ed0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 msgr2=0x7fdcd40b1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdcc402b9f0 tx=0x7fdcc4004730 comp rx=0 tx=0).stop 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 shutdown_connections 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fdcd4159cc0 0x7fdcd414a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fdcb406bbd0 0x7fdcb406e090 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdcd41598e0 0x7fdcd409d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 --2- 172.21.15.81:0/1327490989 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fdcd40d07f0 0x7fdcd40b1250 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 >> 172.21.15.81:0/1327490989 conn(0x7fdcd406b5e0 msgr2=0x7fdcd415c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:02.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 shutdown_connections 2024-03-18T07:15:02.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.061+0000 7fdcda44b640 1 -- 172.21.15.81:0/1327490989 wait complete. 2024-03-18T07:15:02.084 INFO:tasks.ceph:Scrubbing osd.1 2024-03-18T07:15:02.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.254+0000 7f96e87ef640 1 Processor -- start 2024-03-18T07:15:02.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.254+0000 7f96e87ef640 1 -- start start 2024-03-18T07:15:02.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.256+0000 7f96e87ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96e015a750 0x7f96e00cc920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.256+0000 7f96e87ef640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 0x7f96e006e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.256+0000 7f96e87ef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96e015eae0 con 0x7f96e015e1c0 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.256+0000 7f96e87ef640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f96e015ab30 con 0x7f96e015a750 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.256+0000 7f96e87ef640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f96e006b530 con 0x7f96e015e650 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e658b640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f96e015a750 0x7f96e00cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e5d8a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f96e015e1c0 0x7f96e006dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34930/0 (socket says 172.21.15.81:34930) 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e5d8a640 1 -- 172.21.15.81:0/4162726864 learned_addr learned my addr 172.21.15.81:0/4162726864 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:02.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e6d8c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 0x7f96e006e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e658b640 1 -- 172.21.15.81:0/4162726864 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 msgr2=0x7f96e006e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e658b640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 0x7f96e006e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e658b640 1 -- 172.21.15.81:0/4162726864 >> v1:172.21.15.81:6789/0 conn(0x7f96e015e1c0 legacy=0x7f96e006dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e658b640 1 -- 172.21.15.81:0/4162726864 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00b3690 con 0x7f96e015a750 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e5589640 1 -- 172.21.15.81:0/4162726864 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084532824 0 0) 0x7f96e015eae0 con 0x7f96e015e1c0 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.257+0000 7f96e6d8c640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 0x7f96e006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.258+0000 7f96e658b640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015a750 0x7f96e00cc920 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009d90 tx=0x7f96d002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8187a6d9dc6eb0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.258+0000 7f96e5589640 1 -- 172.21.15.81:0/4162726864 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0039070 con 0x7f96e015a750 2024-03-18T07:15:02.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.258+0000 7f96e5589640 1 -- 172.21.15.81:0/4162726864 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d002cc60 con 0x7f96e015a750 2024-03-18T07:15:02.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.258+0000 7f96e5589640 1 -- 172.21.15.81:0/4162726864 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0034660 con 0x7f96e015a750 2024-03-18T07:15:02.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 -- 172.21.15.81:0/4162726864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015a750 msgr2=0x7f96e00cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015a750 0x7f96e00cc920 secure :-1 s=READY pgs=3260 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009d90 tx=0x7f96d002beb0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 -- 172.21.15.81:0/4162726864 shutdown_connections 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015e650 0x7f96e006e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 --2- 172.21.15.81:0/4162726864 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015a750 0x7f96e00cc920 unknown :-1 s=CLOSED pgs=3260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 -- 172.21.15.81:0/4162726864 >> 172.21.15.81:0/4162726864 conn(0x7f96e00d0540 msgr2=0x7f96e00d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 -- 172.21.15.81:0/4162726864 shutdown_connections 2024-03-18T07:15:02.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.260+0000 7f96e87ef640 1 -- 172.21.15.81:0/4162726864 wait complete. 2024-03-18T07:15:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.263+0000 7f96e87ef640 1 Processor -- start 2024-03-18T07:15:02.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.263+0000 7f96e87ef640 1 -- start start 2024-03-18T07:15:02.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 0x7f96e014bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015e1c0 0x7f96e015cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96e015e650 0x7f96e015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96e006b1c0 con 0x7f96e015e1c0 2024-03-18T07:15:02.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f96e00b3c50 con 0x7f96e015e650 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.265+0000 7f96e87ef640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f96e00cd3d0 con 0x7f96e015a750 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 0x7f96e014bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 0x7f96e014bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52804/0 (socket says 172.21.15.81:52804) 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 -- 172.21.15.81:0/2085167370 learned_addr learned my addr 172.21.15.81:0/2085167370 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e6d8c640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96e015e650 0x7f96e015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e5d8a640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015e1c0 0x7f96e015cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 -- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96e015e650 msgr2=0x7f96e015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f96e015e650 0x7f96e015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 -- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015e1c0 msgr2=0x7f96e015cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015e1c0 0x7f96e015cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00c5560 con 0x7f96e015a750 2024-03-18T07:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e5d8a640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e015e1c0 0x7f96e015cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:02.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96e658b640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 0x7f96e014bfb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009d90 tx=0x7f96d0004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.266+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0039050 con 0x7f96e015a750 2024-03-18T07:15:02.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.267+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96d0045070 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.267+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e01f45b0 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.267+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d003e850 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.267+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e00c5ae0 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.267+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f96e00c5eb0 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.268+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f96d003e9f0 con 0x7f96e015a750 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.269+0000 7f96deffd640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f96cc06bc00 0x7f96cc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96e5d8a640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f96cc06bc00 0x7f96cc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f96d00adef0 con 0x7f96e015a750 2024-03-18T07:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96deffd640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f96cc071ac0 0x7f96cc073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96d0046ec0 con 0x7f96cc071ac0 2024-03-18T07:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f96d00ae2a0 con 0x7f96e015a750 2024-03-18T07:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.270+0000 7f96e6d8c640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f96cc071ac0 0x7f96cc073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.271+0000 7f96e5d8a640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f96cc06bc00 0x7f96cc06e0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f96e0159bf0 tx=0x7f96d4009dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.271+0000 7f96e6d8c640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f96cc071ac0 0x7f96cc073ee0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.272+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== osd.1 v2:172.21.15.81:6801/2697389687 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96d0046ec0 con 0x7f96cc071ac0 2024-03-18T07:15:02.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.286+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 --> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f96e004f540 con 0x7f96cc071ac0 2024-03-18T07:15:02.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.286+0000 7f96deffd640 1 -- 172.21.15.81:0/2085167370 <== osd.1 v2:172.21.15.81:6801/2697389687 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f96e004f540 con 0x7f96cc071ac0 2024-03-18T07:15:02.292 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:02.293 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:02.293 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f96cc071ac0 msgr2=0x7f96cc073ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6801/2697389687,v1:172.21.15.81:6802/2697389687] conn(0x7f96cc071ac0 0x7f96cc073ee0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f96cc06bc00 msgr2=0x7f96cc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f96cc06bc00 0x7f96cc06e0c0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f96e0159bf0 tx=0x7f96d4009dd0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 msgr2=0x7f96e014bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 --2- 172.21.15.81:0/2085167370 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f96e015a750 0x7f96e014bfb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f96d0009d90 tx=0x7f96d0004a40 comp rx=0 tx=0).stop 2024-03-18T07:15:02.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e6d8c640 1 -- 172.21.15.81:0/2085167370 reap_dead start 2024-03-18T07:15:02.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 shutdown_connections 2024-03-18T07:15:02.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 >> 172.21.15.81:0/2085167370 conn(0x7f96e00d0540 msgr2=0x7f96e00d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:02.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 shutdown_connections 2024-03-18T07:15:02.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.287+0000 7f96e87ef640 1 -- 172.21.15.81:0/2085167370 wait complete. 2024-03-18T07:15:02.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-18T07:15:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.459+0000 7f5f07f53640 1 Processor -- start 2024-03-18T07:15:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.459+0000 7f5f07f53640 1 -- start start 2024-03-18T07:15:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f07f53640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5f001598e0 0x7f5f000b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f07f53640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f07f53640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0015fc70 con 0x7f5f0006cc70 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f07f53640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f5f000b3c80 con 0x7f5f001598e0 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f07f53640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0015ff50 con 0x7f5f00159cc0 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52808/0 (socket says 172.21.15.81:52808) 2024-03-18T07:15:02.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 -- 172.21.15.81:0/3820751538 learned_addr learned my addr 172.21.15.81:0/3820751538 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f05cef640 1 --2- 172.21.15.81:0/3820751538 >> v2:172.21.15.136:3300/0 conn(0x7f5f001598e0 0x7f5f000b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f064f0640 1 --1- 172.21.15.81:0/3820751538 >> v1:172.21.15.81:6789/0 conn(0x7f5f0006cc70 0x7f5f0015c650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34932/0 (socket says 172.21.15.81:34932) 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 -- 172.21.15.81:0/3820751538 >> v2:172.21.15.136:3300/0 conn(0x7f5f001598e0 msgr2=0x7f5f000b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 --2- 172.21.15.81:0/3820751538 >> v2:172.21.15.136:3300/0 conn(0x7f5f001598e0 0x7f5f000b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 -- 172.21.15.81:0/3820751538 >> v1:172.21.15.81:6789/0 conn(0x7f5f0006cc70 legacy=0x7f5f0015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.460+0000 7f5f054ee640 1 -- 172.21.15.81:0/3820751538 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f00160230 con 0x7f5f00159cc0 2024-03-18T07:15:02.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.461+0000 7f5f054ee640 1 --2- 172.21.15.81:0/3820751538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009870 tx=0x7f5ef402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48877e8cccedcb1b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.461+0000 7f5f04ced640 1 -- 172.21.15.81:0/3820751538 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4034070 con 0x7f5f00159cc0 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f04ced640 1 -- 172.21.15.81:0/3820751538 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4030840 con 0x7f5f00159cc0 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f04ced640 1 -- 172.21.15.81:0/3820751538 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4030c10 con 0x7f5f00159cc0 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 -- 172.21.15.81:0/3820751538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 msgr2=0x7f5f000d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 --2- 172.21.15.81:0/3820751538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009870 tx=0x7f5ef402b980 comp rx=0 tx=0).stop 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 -- 172.21.15.81:0/3820751538 shutdown_connections 2024-03-18T07:15:02.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 --2- 172.21.15.81:0/3820751538 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f00159cc0 0x7f5f000d00e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 --2- 172.21.15.81:0/3820751538 >> v2:172.21.15.136:3300/0 conn(0x7f5f001598e0 0x7f5f000b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 -- 172.21.15.81:0/3820751538 >> 172.21.15.81:0/3820751538 conn(0x7f5f0006b5e0 msgr2=0x7f5f0006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 -- 172.21.15.81:0/3820751538 shutdown_connections 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.462+0000 7f5f07f53640 1 -- 172.21.15.81:0/3820751538 wait complete. 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.463+0000 7f5f07f53640 1 Processor -- start 2024-03-18T07:15:02.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.463+0000 7f5f07f53640 1 -- start start 2024-03-18T07:15:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f0006cc70 0x7f5f0009bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 0x7f5f001539c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f000acd80 con 0x7f5f00159cc0 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001607f0 con 0x7f5f001598e0 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f07f53640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5f000acf00 con 0x7f5f0006cc70 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f054ee640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f054ee640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55902/0 (socket says 172.21.15.81:55902) 2024-03-18T07:15:02.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f054ee640 1 -- 172.21.15.81:0/1306575191 learned_addr learned my addr 172.21.15.81:0/1306575191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.464+0000 7f5f064f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 0x7f5f001539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f05cef640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f0006cc70 0x7f5f0009bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 -- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f0006cc70 msgr2=0x7f5f0009bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f0006cc70 0x7f5f0009bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 -- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 msgr2=0x7f5f001539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 0x7f5f001539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 -- 172.21.15.81:0/1306575191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f001f4a30 con 0x7f5f001598e0 2024-03-18T07:15:02.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f064f0640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 0x7f5f001539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f054ee640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000c00 tx=0x7f5ef40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4034040 con 0x7f5f001598e0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ef4039d90 con 0x7f5f001598e0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0009c680 con 0x7f5f001598e0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4043610 con 0x7f5f001598e0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.465+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f0009cc40 con 0x7f5f001598e0 2024-03-18T07:15:02.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.467+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5ef404a060 con 0x7f5f001598e0 2024-03-18T07:15:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.468+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0004f5b0 con 0x7f5f001598e0 2024-03-18T07:15:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.468+0000 7f5ef27fc640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 0x7f5ee406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.468+0000 7f5f05cef640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 0x7f5ee406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:02.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.468+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5ef40ac7f0 con 0x7f5f001598e0 2024-03-18T07:15:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.469+0000 7f5f05cef640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 0x7f5ee406e0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5efc006fd0 tx=0x7f5efc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:02.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:02.473+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5f001f4a30 con 0x7f5f001598e0 2024-03-18T07:15:03.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.007+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f5f0009d860 con 0x7f5ee406bc00 2024-03-18T07:15:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.008+0000 7f5ef27fc640 1 -- 172.21.15.81:0/1306575191 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5f0009d860 con 0x7f5ee406bc00 2024-03-18T07:15:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-03-18T07:15:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 msgr2=0x7f5ee406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 0x7f5ee406e0c0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5efc006fd0 tx=0x7f5efc008040 comp rx=0 tx=0).stop 2024-03-18T07:15:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 msgr2=0x7f5f001f44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4000c00 tx=0x7f5ef40046c0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 shutdown_connections 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ee406bc00 0x7f5ee406e0c0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f00159cc0 0x7f5f001539c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5f001598e0 0x7f5f001f44f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 --2- 172.21.15.81:0/1306575191 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5f0006cc70 0x7f5f0009bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 >> 172.21.15.81:0/1306575191 conn(0x7f5f0006b5e0 msgr2=0x7f5f00158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 shutdown_connections 2024-03-18T07:15:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.011+0000 7f5f07f53640 1 -- 172.21.15.81:0/1306575191 wait complete. 2024-03-18T07:15:03.042 INFO:tasks.ceph:Scrubbing osd.2 2024-03-18T07:15:03.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:03.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.310+0000 7f5bbbb37640 1 Processor -- start 2024-03-18T07:15:03.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.310+0000 7f5bbbb37640 1 -- start start 2024-03-18T07:15:03.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f5bb4161700 0x7f5bb40d08d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 0x7f5bb40d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 0x7f5bb4161f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40d4fd0 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f5bb40cf8e0 con 0x7f5bb4161700 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bbbb37640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb40cfb80 con 0x7f5bb40d1350 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bb90d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 0x7f5bb40d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bb90d2640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 0x7f5bb40d0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56466/0 (socket says 172.21.15.81:56466) 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bba0d4640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 0x7f5bb4161f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bb90d2640 1 -- 172.21.15.81:0/334500875 learned_addr learned my addr 172.21.15.81:0/334500875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.311+0000 7f5bb98d3640 1 --2- 172.21.15.81:0/334500875 >> v2:172.21.15.136:3300/0 conn(0x7f5bb4161700 0x7f5bb40d08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.312+0000 7f5bba0d4640 1 -- 172.21.15.81:0/334500875 >> v2:172.21.15.136:3300/0 conn(0x7f5bb4161700 msgr2=0x7f5bb40d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.312+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/334500875 >> v2:172.21.15.136:3300/0 conn(0x7f5bb4161700 0x7f5bb40d08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.312+0000 7f5bba0d4640 1 -- 172.21.15.81:0/334500875 >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 msgr2=0x7f5bb40d0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.312+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/334500875 >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 0x7f5bb40d0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.312+0000 7f5bba0d4640 1 -- 172.21.15.81:0/334500875 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40cfe60 con 0x7f5bb40d1350 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.313+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/334500875 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 0x7f5bb4161f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40d1c10 tx=0x7f5ba402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55c01f3299813aa7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.313+0000 7f5bb88d1640 1 -- 172.21.15.81:0/334500875 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4038070 con 0x7f5bb40d1350 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.313+0000 7f5bb88d1640 1 -- 172.21.15.81:0/334500875 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4031700 con 0x7f5bb40d1350 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.313+0000 7f5bb88d1640 1 -- 172.21.15.81:0/334500875 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4031ad0 con 0x7f5bb40d1350 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 -- 172.21.15.81:0/334500875 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 msgr2=0x7f5bb4161f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/334500875 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 0x7f5bb4161f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40d1c10 tx=0x7f5ba402b7a0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 -- 172.21.15.81:0/334500875 shutdown_connections 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/334500875 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb40d1350 0x7f5bb4161f00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/334500875 >> v2:172.21.15.81:3300/0 conn(0x7f5bb40d4ad0 0x7f5bb40d0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/334500875 >> v2:172.21.15.136:3300/0 conn(0x7f5bb4161700 0x7f5bb40d08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 -- 172.21.15.81:0/334500875 >> 172.21.15.81:0/334500875 conn(0x7f5bb409d3e0 msgr2=0x7f5bb40d4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 -- 172.21.15.81:0/334500875 shutdown_connections 2024-03-18T07:15:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.314+0000 7f5bbbb37640 1 -- 172.21.15.81:0/334500875 wait complete. 2024-03-18T07:15:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.315+0000 7f5bbbb37640 1 Processor -- start 2024-03-18T07:15:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 -- start start 2024-03-18T07:15:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb40d1350 0x7f5bb40ca300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 0x7f5bb406d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb4161700 0x7f5bb40b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40b5150 con 0x7f5bb40d1350 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb40b4fd0 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bbbb37640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f5bb4161ae0 con 0x7f5bb4161700 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.316+0000 7f5bb98d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb40d1350 0x7f5bb40ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 0x7f5bb406d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 0x7f5bb406d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55916/0 (socket says 172.21.15.81:55916) 2024-03-18T07:15:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 -- 172.21.15.81:0/1874414604 learned_addr learned my addr 172.21.15.81:0/1874414604 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb4161700 0x7f5bb40b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 -- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb4161700 msgr2=0x7f5bb40b92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb4161700 0x7f5bb40b92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 -- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb40d1350 msgr2=0x7f5bb40ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5bb40d1350 0x7f5bb40ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb40b8250 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f5bb4161700 0x7f5bb40b92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb90d2640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 0x7f5bb406d130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800efc0 tx=0x7f5ba800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.317+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba800cda0 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.318+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba8019070 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.318+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb40b8530 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.318+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba80146a0 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.318+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb40b8af0 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.319+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5ba8005d10 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.319+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5bb40d0460 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.319+0000 7f5bb27fc640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ba006bbd0 0x7f5ba006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f5ba808ac60 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bb27fc640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f5ba0071a90 0x7f5ba0073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ba80020b0 con 0x7f5ba0071a90 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5ba8055550 con 0x7f5bb40d4ad0 2024-03-18T07:15:03.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bb98d3640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ba006bbd0 0x7f5ba006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.320+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f5ba0071a90 0x7f5ba0073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.321+0000 7f5bba0d4640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f5ba0071a90 0x7f5ba0073eb0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.321+0000 7f5bb98d3640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ba006bbd0 0x7f5ba006e090 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009ac0 tx=0x7f5bac009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.322+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== osd.2 v2:172.21.15.81:6816/1596798397 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ba80020b0 con 0x7f5ba0071a90 2024-03-18T07:15:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.361+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 --> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5bb404f540 con 0x7f5ba0071a90 2024-03-18T07:15:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.361+0000 7f5bb27fc640 1 -- 172.21.15.81:0/1874414604 <== osd.2 v2:172.21.15.81:6816/1596798397 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5bb404f540 con 0x7f5ba0071a90 2024-03-18T07:15:03.367 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:03.368 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:03.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f5ba0071a90 msgr2=0x7f5ba0073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6816/1596798397,v1:172.21.15.81:6817/1596798397] conn(0x7f5ba0071a90 0x7f5ba0073eb0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ba006bbd0 msgr2=0x7f5ba006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f5ba006bbd0 0x7f5ba006e090 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5bac009ac0 tx=0x7f5bac009190 comp rx=0 tx=0).stop 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 msgr2=0x7f5bb406d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 --2- 172.21.15.81:0/1874414604 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f5bb40d4ad0 0x7f5bb406d130 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5ba800efc0 tx=0x7f5ba800c490 comp rx=0 tx=0).stop 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bba0d4640 1 -- 172.21.15.81:0/1874414604 reap_dead start 2024-03-18T07:15:03.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 shutdown_connections 2024-03-18T07:15:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 >> 172.21.15.81:0/1874414604 conn(0x7f5bb409d3e0 msgr2=0x7f5bb40b44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 shutdown_connections 2024-03-18T07:15:03.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.362+0000 7f5bbbb37640 1 -- 172.21.15.81:0/1874414604 wait complete. 2024-03-18T07:15:03.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-18T07:15:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.555+0000 7fe85bd7e640 1 Processor -- start 2024-03-18T07:15:03.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.555+0000 7fe85bd7e640 1 -- start start 2024-03-18T07:15:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 0x7fe8540ad8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe85406f280 0x7fe8540b3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fe85406b9b0 con 0x7fe85415e2d0 2024-03-18T07:15:03.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fe85406d9b0 con 0x7fe85406f280 2024-03-18T07:15:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.556+0000 7fe85bd7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe85406b360 con 0x7fe85406e7e0 2024-03-18T07:15:03.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859b1a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 0x7fe8540ad8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859319640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fe85406f280 0x7fe8540b3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859319640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52850/0 (socket says 172.21.15.81:52850) 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859b1a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 0x7fe8540ad8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56482/0 (socket says 172.21.15.81:56482) 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859319640 1 -- 172.21.15.81:0/1540362892 learned_addr learned my addr 172.21.15.81:0/1540362892 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:03.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 -- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 msgr2=0x7fe8540b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 -- 172.21.15.81:0/1540362892 >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 msgr2=0x7fe8540ad8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 --2- 172.21.15.81:0/1540362892 >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 0x7fe8540ad8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe85a31b640 1 -- 172.21.15.81:0/1540362892 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85406b640 con 0x7fe85406f280 2024-03-18T07:15:03.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.557+0000 7fe859319640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.559+0000 7fe85a31b640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe8540b3b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8540cce00 tx=0x7fe84c02bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2b7bcddeec59ace server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.560+0000 7fe858b18640 1 -- 172.21.15.81:0/1540362892 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c039070 con 0x7fe85406f280 2024-03-18T07:15:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.560+0000 7fe858b18640 1 -- 172.21.15.81:0/1540362892 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe84c02cb40 con 0x7fe85406f280 2024-03-18T07:15:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.560+0000 7fe858b18640 1 -- 172.21.15.81:0/1540362892 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe84c034440 con 0x7fe85406f280 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.561+0000 7fe85bd7e640 1 -- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 msgr2=0x7fe8540b3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.561+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe8540b3b30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe8540cce00 tx=0x7fe84c02bd90 comp rx=0 tx=0).stop 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 -- 172.21.15.81:0/1540362892 shutdown_connections 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe8540b3b30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/1540362892 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85406e7e0 0x7fe8540b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/1540362892 >> v2:172.21.15.81:3300/0 conn(0x7fe85415e2d0 0x7fe8540ad8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 -- 172.21.15.81:0/1540362892 >> 172.21.15.81:0/1540362892 conn(0x7fe8540d0580 msgr2=0x7fe8540d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 -- 172.21.15.81:0/1540362892 shutdown_connections 2024-03-18T07:15:03.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.562+0000 7fe85bd7e640 1 -- 172.21.15.81:0/1540362892 wait complete. 2024-03-18T07:15:03.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.567+0000 7fe85bd7e640 1 Processor -- start 2024-03-18T07:15:03.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.567+0000 7fe85bd7e640 1 -- start start 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe85414ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 0x7fe854160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe85406be40 con 0x7fe85406e7e0 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fe8540b59d0 con 0x7fe85406f280 2024-03-18T07:15:03.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe85bd7e640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fe85406bfc0 con 0x7fe85415e2d0 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe859b1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe859b1a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56494/0 (socket says 172.21.15.81:56494) 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe859b1a640 1 -- 172.21.15.81:0/86151044 learned_addr learned my addr 172.21.15.81:0/86151044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.570+0000 7fe859319640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe85414ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe85a31b640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 0x7fe854160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 -- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 msgr2=0x7fe854160d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 0x7fe854160d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 -- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 msgr2=0x7fe85414ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe85414ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 -- 172.21.15.81:0/86151044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85415e6b0 con 0x7fe85406e7e0 2024-03-18T07:15:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859319640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe85414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe85a31b640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 0x7fe854160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:03.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe859b1a640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7fe85000e8a0 tx=0x7fe85000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850017070 con 0x7fe85406e7e0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.571+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85000c940 con 0x7fe85406e7e0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.572+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85415e990 con 0x7fe85406e7e0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.572+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85000cd30 con 0x7fe85406e7e0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.572+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85415f230 con 0x7fe85406e7e0 2024-03-18T07:15:03.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.573+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85404f5b0 con 0x7fe85406e7e0 2024-03-18T07:15:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.574+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe85001a070 con 0x7fe85406e7e0 2024-03-18T07:15:03.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.576+0000 7fe84a7fc640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 0x7fe83806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.576+0000 7fe859319640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 0x7fe83806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.576+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fe85008ae50 con 0x7fe85406e7e0 2024-03-18T07:15:03.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.577+0000 7fe859319640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 0x7fe83806e090 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe844009630 tx=0x7fe844008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:03.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:03.588+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe850059ba0 con 0x7fe85406e7e0 2024-03-18T07:15:04.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.123+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fe854067050 con 0x7fe83806bbd0 2024-03-18T07:15:04.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.124+0000 7fe84a7fc640 1 -- 172.21.15.81:0/86151044 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe854067050 con 0x7fe83806bbd0 2024-03-18T07:15:04.130 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 msgr2=0x7fe83806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 0x7fe83806e090 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fe844009630 tx=0x7fe844008040 comp rx=0 tx=0).stop 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 msgr2=0x7fe8541f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 secure :-1 s=READY pgs=3262 cs=0 l=1 rev1=1 crypto rx=0x7fe85000e8a0 tx=0x7fe85000ed60 comp rx=0 tx=0).stop 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 shutdown_connections 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fe85415e2d0 0x7fe854160d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fe85406f280 0x7fe85414ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fe83806bbd0 0x7fe83806e090 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 --2- 172.21.15.81:0/86151044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe85406e7e0 0x7fe8541f4ee0 unknown :-1 s=CLOSED pgs=3262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.126+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 >> 172.21.15.81:0/86151044 conn(0x7fe8540d0580 msgr2=0x7fe8540b3230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.127+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 shutdown_connections 2024-03-18T07:15:04.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.127+0000 7fe85bd7e640 1 -- 172.21.15.81:0/86151044 wait complete. 2024-03-18T07:15:04.157 INFO:tasks.ceph:Scrubbing osd.3 2024-03-18T07:15:04.157 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:04.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.425+0000 7fefdb220640 1 Processor -- start 2024-03-18T07:15:04.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.426+0000 7fefdb220640 1 -- start start 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefdb220640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fefd4155540 0x7fefd415f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefdb220640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 0x7fefd415ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefdb220640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefd40cc490 con 0x7fefd4155920 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefdb220640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fefd40cc1b0 con 0x7fefd40cdb60 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefdb220640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fefd40c4db0 con 0x7fefd4155540 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefd8fbc640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fefd4155540 0x7fefd415f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefd3fff640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fefd4155920 0x7fefd40cb9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:60376/0 (socket says 172.21.15.81:60376) 2024-03-18T07:15:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefd3fff640 1 -- 172.21.15.81:0/1439572978 learned_addr learned my addr 172.21.15.81:0/1439572978 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.428+0000 7fefd97bd640 1 --2- 172.21.15.81:0/1439572978 >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 0x7fefd415ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd8fbc640 1 -- 172.21.15.81:0/1439572978 >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 msgr2=0x7fefd415ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd8fbc640 1 --2- 172.21.15.81:0/1439572978 >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 0x7fefd415ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd8fbc640 1 -- 172.21.15.81:0/1439572978 >> v1:172.21.15.136:6789/0 conn(0x7fefd4155920 legacy=0x7fefd40cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd8fbc640 1 -- 172.21.15.81:0/1439572978 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd40c5090 con 0x7fefd4155540 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd97bd640 1 --2- 172.21.15.81:0/1439572978 >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 0x7fefd415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:04.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.429+0000 7fefd37fe640 1 -- 172.21.15.81:0/1439572978 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614191888 0 0) 0x7fefd40cc490 con 0x7fefd4155920 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.430+0000 7fefd8fbc640 1 --2- 172.21.15.81:0/1439572978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd4155540 0x7fefd415f7e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefd406ef40 tx=0x7fefc402e0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ce2a007b16874b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.430+0000 7fefd37fe640 1 -- 172.21.15.81:0/1439572978 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc403b070 con 0x7fefd4155540 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.430+0000 7fefd37fe640 1 -- 172.21.15.81:0/1439572978 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefc402ee50 con 0x7fefd4155540 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.430+0000 7fefd37fe640 1 -- 172.21.15.81:0/1439572978 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4036660 con 0x7fefd4155540 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 -- 172.21.15.81:0/1439572978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd4155540 msgr2=0x7fefd415f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 --2- 172.21.15.81:0/1439572978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd4155540 0x7fefd415f7e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fefd406ef40 tx=0x7fefc402e0a0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 -- 172.21.15.81:0/1439572978 shutdown_connections 2024-03-18T07:15:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 --2- 172.21.15.81:0/1439572978 >> v2:172.21.15.81:3300/0 conn(0x7fefd40cdb60 0x7fefd415ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 --2- 172.21.15.81:0/1439572978 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd4155540 0x7fefd415f7e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 -- 172.21.15.81:0/1439572978 >> 172.21.15.81:0/1439572978 conn(0x7fefd40cfc60 msgr2=0x7fefd40d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 -- 172.21.15.81:0/1439572978 shutdown_connections 2024-03-18T07:15:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.431+0000 7fefdb220640 1 -- 172.21.15.81:0/1439572978 wait complete. 2024-03-18T07:15:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.432+0000 7fefdb220640 1 Processor -- start 2024-03-18T07:15:04.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.432+0000 7fefdb220640 1 -- start start 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefd40cdb60 0x7fefd40b53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fefd4155540 0x7fefd415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd414fc00 0x7fefd414a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefd415f180 con 0x7fefd40cdb60 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fefd40cdfb0 con 0x7fefd414fc00 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefdb220640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fefd415f300 con 0x7fefd4155540 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefd8fbc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefd40cdb60 0x7fefd40b53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefd97bd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd414fc00 0x7fefd414a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefd3fff640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fefd4155540 0x7fefd415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefd8fbc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefd40cdb60 0x7fefd40b53c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56502/0 (socket says 172.21.15.81:56502) 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.434+0000 7fefd8fbc640 1 -- 172.21.15.81:0/90375329 learned_addr learned my addr 172.21.15.81:0/90375329 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 -- 172.21.15.81:0/90375329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fefd4155540 msgr2=0x7fefd415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fefd4155540 0x7fefd415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 -- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefd40cdb60 msgr2=0x7fefd40b53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fefd40cdb60 0x7fefd40b53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd41f75f0 con 0x7fefd414fc00 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd97bd640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd414fc00 0x7fefd414a300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e7e0 tx=0x7fefbc00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.435+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc00f040 con 0x7fefd414fc00 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.436+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc004030 con 0x7fefd414fc00 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.436+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd41f78d0 con 0x7fefd414fc00 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.436+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc004400 con 0x7fefd414fc00 2024-03-18T07:15:04.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.436+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd41f7e90 con 0x7fefd414fc00 2024-03-18T07:15:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.437+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fefd40b5900 con 0x7fefd414fc00 2024-03-18T07:15:04.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.440+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fefbc00c6d0 con 0x7fefd414fc00 2024-03-18T07:15:04.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd17fa640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fefb406bbd0 0x7fefb406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fefbc08a330 con 0x7fefd414fc00 2024-03-18T07:15:04.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd8fbc640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fefb406bbd0 0x7fefb406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd17fa640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fefb4071a90 0x7fefb4073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fefbc006870 con 0x7fefb4071a90 2024-03-18T07:15:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fefbc091050 con 0x7fefd414fc00 2024-03-18T07:15:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.441+0000 7fefd3fff640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fefb4071a90 0x7fefb4073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.442+0000 7fefd3fff640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fefb4071a90 0x7fefb4073eb0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.442+0000 7fefd8fbc640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fefb406bbd0 0x7fefb406e090 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b800 tx=0x7fefc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.444+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== osd.3 v2:172.21.15.81:6824/2792020926 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fefbc006870 con 0x7fefb4071a90 2024-03-18T07:15:04.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.483+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 --> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fefd404f540 con 0x7fefb4071a90 2024-03-18T07:15:04.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.483+0000 7fefd17fa640 1 -- 172.21.15.81:0/90375329 <== osd.3 v2:172.21.15.81:6824/2792020926 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fefd404f540 con 0x7fefb4071a90 2024-03-18T07:15:04.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:04.490 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fefb4071a90 msgr2=0x7fefb4073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6824/2792020926,v1:172.21.15.81:6825/2792020926] conn(0x7fefb4071a90 0x7fefb4073eb0 crc :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fefb406bbd0 msgr2=0x7fefb406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fefb406bbd0 0x7fefb406e090 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fefc400b800 tx=0x7fefc4008040 comp rx=0 tx=0).stop 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd414fc00 msgr2=0x7fefd414a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 --2- 172.21.15.81:0/90375329 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fefd414fc00 0x7fefd414a300 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00e7e0 tx=0x7fefbc00eca0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefd97bd640 1 -- 172.21.15.81:0/90375329 reap_dead start 2024-03-18T07:15:04.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 shutdown_connections 2024-03-18T07:15:04.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 >> 172.21.15.81:0/90375329 conn(0x7fefd40cfc60 msgr2=0x7fefd40caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:04.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 shutdown_connections 2024-03-18T07:15:04.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.484+0000 7fefdb220640 1 -- 172.21.15.81:0/90375329 wait complete. 2024-03-18T07:15:04.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-18T07:15:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.680+0000 7f974f227640 1 Processor -- start 2024-03-18T07:15:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.680+0000 7f974f227640 1 -- start start 2024-03-18T07:15:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974f227640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97480cfc20 0x7f97480cda60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974f227640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97480ceeb0 0x7f9748165f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974f227640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97480d2a00 con 0x7f974815c510 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974f227640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f97480c5a30 con 0x7f97480ceeb0 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974f227640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f97480c5d10 con 0x7f97480cfc20 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f9747fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97480cfc20 0x7f97480cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974d7c4640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f97480ceeb0 0x7f9748165f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f9747fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f97480cfc20 0x7f97480cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55982/0 (socket says 172.21.15.81:55982) 2024-03-18T07:15:04.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f9747fff640 1 -- 172.21.15.81:0/3237953315 learned_addr learned my addr 172.21.15.81:0/3237953315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f974cfc3640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f974815c510 0x7f97480ce7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:60384/0 (socket says 172.21.15.81:60384) 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.682+0000 7f9747fff640 1 -- 172.21.15.81:0/3237953315 >> v2:172.21.15.81:3300/0 conn(0x7f97480ceeb0 msgr2=0x7f9748165f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.683+0000 7f9747fff640 1 --2- 172.21.15.81:0/3237953315 >> v2:172.21.15.81:3300/0 conn(0x7f97480ceeb0 0x7f9748165f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.683+0000 7f9747fff640 1 -- 172.21.15.81:0/3237953315 >> v1:172.21.15.136:6789/0 conn(0x7f974815c510 legacy=0x7f97480ce7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.683+0000 7f97477fe640 1 -- 172.21.15.81:0/3237953315 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116970504 0 0) 0x7f97480d2a00 con 0x7f974815c510 2024-03-18T07:15:04.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.683+0000 7f9747fff640 1 -- 172.21.15.81:0/3237953315 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97480c5ff0 con 0x7f97480cfc20 2024-03-18T07:15:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.685+0000 7f9747fff640 1 --2- 172.21.15.81:0/3237953315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480cda60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f974809ba60 tx=0x7f973802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7d1d7abe4091ba5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.685+0000 7f97477fe640 1 -- 172.21.15.81:0/3237953315 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973802cb20 con 0x7f97480cfc20 2024-03-18T07:15:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.685+0000 7f97477fe640 1 -- 172.21.15.81:0/3237953315 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f973802ccc0 con 0x7f97480cfc20 2024-03-18T07:15:04.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.685+0000 7f97477fe640 1 -- 172.21.15.81:0/3237953315 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9738034610 con 0x7f97480cfc20 2024-03-18T07:15:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 -- 172.21.15.81:0/3237953315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 msgr2=0x7f97480cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 --2- 172.21.15.81:0/3237953315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480cda60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f974809ba60 tx=0x7f973802bf80 comp rx=0 tx=0).stop 2024-03-18T07:15:04.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 -- 172.21.15.81:0/3237953315 shutdown_connections 2024-03-18T07:15:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 --2- 172.21.15.81:0/3237953315 >> v2:172.21.15.81:3300/0 conn(0x7f97480ceeb0 0x7f9748165f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 --2- 172.21.15.81:0/3237953315 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480cda60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 -- 172.21.15.81:0/3237953315 >> 172.21.15.81:0/3237953315 conn(0x7f97480d1e40 msgr2=0x7f97480d2250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.686+0000 7f974f227640 1 -- 172.21.15.81:0/3237953315 shutdown_connections 2024-03-18T07:15:04.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.687+0000 7f974f227640 1 -- 172.21.15.81:0/3237953315 wait complete. 2024-03-18T07:15:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.690+0000 7f974f227640 1 Processor -- start 2024-03-18T07:15:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.690+0000 7f974f227640 1 -- start start 2024-03-18T07:15:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480b2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 0x7f97480aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97480cf7f0 con 0x7f974815c510 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f97480cf670 con 0x7f97480cfc20 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974f227640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f97480c8520 con 0x7f97480ceeb0 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974cfc3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974d7c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 0x7f97480aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f9747fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480b2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974cfc3640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52886/0 (socket says 172.21.15.81:52886) 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974d7c4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 0x7f97480aeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56516/0 (socket says 172.21.15.81:56516) 2024-03-18T07:15:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.692+0000 7f974cfc3640 1 -- 172.21.15.81:0/1659478067 learned_addr learned my addr 172.21.15.81:0/1659478067 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 -- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 msgr2=0x7f97480b2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480b2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 -- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 msgr2=0x7f97480aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 0x7f97480aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 -- 172.21.15.81:0/1659478067 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97480b00a0 con 0x7f97480ceeb0 2024-03-18T07:15:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f9747fff640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.693+0000 7f974cfc3640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f973000c460 tx=0x7f973000c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.694+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730018070 con 0x7f97480ceeb0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.694+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9730007500 con 0x7f97480ceeb0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.694+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97480b0380 con 0x7f97480ceeb0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.694+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730004a20 con 0x7f97480ceeb0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.694+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f97480b2b70 con 0x7f97480ceeb0 2024-03-18T07:15:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.695+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9748153db0 con 0x7f97480ceeb0 2024-03-18T07:15:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.698+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f973001b070 con 0x7f97480ceeb0 2024-03-18T07:15:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.698+0000 7f97457fa640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 0x7f972806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.698+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9730089900 con 0x7f97480ceeb0 2024-03-18T07:15:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.698+0000 7f9747fff640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 0x7f972806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.699+0000 7f9747fff640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 0x7f972806e090 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9738035000 tx=0x7f9738030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.703+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9730058130 con 0x7f97480ceeb0 2024-03-18T07:15:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.880+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f97480b2790 con 0x7f972806bbd0 2024-03-18T07:15:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.880+0000 7f97457fa640 1 -- 172.21.15.81:0/1659478067 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f97480b2790 con 0x7f972806bbd0 2024-03-18T07:15:04.886 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.882+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 msgr2=0x7f972806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.882+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 0x7f972806e090 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9738035000 tx=0x7f9738030000 comp rx=0 tx=0).stop 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.882+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 msgr2=0x7f97480b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.882+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f973000c460 tx=0x7f973000c920 comp rx=0 tx=0).stop 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 shutdown_connections 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f972806bbd0 0x7f972806e090 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f974815c510 0x7f97480aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f97480cfc20 0x7f97480b2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 --2- 172.21.15.81:0/1659478067 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f97480ceeb0 0x7f97480b1d10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 >> 172.21.15.81:0/1659478067 conn(0x7f97480d1e40 msgr2=0x7f97480c7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 shutdown_connections 2024-03-18T07:15:04.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:04.883+0000 7f974f227640 1 -- 172.21.15.81:0/1659478067 wait complete. 2024-03-18T07:15:04.902 INFO:tasks.ceph:Scrubbing osd.4 2024-03-18T07:15:04.903 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:05.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.062+0000 7f3b47d39640 1 Processor -- start 2024-03-18T07:15:05.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.063+0000 7f3b47d39640 1 -- start start 2024-03-18T07:15:05.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b47d39640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f3b4015f020 0x7f3b40151790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b47d39640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b40151cd0 0x7f3b400b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b47d39640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b400b0050 con 0x7f3b4015ec40 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b47d39640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f3b4006e1f0 con 0x7f3b4015f020 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b47d39640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4006e4d0 con 0x7f3b40151cd0 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b45ad5640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f3b4015ec40 0x7f3b400af940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:60400/0 (socket says 172.21.15.81:60400) 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b45ad5640 1 -- 172.21.15.81:0/1461768112 learned_addr learned my addr 172.21.15.81:0/1461768112 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b452d4640 1 --2- 172.21.15.81:0/1461768112 >> v2:172.21.15.81:3300/0 conn(0x7f3b4015f020 0x7f3b40151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b462d6640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b40151cd0 0x7f3b400b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b44ad3640 1 -- 172.21.15.81:0/1461768112 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145697643 0 0) 0x7f3b400b0050 con 0x7f3b4015ec40 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b44ad3640 1 -- 172.21.15.81:0/1461768112 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b2c005730 con 0x7f3b4015ec40 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b452d4640 1 -- 172.21.15.81:0/1461768112 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b40151cd0 msgr2=0x7f3b400b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.065+0000 7f3b452d4640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b40151cd0 0x7f3b400b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.066+0000 7f3b452d4640 1 -- 172.21.15.81:0/1461768112 >> v1:172.21.15.136:6789/0 conn(0x7f3b4015ec40 legacy=0x7f3b400af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.066+0000 7f3b452d4640 1 -- 172.21.15.81:0/1461768112 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b4006e7b0 con 0x7f3b4015f020 2024-03-18T07:15:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.067+0000 7f3b452d4640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015f020 0x7f3b40151790 secure :-1 s=READY pgs=3263 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097a0 tx=0x7f3b3002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620b2d1b0f51879e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.068+0000 7f3b44ad3640 1 -- 172.21.15.81:0/1461768112 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30035020 con 0x7f3b4015f020 2024-03-18T07:15:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.068+0000 7f3b44ad3640 1 -- 172.21.15.81:0/1461768112 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b30031810 con 0x7f3b4015f020 2024-03-18T07:15:05.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.068+0000 7f3b44ad3640 1 -- 172.21.15.81:0/1461768112 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30031be0 con 0x7f3b4015f020 2024-03-18T07:15:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 -- 172.21.15.81:0/1461768112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015f020 msgr2=0x7f3b40151790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015f020 0x7f3b40151790 secure :-1 s=READY pgs=3263 cs=0 l=1 rev1=1 crypto rx=0x7f3b300097a0 tx=0x7f3b3002b8b0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 -- 172.21.15.81:0/1461768112 shutdown_connections 2024-03-18T07:15:05.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b40151cd0 0x7f3b400b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 --2- 172.21.15.81:0/1461768112 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015f020 0x7f3b40151790 unknown :-1 s=CLOSED pgs=3263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 -- 172.21.15.81:0/1461768112 >> 172.21.15.81:0/1461768112 conn(0x7f3b400d0540 msgr2=0x7f3b400d0950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 -- 172.21.15.81:0/1461768112 shutdown_connections 2024-03-18T07:15:05.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.069+0000 7f3b47d39640 1 -- 172.21.15.81:0/1461768112 wait complete. 2024-03-18T07:15:05.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.072+0000 7f3b47d39640 1 Processor -- start 2024-03-18T07:15:05.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.072+0000 7f3b47d39640 1 -- start start 2024-03-18T07:15:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 0x7f3b40144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015ec40 0x7f3b401482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b4015f020 0x7f3b400cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4015f650 con 0x7f3b4015ec40 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f3b4006ed70 con 0x7f3b40151cd0 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b47d39640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f3b4015f7d0 con 0x7f3b4015f020 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.074+0000 7f3b45ad5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 0x7f3b40144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 0x7f3b40144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:55998/0 (socket says 172.21.15.81:55998) 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 -- 172.21.15.81:0/2094589957 learned_addr learned my addr 172.21.15.81:0/2094589957 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b452d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015ec40 0x7f3b401482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b462d6640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b4015f020 0x7f3b400cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 -- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b4015f020 msgr2=0x7f3b400cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b4015f020 0x7f3b400cf230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 -- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015ec40 msgr2=0x7f3b401482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b4015ec40 0x7f3b401482f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b40147710 con 0x7f3b40151cd0 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b462d6640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f3b4015f020 0x7f3b400cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b45ad5640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 0x7f3b40144bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c530 tx=0x7f3b3c00c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c017070 con 0x7f3b40151cd0 2024-03-18T07:15:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3c005ce0 con 0x7f3b40151cd0 2024-03-18T07:15:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b40152160 con 0x7f3b40151cd0 2024-03-18T07:15:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.075+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c0072b0 con 0x7f3b40151cd0 2024-03-18T07:15:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.076+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b40152720 con 0x7f3b40151cd0 2024-03-18T07:15:05.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.076+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b40145130 con 0x7f3b40151cd0 2024-03-18T07:15:05.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.078+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3b3c01a070 con 0x7f3b40151cd0 2024-03-18T07:15:05.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.079+0000 7f3b367fc640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b2406bbd0 0x7f3b2406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.079+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f3b3c089af0 con 0x7f3b40151cd0 2024-03-18T07:15:05.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.079+0000 7f3b452d4640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b2406bbd0 0x7f3b2406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.080+0000 7f3b367fc640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7f3b24071a90 0x7f3b24073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.080+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b24074560 con 0x7f3b24071a90 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.080+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3b3c08e2c0 con 0x7f3b40151cd0 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.080+0000 7f3b462d6640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7f3b24071a90 0x7f3b24073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.080+0000 7f3b452d4640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b2406bbd0 0x7f3b2406e090 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3b30036000 tx=0x7f3b3003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.081+0000 7f3b462d6640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7f3b24071a90 0x7f3b24073eb0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.081+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== osd.4 v2:172.21.15.136:6800/1798639050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b24074560 con 0x7f3b24071a90 2024-03-18T07:15:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.095+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 --> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3b4004f540 con 0x7f3b24071a90 2024-03-18T07:15:05.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.095+0000 7f3b367fc640 1 -- 172.21.15.81:0/2094589957 <== osd.4 v2:172.21.15.136:6800/1798639050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3b4004f540 con 0x7f3b24071a90 2024-03-18T07:15:05.101 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:05.102 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.095+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7f3b24071a90 msgr2=0x7f3b24073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.095+0000 7f3b47d39640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:6800/1798639050,v1:172.21.15.136:6801/1798639050] conn(0x7f3b24071a90 0x7f3b24073eb0 crc :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b2406bbd0 msgr2=0x7f3b2406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f3b2406bbd0 0x7f3b2406e090 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3b30036000 tx=0x7f3b3003c040 comp rx=0 tx=0).stop 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 msgr2=0x7f3b40144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 --2- 172.21.15.81:0/2094589957 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f3b40151cd0 0x7f3b40144bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c00c530 tx=0x7f3b3c00c9f0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b462d6640 1 -- 172.21.15.81:0/2094589957 reap_dead start 2024-03-18T07:15:05.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 shutdown_connections 2024-03-18T07:15:05.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 >> 172.21.15.81:0/2094589957 conn(0x7f3b400d0540 msgr2=0x7f3b40150160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 shutdown_connections 2024-03-18T07:15:05.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.096+0000 7f3b47d39640 1 -- 172.21.15.81:0/2094589957 wait complete. 2024-03-18T07:15:05.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-18T07:15:05.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.277+0000 7f4be9c8a640 1 Processor -- start 2024-03-18T07:15:05.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.277+0000 7f4be9c8a640 1 -- start start 2024-03-18T07:15:05.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be9c8a640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f4be4159c90 0x7f4be40d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be9c8a640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4be40b5e70 0x7f4be40d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be9c8a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4be40afa20 con 0x7f4be40add90 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be9c8a640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f4be40afd00 con 0x7f4be40b5e70 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be9c8a640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f4be40affe0 con 0x7f4be4159c90 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be3fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f4be40b5e70 0x7f4be40d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4bdaffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4be40add90 0x7f4be406b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34948/0 (socket says 172.21.15.81:34948) 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4bdaffd640 1 -- 172.21.15.81:0/1962189164 learned_addr learned my addr 172.21.15.81:0/1962189164 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be37fe640 1 --2- 172.21.15.81:0/1962189164 >> v2:172.21.15.136:3300/0 conn(0x7f4be4159c90 0x7f4be40d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be37fe640 1 -- 172.21.15.81:0/1962189164 >> v2:172.21.15.81:3300/0 conn(0x7f4be40b5e70 msgr2=0x7f4be40d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.279+0000 7f4be37fe640 1 --2- 172.21.15.81:0/1962189164 >> v2:172.21.15.81:3300/0 conn(0x7f4be40b5e70 0x7f4be40d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.280+0000 7f4be37fe640 1 -- 172.21.15.81:0/1962189164 >> v1:172.21.15.81:6789/0 conn(0x7f4be40add90 legacy=0x7f4be406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.280+0000 7f4be37fe640 1 -- 172.21.15.81:0/1962189164 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be40b02c0 con 0x7f4be4159c90 2024-03-18T07:15:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.280+0000 7f4be37fe640 1 --2- 172.21.15.81:0/1962189164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be40d1100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b3b70 tx=0x7f4bd402fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16db2af742576b24 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.281+0000 7f4be2ffd640 1 -- 172.21.15.81:0/1962189164 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd40307f0 con 0x7f4be4159c90 2024-03-18T07:15:05.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.281+0000 7f4be2ffd640 1 -- 172.21.15.81:0/1962189164 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd4030990 con 0x7f4be4159c90 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.281+0000 7f4be2ffd640 1 -- 172.21.15.81:0/1962189164 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd4030d60 con 0x7f4be4159c90 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1962189164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 msgr2=0x7f4be40d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1962189164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be40d1100 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4be40b3b70 tx=0x7f4bd402fc50 comp rx=0 tx=0).stop 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1962189164 shutdown_connections 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1962189164 >> v2:172.21.15.81:3300/0 conn(0x7f4be40b5e70 0x7f4be40d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1962189164 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be40d1100 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1962189164 >> 172.21.15.81:0/1962189164 conn(0x7f4be406c4b0 msgr2=0x7f4be406c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1962189164 shutdown_connections 2024-03-18T07:15:05.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.282+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1962189164 wait complete. 2024-03-18T07:15:05.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.285+0000 7f4be9c8a640 1 Processor -- start 2024-03-18T07:15:05.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.286+0000 7f4be9c8a640 1 -- start start 2024-03-18T07:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.287+0000 7f4be9c8a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 0x7f4be40b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.287+0000 7f4be9c8a640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.287+0000 7f4be9c8a640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be414eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be9c8a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40ae410 con 0x7f4be40add90 2024-03-18T07:15:05.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be9c8a640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f4be40ae290 con 0x7f4be4159c90 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be9c8a640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f4be4072b00 con 0x7f4be40b5e70 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 0x7f4be40b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be414eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:52916/0 (socket says 172.21.15.81:52916) 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be3fff640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be414eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:56014/0 (socket says 172.21.15.81:56014) 2024-03-18T07:15:05.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 -- 172.21.15.81:0/1966600407 learned_addr learned my addr 172.21.15.81:0/1966600407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 0x7f4be40b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56548/0 (socket says 172.21.15.81:56548) 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 -- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 msgr2=0x7f4be414eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be414eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 -- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 msgr2=0x7f4be40b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 0x7f4be40b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 -- 172.21.15.81:0/1966600407 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be40b2ce0 con 0x7f4be40b5e70 2024-03-18T07:15:05.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4bdaffd640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c440 tx=0x7f4bcc001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.288+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc017070 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.289+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be40b2fc0 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.289+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bcc005ce0 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.289+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0072f0 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.289+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be40b3580 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.290+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4bcc01a070 con 0x7f4be40b5e70 2024-03-18T07:15:05.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.291+0000 7f4be0ff9640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 0x7f4bc406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.291+0000 7f4be37fe640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 0x7f4bc406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.291+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f4bcc089ad0 con 0x7f4be40b5e70 2024-03-18T07:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.292+0000 7f4be37fe640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 0x7f4bc406e090 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4039000 tx=0x7f4bd4034000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.292+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be404f5b0 con 0x7f4be40b5e70 2024-03-18T07:15:05.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.297+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4bcc058260 con 0x7f4be40b5e70 2024-03-18T07:15:05.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.526+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f4be40b2a90 con 0x7f4bc406bbd0 2024-03-18T07:15:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.527+0000 7f4be0ff9640 1 -- 172.21.15.81:0/1966600407 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4be40b2a90 con 0x7f4bc406bbd0 2024-03-18T07:15:05.533 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 msgr2=0x7f4bc406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 0x7f4bc406e090 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4bd4039000 tx=0x7f4bd4034000 comp rx=0 tx=0).stop 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 msgr2=0x7f4be4157b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00c440 tx=0x7f4bcc001e70 comp rx=0 tx=0).stop 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 shutdown_connections 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f4be4159c90 0x7f4be414eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f4be40b5e70 0x7f4be4157b70 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.533+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f4bc406bbd0 0x7f4bc406e090 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.534+0000 7f4be9c8a640 1 --2- 172.21.15.81:0/1966600407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4be40add90 0x7f4be40b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.534+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 >> 172.21.15.81:0/1966600407 conn(0x7f4be406c4b0 msgr2=0x7f4be406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.534+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 shutdown_connections 2024-03-18T07:15:05.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.534+0000 7f4be9c8a640 1 -- 172.21.15.81:0/1966600407 wait complete. 2024-03-18T07:15:05.573 INFO:tasks.ceph:Scrubbing osd.5 2024-03-18T07:15:05.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:05.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.732+0000 7fc5811ed640 1 Processor -- start 2024-03-18T07:15:05.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.732+0000 7fc5811ed640 1 -- start start 2024-03-18T07:15:05.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.734+0000 7fc5811ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc5811ed640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc57c06d750 0x7fc57c071b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc5811ed640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fc57c06ed90 0x7fc57c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc5811ed640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c0b53c0 con 0x7fc57c06ed90 2024-03-18T07:15:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc5811ed640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fc57c15c480 con 0x7fc57c06d750 2024-03-18T07:15:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc5811ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c06dcf0 con 0x7fc57c1589e0 2024-03-18T07:15:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc573fff640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fc57c06d750 0x7fc57c071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:39724/0 (socket says 172.21.15.81:39724) 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 -- 172.21.15.81:0/2804046839 learned_addr learned my addr 172.21.15.81:0/2804046839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 -- 172.21.15.81:0/2804046839 >> v2:172.21.15.136:3300/0 conn(0x7fc57c06d750 msgr2=0x7fc57c071b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/2804046839 >> v2:172.21.15.136:3300/0 conn(0x7fc57c06d750 0x7fc57c071b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 -- 172.21.15.81:0/2804046839 >> v2:172.21.15.81:3300/0 conn(0x7fc57c06ed90 msgr2=0x7fc57c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/2804046839 >> v2:172.21.15.81:3300/0 conn(0x7fc57c06ed90 0x7fc57c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.735+0000 7fc57ad9d640 1 -- 172.21.15.81:0/2804046839 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c06dfd0 con 0x7fc57c1589e0 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.736+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/2804046839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0b32b0 tx=0x7fc56c02b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a63e7e19889a3796 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.736+0000 7fc57a59c640 1 -- 172.21.15.81:0/2804046839 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c035020 con 0x7fc57c1589e0 2024-03-18T07:15:05.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.737+0000 7fc57a59c640 1 -- 172.21.15.81:0/2804046839 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c02d040 con 0x7fc57c1589e0 2024-03-18T07:15:05.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.737+0000 7fc57a59c640 1 -- 172.21.15.81:0/2804046839 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c031a80 con 0x7fc57c1589e0 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 -- 172.21.15.81:0/2804046839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 msgr2=0x7fc57c15bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 --2- 172.21.15.81:0/2804046839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0b32b0 tx=0x7fc56c02b900 comp rx=0 tx=0).stop 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 -- 172.21.15.81:0/2804046839 shutdown_connections 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 --2- 172.21.15.81:0/2804046839 >> v2:172.21.15.81:3300/0 conn(0x7fc57c06ed90 0x7fc57c0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 --2- 172.21.15.81:0/2804046839 >> v2:172.21.15.136:3300/0 conn(0x7fc57c06d750 0x7fc57c071b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 --2- 172.21.15.81:0/2804046839 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c1589e0 0x7fc57c15bf40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 -- 172.21.15.81:0/2804046839 >> 172.21.15.81:0/2804046839 conn(0x7fc57c0b2680 msgr2=0x7fc57c0b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 -- 172.21.15.81:0/2804046839 shutdown_connections 2024-03-18T07:15:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.738+0000 7fc5811ed640 1 -- 172.21.15.81:0/2804046839 wait complete. 2024-03-18T07:15:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.741+0000 7fc5811ed640 1 Processor -- start 2024-03-18T07:15:05.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.742+0000 7fc5811ed640 1 -- start start 2024-03-18T07:15:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.743+0000 7fc5811ed640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 0x7fc57c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc5811ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc57c06ed90 0x7fc57c1449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc5811ed640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c1589e0 0x7fc57c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc5811ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c06e870 con 0x7fc57c06ed90 2024-03-18T07:15:05.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc5811ed640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fc57c06e590 con 0x7fc57c1589e0 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc5811ed640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fc57c158dc0 con 0x7fc57c06d750 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 0x7fc57c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 0x7fc57c0b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:39740/0 (socket says 172.21.15.81:39740) 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 -- 172.21.15.81:0/1500935446 learned_addr learned my addr 172.21.15.81:0/1500935446 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc573fff640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc57c06ed90 0x7fc57c1449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57b59e640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c1589e0 0x7fc57c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 -- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c1589e0 msgr2=0x7fc57c155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fc57c1589e0 0x7fc57c155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 -- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc57c06ed90 msgr2=0x7fc57c1449f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc57c06ed90 0x7fc57c1449f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc57c155100 con 0x7fc57c06d750 2024-03-18T07:15:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.744+0000 7fc57ad9d640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 0x7fc57c0b0400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02b940 tx=0x7fc56c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.745+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c040070 con 0x7fc57c06d750 2024-03-18T07:15:05.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.745+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc56c039bf0 con 0x7fc57c06d750 2024-03-18T07:15:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.745+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc57c1553e0 con 0x7fc57c06d750 2024-03-18T07:15:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.745+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc56c035040 con 0x7fc57c06d750 2024-03-18T07:15:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.745+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc57c0b0940 con 0x7fc57c06d750 2024-03-18T07:15:05.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.746+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc57c154eb0 con 0x7fc57c06d750 2024-03-18T07:15:05.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.749+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc56c04b060 con 0x7fc57c06d750 2024-03-18T07:15:05.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.750+0000 7fc5737fe640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc55c06bbd0 0x7fc55c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.750+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fc56c0ac7f0 con 0x7fc57c06d750 2024-03-18T07:15:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.750+0000 7fc573fff640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc55c06bbd0 0x7fc55c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc5737fe640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7fc55c071a90 0x7fc55c073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc55c074560 con 0x7fc55c071a90 2024-03-18T07:15:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fc56c0acba0 con 0x7fc57c06d750 2024-03-18T07:15:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc57b59e640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7fc55c071a90 0x7fc55c073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc573fff640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc55c06bbd0 0x7fc55c06e090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc57c156990 tx=0x7fc564009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.751+0000 7fc57b59e640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7fc55c071a90 0x7fc55c073eb0 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.752+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== osd.5 v2:172.21.15.136:6824/4148726140 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc55c074560 con 0x7fc55c071a90 2024-03-18T07:15:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.766+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 --> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc57c04f540 con 0x7fc55c071a90 2024-03-18T07:15:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.766+0000 7fc5737fe640 1 -- 172.21.15.81:0/1500935446 <== osd.5 v2:172.21.15.136:6824/4148726140 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc57c04f540 con 0x7fc55c071a90 2024-03-18T07:15:05.772 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:05.772 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:05.772 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.766+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7fc55c071a90 msgr2=0x7fc55c073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.766+0000 7fc5811ed640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:6824/4148726140,v1:172.21.15.136:6825/4148726140] conn(0x7fc55c071a90 0x7fc55c073eb0 crc :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.766+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc55c06bbd0 msgr2=0x7fc55c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fc55c06bbd0 0x7fc55c06e090 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fc57c156990 tx=0x7fc564009190 comp rx=0 tx=0).stop 2024-03-18T07:15:05.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 msgr2=0x7fc57c0b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 --2- 172.21.15.81:0/1500935446 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fc57c06d750 0x7fc57c0b0400 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc56c02b940 tx=0x7fc56c0046c0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc57b59e640 1 -- 172.21.15.81:0/1500935446 reap_dead start 2024-03-18T07:15:05.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 shutdown_connections 2024-03-18T07:15:05.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 >> 172.21.15.81:0/1500935446 conn(0x7fc57c0b2680 msgr2=0x7fc57c1569e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 shutdown_connections 2024-03-18T07:15:05.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.767+0000 7fc5811ed640 1 -- 172.21.15.81:0/1500935446 wait complete. 2024-03-18T07:15:05.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-18T07:15:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.939+0000 7f151fa62640 1 Processor -- start 2024-03-18T07:15:05.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.939+0000 7f151fa62640 1 -- start start 2024-03-18T07:15:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.941+0000 7f151fa62640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15181598e0 0x7f15180b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151fa62640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f1518159cc0 0x7f15180d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151fa62640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f151806cc70 0x7f15180d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151fa62640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f15180b3c80 con 0x7f1518159cc0 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151fa62640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f151815fc70 con 0x7f15181598e0 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151fa62640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f151815ff50 con 0x7f151806cc70 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15181598e0 0x7f15180b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f15181598e0 0x7f15180b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:52988/0 (socket says 172.21.15.81:52988) 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 -- 172.21.15.81:0/4271509335 learned_addr learned my addr 172.21.15.81:0/4271509335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151dfff640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f151806cc70 0x7f15180d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151cffd640 1 --2- 172.21.15.81:0/4271509335 >> v2:172.21.15.81:3300/0 conn(0x7f1518159cc0 0x7f15180d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 -- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f151806cc70 msgr2=0x7f15180d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f151806cc70 0x7f15180d0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 -- 172.21.15.81:0/4271509335 >> v2:172.21.15.81:3300/0 conn(0x7f1518159cc0 msgr2=0x7f15180d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 --2- 172.21.15.81:0/4271509335 >> v2:172.21.15.81:3300/0 conn(0x7f1518159cc0 0x7f15180d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.942+0000 7f151d7fe640 1 -- 172.21.15.81:0/4271509335 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518160230 con 0x7f15181598e0 2024-03-18T07:15:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.943+0000 7f151d7fe640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15181598e0 0x7f15180b3740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f151806e4e0 tx=0x7f151402b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=997d209965dc61db server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.943+0000 7f150ffff640 1 -- 172.21.15.81:0/4271509335 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514035020 con 0x7f15181598e0 2024-03-18T07:15:05.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.943+0000 7f150ffff640 1 -- 172.21.15.81:0/4271509335 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514031880 con 0x7f15181598e0 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.943+0000 7f150ffff640 1 -- 172.21.15.81:0/4271509335 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514031c50 con 0x7f15181598e0 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 -- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15181598e0 msgr2=0x7f15180b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15181598e0 0x7f15180b3740 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f151806e4e0 tx=0x7f151402b920 comp rx=0 tx=0).stop 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 -- 172.21.15.81:0/4271509335 shutdown_connections 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f151806cc70 0x7f15180d0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 --2- 172.21.15.81:0/4271509335 >> v2:172.21.15.81:3300/0 conn(0x7f1518159cc0 0x7f15180d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 --2- 172.21.15.81:0/4271509335 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f15181598e0 0x7f15180b3740 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 -- 172.21.15.81:0/4271509335 >> 172.21.15.81:0/4271509335 conn(0x7f151806b5e0 msgr2=0x7f151806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:05.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 -- 172.21.15.81:0/4271509335 shutdown_connections 2024-03-18T07:15:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.945+0000 7f151fa62640 1 -- 172.21.15.81:0/4271509335 wait complete. 2024-03-18T07:15:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.948+0000 7f151fa62640 1 Processor -- start 2024-03-18T07:15:05.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.948+0000 7f151fa62640 1 -- start start 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15181598e0 0x7f15181f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1518159cc0 0x7f15181f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15180acd80 con 0x7f151806cc70 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f15181607f0 con 0x7f1518159cc0 2024-03-18T07:15:05.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151fa62640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f15180acf00 con 0x7f15181598e0 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151d7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151d7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56892/0 (socket says 172.21.15.81:56892) 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151d7fe640 1 -- 172.21.15.81:0/519867073 learned_addr learned my addr 172.21.15.81:0/519867073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.950+0000 7f151dfff640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1518159cc0 0x7f15181f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151cffd640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15181598e0 0x7f15181f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 -- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15181598e0 msgr2=0x7f15181f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15181598e0 0x7f15181f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 -- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1518159cc0 msgr2=0x7f15181f2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1518159cc0 0x7f15181f2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 -- 172.21.15.81:0/519867073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1518150e20 con 0x7f151806cc70 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.951+0000 7f151d7fe640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f1514000c00 tx=0x7f15140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.952+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514040070 con 0x7f151806cc70 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.952+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15181f5e00 con 0x7f151806cc70 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.952+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1514030d10 con 0x7f151806cc70 2024-03-18T07:15:05.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.952+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15181f5b20 con 0x7f151806cc70 2024-03-18T07:15:05.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.952+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1514035040 con 0x7f151806cc70 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.953+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f151804f5b0 con 0x7f151806cc70 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.954+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1514038020 con 0x7f151806cc70 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.955+0000 7f150dffb640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 0x7f14fc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.955+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f15140acb70 con 0x7f151806cc70 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.955+0000 7f151cffd640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 0x7f14fc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:05.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.955+0000 7f151cffd640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 0x7f14fc06e090 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f15180b19c0 tx=0x7f1508008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:05.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:05.978+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1518150e20 con 0x7f151806cc70 2024-03-18T07:15:06.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.152+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f15180d0300 con 0x7f14fc06bbd0 2024-03-18T07:15:06.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.153+0000 7f150dffb640 1 -- 172.21.15.81:0/519867073 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f15180d0300 con 0x7f14fc06bbd0 2024-03-18T07:15:06.159 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-03-18T07:15:06.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 msgr2=0x7f14fc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 0x7f14fc06e090 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f15180b19c0 tx=0x7f1508008040 comp rx=0 tx=0).stop 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 msgr2=0x7f15181508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 secure :-1 s=READY pgs=3265 cs=0 l=1 rev1=1 crypto rx=0x7f1514000c00 tx=0x7f15140046c0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 shutdown_connections 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1518159cc0 0x7f15181f2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f15181598e0 0x7f15181f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f14fc06bbd0 0x7f14fc06e090 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 --2- 172.21.15.81:0/519867073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f151806cc70 0x7f15181508e0 unknown :-1 s=CLOSED pgs=3265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 >> 172.21.15.81:0/519867073 conn(0x7f151806b5e0 msgr2=0x7f151815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:06.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 shutdown_connections 2024-03-18T07:15:06.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.155+0000 7f151fa62640 1 -- 172.21.15.81:0/519867073 wait complete. 2024-03-18T07:15:06.175 INFO:tasks.ceph:Scrubbing osd.6 2024-03-18T07:15:06.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.427+0000 7f112edcd640 1 Processor -- start 2024-03-18T07:15:06.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.427+0000 7f112edcd640 1 -- start start 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112edcd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 0x7f112806e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112edcd640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f1128072cb0 0x7f11280d0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112edcd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11280d0b40 con 0x7f1128071e90 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112edcd640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f1128073130 con 0x7f1128072cb0 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112edcd640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11280cf2c0 con 0x7f112815b130 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112d36a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1128071e90 0x7f11280cb3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41156/0 (socket says 172.21.15.81:41156) 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112d36a640 1 -- 172.21.15.81:0/829167571 learned_addr learned my addr 172.21.15.81:0/829167571 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f1127fff640 1 --2- 172.21.15.81:0/829167571 >> v2:172.21.15.136:3300/0 conn(0x7f1128072cb0 0x7f11280d0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.429+0000 7f112cb69640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 0x7f112806e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f11277fe640 1 -- 172.21.15.81:0/829167571 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674006210 0 0) 0x7f11280d0b40 con 0x7f1128071e90 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f11277fe640 1 -- 172.21.15.81:0/829167571 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1114003520 con 0x7f1128071e90 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f1127fff640 1 -- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 msgr2=0x7f112806e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f1127fff640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 0x7f112806e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f1127fff640 1 -- 172.21.15.81:0/829167571 >> v1:172.21.15.81:6789/0 conn(0x7f1128071e90 legacy=0x7f11280cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f1127fff640 1 -- 172.21.15.81:0/829167571 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11280cf560 con 0x7f1128072cb0 2024-03-18T07:15:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.430+0000 7f112cb69640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 0x7f112806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.432+0000 7f1127fff640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128072cb0 0x7f11280d0600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11100097a0 tx=0x7f111002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45c31086fc0dfdd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.432+0000 7f11277fe640 1 -- 172.21.15.81:0/829167571 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110035020 con 0x7f1128072cb0 2024-03-18T07:15:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.432+0000 7f11277fe640 1 -- 172.21.15.81:0/829167571 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1110031830 con 0x7f1128072cb0 2024-03-18T07:15:06.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.432+0000 7f11277fe640 1 -- 172.21.15.81:0/829167571 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1110031be0 con 0x7f1128072cb0 2024-03-18T07:15:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 -- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128072cb0 msgr2=0x7f11280d0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128072cb0 0x7f11280d0600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f11100097a0 tx=0x7f111002b8d0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 -- 172.21.15.81:0/829167571 shutdown_connections 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f1128072cb0 0x7f11280d0600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 --2- 172.21.15.81:0/829167571 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f112815b130 0x7f112806e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 -- 172.21.15.81:0/829167571 >> 172.21.15.81:0/829167571 conn(0x7f11280d0da0 msgr2=0x7f11280d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.433+0000 7f112edcd640 1 -- 172.21.15.81:0/829167571 shutdown_connections 2024-03-18T07:15:06.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.434+0000 7f112edcd640 1 -- 172.21.15.81:0/829167571 wait complete. 2024-03-18T07:15:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.436+0000 7f112edcd640 1 Processor -- start 2024-03-18T07:15:06.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.437+0000 7f112edcd640 1 -- start start 2024-03-18T07:15:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 0x7f1128152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128072cb0 0x7f11280c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112815b130 0x7f11280c6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11280cfe00 con 0x7f1128072cb0 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f11280cfb20 con 0x7f112815b130 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112edcd640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f11280d00e0 con 0x7f1128071e90 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 0x7f1128152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 0x7f1128152860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:39768/0 (socket says 172.21.15.81:39768) 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 -- 172.21.15.81:0/658041095 learned_addr learned my addr 172.21.15.81:0/658041095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:06.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f1127fff640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128072cb0 0x7f11280c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112d36a640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112815b130 0x7f11280c6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 -- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112815b130 msgr2=0x7f11280c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f112815b130 0x7f11280c6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 -- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128072cb0 msgr2=0x7f11280c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128072cb0 0x7f11280c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f112cb69640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11280b3da0 con 0x7f1128071e90 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.439+0000 7f1127fff640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1128072cb0 0x7f11280c60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:06.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f112cb69640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 0x7f1128152860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1118009ec0 tx=0x7f111800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118018020 con 0x7f1128071e90 2024-03-18T07:15:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1118014680 con 0x7f1128071e90 2024-03-18T07:15:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1118014a50 con 0x7f1128071e90 2024-03-18T07:15:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11280b4080 con 0x7f1128071e90 2024-03-18T07:15:06.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.440+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11281553f0 con 0x7f1128071e90 2024-03-18T07:15:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.441+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f112804f540 con 0x7f1128071e90 2024-03-18T07:15:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1118005d10 con 0x7f1128071e90 2024-03-18T07:15:06.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f110806bbd0 0x7f110806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f111808bb80 con 0x7f1128071e90 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f1108071a90 0x7f1108073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f111801ae50 con 0x7f1108071a90 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f111808c010 con 0x7f1128071e90 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.443+0000 7f1127fff640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f110806bbd0 0x7f110806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.444+0000 7f112d36a640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f1108071a90 0x7f1108073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.444+0000 7f112d36a640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f1108071a90 0x7f1108073eb0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.444+0000 7f1127fff640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f110806bbd0 0x7f110806e090 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1110036000 tx=0x7f1110008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.445+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== osd.6 v2:172.21.15.136:6814/2186134377 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f111801ae50 con 0x7f1108071a90 2024-03-18T07:15:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.458+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 --> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1128072a90 con 0x7f1108071a90 2024-03-18T07:15:06.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.458+0000 7f11257fa640 1 -- 172.21.15.81:0/658041095 <== osd.6 v2:172.21.15.136:6814/2186134377 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1128072a90 con 0x7f1108071a90 2024-03-18T07:15:06.464 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:06.465 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:06.465 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f1108071a90 msgr2=0x7f1108073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:6814/2186134377,v1:172.21.15.136:6816/2186134377] conn(0x7f1108071a90 0x7f1108073eb0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f110806bbd0 msgr2=0x7f110806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f110806bbd0 0x7f110806e090 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f1110036000 tx=0x7f1110008030 comp rx=0 tx=0).stop 2024-03-18T07:15:06.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 msgr2=0x7f1128152860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 --2- 172.21.15.81:0/658041095 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f1128071e90 0x7f1128152860 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1118009ec0 tx=0x7f111800c490 comp rx=0 tx=0).stop 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112d36a640 1 -- 172.21.15.81:0/658041095 reap_dead start 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 shutdown_connections 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 >> 172.21.15.81:0/658041095 conn(0x7f11280d0da0 msgr2=0x7f11280b0940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 shutdown_connections 2024-03-18T07:15:06.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.459+0000 7f112edcd640 1 -- 172.21.15.81:0/658041095 wait complete. 2024-03-18T07:15:06.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-18T07:15:06.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.628+0000 7fad1e7ef640 1 Processor -- start 2024-03-18T07:15:06.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.628+0000 7fad1e7ef640 1 -- start start 2024-03-18T07:15:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.630+0000 7fad1e7ef640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad1815ad80 0x7fad180cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1e7ef640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 0x7fad180cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1e7ef640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad180cf700 con 0x7fad180cd7a0 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1e7ef640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fad180cbf40 con 0x7fad1815ad80 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1e7ef640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7fad180cf9e0 con 0x7fad1815ea30 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad17fff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fad1815ad80 0x7fad180cba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1cd8c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad180cd7a0 0x7fad1806f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41158/0 (socket says 172.21.15.81:41158) 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad1cd8c640 1 -- 172.21.15.81:0/677985651 learned_addr learned my addr 172.21.15.81:0/677985651 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad177fe640 1 --2- 172.21.15.81:0/677985651 >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 0x7fad180cee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad17fff640 1 -- 172.21.15.81:0/677985651 >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 msgr2=0x7fad180cee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad17fff640 1 --2- 172.21.15.81:0/677985651 >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 0x7fad180cee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad17fff640 1 -- 172.21.15.81:0/677985651 >> v1:172.21.15.81:6789/0 conn(0x7fad180cd7a0 legacy=0x7fad1806f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad17fff640 1 -- 172.21.15.81:0/677985651 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad180cfcc0 con 0x7fad1815ad80 2024-03-18T07:15:06.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.631+0000 7fad177fe640 1 --2- 172.21.15.81:0/677985651 >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 0x7fad180cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.633+0000 7fad17fff640 1 --2- 172.21.15.81:0/677985651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad180cba00 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7fad180d0d10 tx=0x7fad0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34cfcf759b6dd37 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.633+0000 7fad16ffd640 1 -- 172.21.15.81:0/677985651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08035020 con 0x7fad1815ad80 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.633+0000 7fad16ffd640 1 -- 172.21.15.81:0/677985651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad08031830 con 0x7fad1815ad80 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad16ffd640 1 -- 172.21.15.81:0/677985651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad08031c00 con 0x7fad1815ad80 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 -- 172.21.15.81:0/677985651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 msgr2=0x7fad180cba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/677985651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad180cba00 secure :-1 s=READY pgs=3268 cs=0 l=1 rev1=1 crypto rx=0x7fad180d0d10 tx=0x7fad0802b8d0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 -- 172.21.15.81:0/677985651 shutdown_connections 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/677985651 >> v2:172.21.15.136:3300/0 conn(0x7fad1815ea30 0x7fad180cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/677985651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad180cba00 unknown :-1 s=CLOSED pgs=3268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 -- 172.21.15.81:0/677985651 >> 172.21.15.81:0/677985651 conn(0x7fad180b2a40 msgr2=0x7fad180b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 -- 172.21.15.81:0/677985651 shutdown_connections 2024-03-18T07:15:06.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.634+0000 7fad1e7ef640 1 -- 172.21.15.81:0/677985651 wait complete. 2024-03-18T07:15:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.637+0000 7fad1e7ef640 1 Processor -- start 2024-03-18T07:15:06.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.638+0000 7fad1e7ef640 1 -- start start 2024-03-18T07:15:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad180cd7a0 0x7fad1815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad181f5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 0x7fad181f6320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad1815b160 con 0x7fad1815ad80 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fad1806eb20 con 0x7fad180cd7a0 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1e7ef640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fad180cf360 con 0x7fad1815ea30 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad181f5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad177fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad181f5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56918/0 (socket says 172.21.15.81:56918) 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad177fe640 1 -- 172.21.15.81:0/2100726707 learned_addr learned my addr 172.21.15.81:0/2100726707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1cd8c640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 0x7fad181f6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad17fff640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad180cd7a0 0x7fad1815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.640+0000 7fad1cd8c640 1 -- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad180cd7a0 msgr2=0x7fad1815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1cd8c640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad180cd7a0 0x7fad1815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1cd8c640 1 -- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 msgr2=0x7fad181f5de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1cd8c640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad181f5de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1cd8c640 1 -- 172.21.15.81:0/2100726707 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad1815e220 con 0x7fad1815ea30 2024-03-18T07:15:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1cd8c640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 0x7fad181f6320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cad0 tx=0x7fad1000cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10017070 con 0x7fad1815ea30 2024-03-18T07:15:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad1000ab70 con 0x7fad1815ea30 2024-03-18T07:15:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad1814c130 con 0x7fad1815ea30 2024-03-18T07:15:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad10012400 con 0x7fad1815ea30 2024-03-18T07:15:06.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.641+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fad1814c3d0 con 0x7fad1815ea30 2024-03-18T07:15:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.643+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fad1001a070 con 0x7fad1815ea30 2024-03-18T07:15:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.643+0000 7fad14ff9640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 0x7fad0406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.644+0000 7fad17fff640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 0x7fad0406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:06.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.644+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fad1008a350 con 0x7fad1815ea30 2024-03-18T07:15:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.644+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad1804f5b0 con 0x7fad1815ea30 2024-03-18T07:15:06.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.644+0000 7fad17fff640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 0x7fad0406e090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fad08036000 tx=0x7fad08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:06.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.649+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fad10058a50 con 0x7fad1815ea30 2024-03-18T07:15:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.825+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fad18143d70 con 0x7fad0406bbd0 2024-03-18T07:15:06.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.825+0000 7fad14ff9640 1 -- 172.21.15.81:0/2100726707 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fad080318b0 con 0x7fad0406bbd0 2024-03-18T07:15:06.832 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-03-18T07:15:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 msgr2=0x7fad0406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 0x7fad0406e090 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fad08036000 tx=0x7fad08008030 comp rx=0 tx=0).stop 2024-03-18T07:15:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 msgr2=0x7fad181f6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 0x7fad181f6320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fad1000cad0 tx=0x7fad1000cf90 comp rx=0 tx=0).stop 2024-03-18T07:15:06.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 shutdown_connections 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fad1815ea30 0x7fad181f6320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fad0406bbd0 0x7fad0406e090 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fad1815ad80 0x7fad181f5de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 --2- 172.21.15.81:0/2100726707 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fad180cd7a0 0x7fad1815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.831+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 >> 172.21.15.81:0/2100726707 conn(0x7fad180b2a40 msgr2=0x7fad1814d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.832+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 shutdown_connections 2024-03-18T07:15:06.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:06.832+0000 7fad1e7ef640 1 -- 172.21.15.81:0/2100726707 wait complete. 2024-03-18T07:15:06.870 INFO:tasks.ceph:Scrubbing osd.7 2024-03-18T07:15:06.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-18T07:15:07.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.029+0000 7f9f062d9640 1 Processor -- start 2024-03-18T07:15:07.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.029+0000 7f9f062d9640 1 -- start start 2024-03-18T07:15:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f001617d0 0x7f9f0006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9f000997a0 0x7f9f0006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 0x7f9f000b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f9f00161bb0 con 0x7f9f000b5040 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f9f000c6720 con 0x7f9f000997a0 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.031+0000 7f9f062d9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9f000c6a00 con 0x7f9f001617d0 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9f000997a0 0x7f9f0006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f052d7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f001617d0 0x7f9f0006b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f9f000997a0 0x7f9f0006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:53022/0 (socket says 172.21.15.81:53022) 2024-03-18T07:15:07.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 -- 172.21.15.81:0/3806790457 learned_addr learned my addr 172.21.15.81:0/3806790457 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f05ad8640 1 --2- 172.21.15.81:0/3806790457 >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 0x7f9f000b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 -- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f001617d0 msgr2=0x7f9f0006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 --2- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f001617d0 0x7f9f0006b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 -- 172.21.15.81:0/3806790457 >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 msgr2=0x7f9f000b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 --2- 172.21.15.81:0/3806790457 >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 0x7f9f000b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f04ad6640 1 -- 172.21.15.81:0/3806790457 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f000c6ce0 con 0x7f9f000997a0 2024-03-18T07:15:07.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.032+0000 7f9f05ad8640 1 --2- 172.21.15.81:0/3806790457 >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 0x7f9f000b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T07:15:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.033+0000 7f9f04ad6640 1 --2- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f000997a0 0x7f9f0006b700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9f00070f20 tx=0x7f9ef002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16487b828827d3bb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.033+0000 7f9ef7fff640 1 -- 172.21.15.81:0/3806790457 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0035020 con 0x7f9f000997a0 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.033+0000 7f9ef7fff640 1 -- 172.21.15.81:0/3806790457 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef0031870 con 0x7f9f000997a0 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.033+0000 7f9ef7fff640 1 -- 172.21.15.81:0/3806790457 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef0031c40 con 0x7f9f000997a0 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.034+0000 7f9f062d9640 1 -- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f000997a0 msgr2=0x7f9f0006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.034+0000 7f9f062d9640 1 --2- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f000997a0 0x7f9f0006b700 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9f00070f20 tx=0x7f9ef002b910 comp rx=0 tx=0).stop 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 -- 172.21.15.81:0/3806790457 shutdown_connections 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 --2- 172.21.15.81:0/3806790457 >> v2:172.21.15.81:3300/0 conn(0x7f9f000b5040 0x7f9f000b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 --2- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f000997a0 0x7f9f0006b700 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 --2- 172.21.15.81:0/3806790457 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f001617d0 0x7f9f0006b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 -- 172.21.15.81:0/3806790457 >> 172.21.15.81:0/3806790457 conn(0x7f9f000727c0 msgr2=0x7f9f00072bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 -- 172.21.15.81:0/3806790457 shutdown_connections 2024-03-18T07:15:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.035+0000 7f9f062d9640 1 -- 172.21.15.81:0/3806790457 wait complete. 2024-03-18T07:15:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.038+0000 7f9f062d9640 1 Processor -- start 2024-03-18T07:15:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.038+0000 7f9f062d9640 1 -- start start 2024-03-18T07:15:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f000997a0 0x7f9f000cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f000b5040 0x7f9f000cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 0x7f9f000c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f000c62d0 con 0x7f9f000997a0 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0006d750 con 0x7f9f001617d0 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f062d9640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f9f000c6450 con 0x7f9f000b5040 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f052d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f000997a0 0x7f9f000cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f05ad8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 0x7f9f000c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f052d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f000997a0 0x7f9f000cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56930/0 (socket says 172.21.15.81:56930) 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f05ad8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 0x7f9f000c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:53038/0 (socket says 172.21.15.81:53038) 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f052d7640 1 -- 172.21.15.81:0/1076373635 learned_addr learned my addr 172.21.15.81:0/1076373635 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.040+0000 7f9f04ad6640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f000b5040 0x7f9f000cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 -- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f000b5040 msgr2=0x7f9f000cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f9f000b5040 0x7f9f000cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 -- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f000997a0 msgr2=0x7f9f000cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f000997a0 0x7f9f000cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f000cd6e0 con 0x7f9f001617d0 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f05ad8640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 0x7f9f000c83d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8007d40 tx=0x7f9ef800d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef801a070 con 0x7f9f001617d0 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ef8007e30 con 0x7f9f001617d0 2024-03-18T07:15:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f000d0420 con 0x7f9f001617d0 2024-03-18T07:15:07.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.041+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ef8003b90 con 0x7f9f001617d0 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.042+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f000d09e0 con 0x7f9f001617d0 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.043+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9ef801d070 con 0x7f9f001617d0 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.044+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9f0004f540 con 0x7f9f001617d0 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.044+0000 7f9ef5ffb640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9ee406bbd0 0x7f9ee406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.044+0000 7f9f052d7640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9ee406bbd0 0x7f9ee406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.044+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f9ef808a790 con 0x7f9f001617d0 2024-03-18T07:15:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.045+0000 7f9ef5ffb640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7f9ee4071a90 0x7f9ee4073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.045+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ef8021e50 con 0x7f9ee4071a90 2024-03-18T07:15:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.045+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9ef8091050 con 0x7f9f001617d0 2024-03-18T07:15:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.045+0000 7f9f04ad6640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7f9ee4071a90 0x7f9ee4073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.045+0000 7f9f052d7640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9ee406bbd0 0x7f9ee406e090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009c00 tx=0x7f9efc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.046+0000 7f9f04ad6640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7f9ee4071a90 0x7f9ee4073eb0 crc :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.046+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== osd.7 v2:172.21.15.136:6808/3828864915 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ef8021e50 con 0x7f9ee4071a90 2024-03-18T07:15:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.084+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 --> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9f000d0e20 con 0x7f9ee4071a90 2024-03-18T07:15:07.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.085+0000 7f9ef5ffb640 1 -- 172.21.15.81:0/1076373635 <== osd.7 v2:172.21.15.136:6808/3828864915 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9f000d0e20 con 0x7f9ee4071a90 2024-03-18T07:15:07.091 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-03-18T07:15:07.091 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T07:15:07.092 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.085+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7f9ee4071a90 msgr2=0x7f9ee4073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.085+0000 7f9f062d9640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:6808/3828864915,v1:172.21.15.136:6809/3828864915] conn(0x7f9ee4071a90 0x7f9ee4073eb0 crc :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9ee406bbd0 msgr2=0x7f9ee406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f9ee406bbd0 0x7f9ee406e090 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f9efc009c00 tx=0x7f9efc009190 comp rx=0 tx=0).stop 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 msgr2=0x7f9f000c83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 --2- 172.21.15.81:0/1076373635 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f9f001617d0 0x7f9f000c83d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f9ef8007d40 tx=0x7f9ef800d4a0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f05ad8640 1 -- 172.21.15.81:0/1076373635 reap_dead start 2024-03-18T07:15:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 shutdown_connections 2024-03-18T07:15:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 >> 172.21.15.81:0/1076373635 conn(0x7f9f000727c0 msgr2=0x7f9f000c5780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 shutdown_connections 2024-03-18T07:15:07.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.086+0000 7f9f062d9640 1 -- 172.21.15.81:0/1076373635 wait complete. 2024-03-18T07:15:07.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-18T07:15:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.384+0000 7f0b96177640 1 Processor -- start 2024-03-18T07:15:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.385+0000 7f0b96177640 1 -- start start 2024-03-18T07:15:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b96177640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b9006b1c0 0x7f0b9015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b96177640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b9006f700 0x7f0b9006dc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b96177640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b900b5cd0 con 0x7f0b900b57f0 2024-03-18T07:15:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b96177640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7f0b900b40b0 con 0x7f0b9006f700 2024-03-18T07:15:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b96177640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f0b9015e890 con 0x7f0b9006b1c0 2024-03-18T07:15:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b86ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0b900b57f0 0x7f0b9006b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:41160/0 (socket says 172.21.15.81:41160) 2024-03-18T07:15:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b8f7fe640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f0b9006b1c0 0x7f0b9015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b8ffff640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7f0b9006f700 0x7f0b9006dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b86ffd640 1 -- 172.21.15.81:0/3281017359 learned_addr learned my addr 172.21.15.81:0/3281017359 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.387+0000 7f0b8f7fe640 1 -- 172.21.15.81:0/3281017359 >> v2:172.21.15.81:3300/0 conn(0x7f0b9006f700 msgr2=0x7f0b9006dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.388+0000 7f0b8f7fe640 1 --2- 172.21.15.81:0/3281017359 >> v2:172.21.15.81:3300/0 conn(0x7f0b9006f700 0x7f0b9006dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.388+0000 7f0b8f7fe640 1 -- 172.21.15.81:0/3281017359 >> v1:172.21.15.81:6789/0 conn(0x7f0b900b57f0 legacy=0x7f0b9006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.388+0000 7f0b8f7fe640 1 -- 172.21.15.81:0/3281017359 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b9015eb70 con 0x7f0b9006b1c0 2024-03-18T07:15:07.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.389+0000 7f0b8f7fe640 1 --2- 172.21.15.81:0/3281017359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006b1c0 0x7f0b9015f370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b90067fb0 tx=0x7f0b8002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39749276c2a5f9a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.389+0000 7f0b8effd640 1 -- 172.21.15.81:0/3281017359 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80035020 con 0x7f0b9006b1c0 2024-03-18T07:15:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.389+0000 7f0b8effd640 1 -- 172.21.15.81:0/3281017359 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b80031830 con 0x7f0b9006b1c0 2024-03-18T07:15:07.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.389+0000 7f0b8effd640 1 -- 172.21.15.81:0/3281017359 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b80031c00 con 0x7f0b9006b1c0 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 -- 172.21.15.81:0/3281017359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006b1c0 msgr2=0x7f0b9015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 --2- 172.21.15.81:0/3281017359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006b1c0 0x7f0b9015f370 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0b90067fb0 tx=0x7f0b8002b8d0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 -- 172.21.15.81:0/3281017359 shutdown_connections 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 --2- 172.21.15.81:0/3281017359 >> v2:172.21.15.81:3300/0 conn(0x7f0b9006f700 0x7f0b9006dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 --2- 172.21.15.81:0/3281017359 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006b1c0 0x7f0b9015f370 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 -- 172.21.15.81:0/3281017359 >> 172.21.15.81:0/3281017359 conn(0x7f0b900b2a40 msgr2=0x7f0b900b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 -- 172.21.15.81:0/3281017359 shutdown_connections 2024-03-18T07:15:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.390+0000 7f0b96177640 1 -- 172.21.15.81:0/3281017359 wait complete. 2024-03-18T07:15:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.393+0000 7f0b96177640 1 Processor -- start 2024-03-18T07:15:07.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.394+0000 7f0b96177640 1 -- start start 2024-03-18T07:15:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 0x7f0b901404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 0x7f0b90141a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b900b57f0 0x7f0b901f4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b9015e450 con 0x7f0b9006b1c0 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f0b900b5fb0 con 0x7f0b9006f700 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b96177640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f0b9015e5d0 con 0x7f0b900b57f0 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 0x7f0b901404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b86ffd640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 0x7f0b90141a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 0x7f0b901404b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56942/0 (socket says 172.21.15.81:56942) 2024-03-18T07:15:07.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b8f7fe640 1 -- 172.21.15.81:0/2927092068 learned_addr learned my addr 172.21.15.81:0/2927092068 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b8ffff640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b900b57f0 0x7f0b901f4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b86ffd640 1 -- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b900b57f0 msgr2=0x7f0b901f4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b86ffd640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b900b57f0 0x7f0b901f4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.396+0000 7f0b86ffd640 1 -- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 msgr2=0x7f0b901404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b86ffd640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 0x7f0b901404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b86ffd640 1 -- 172.21.15.81:0/2927092068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b90143a20 con 0x7f0b9006f700 2024-03-18T07:15:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b86ffd640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 0x7f0b90141a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b900b5c00 tx=0x7f0b7800c760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78017070 con 0x7f0b9006f700 2024-03-18T07:15:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b78005ce0 con 0x7f0b9006f700 2024-03-18T07:15:07.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b90143d00 con 0x7f0b9006f700 2024-03-18T07:15:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b78007310 con 0x7f0b9006f700 2024-03-18T07:15:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.397+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b901f4840 con 0x7f0b9006f700 2024-03-18T07:15:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.399+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b9004f5b0 con 0x7f0b9006f700 2024-03-18T07:15:07.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.400+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0b7801a070 con 0x7f0b9006f700 2024-03-18T07:15:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.401+0000 7f0b8cff9640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 0x7f0b7006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.401+0000 7f0b8f7fe640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 0x7f0b7006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.401+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f0b780899b0 con 0x7f0b9006f700 2024-03-18T07:15:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.402+0000 7f0b8f7fe640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 0x7f0b7006e090 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009560 tx=0x7f0b80008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.405+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0b780580b0 con 0x7f0b9006f700 2024-03-18T07:15:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.932+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f0b901f4a10 con 0x7f0b7006bbd0 2024-03-18T07:15:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.932+0000 7f0b8cff9640 1 -- 172.21.15.81:0/2927092068 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0b901f4a10 con 0x7f0b7006bbd0 2024-03-18T07:15:07.938 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-03-18T07:15:07.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 msgr2=0x7f0b7006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 0x7f0b7006e090 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0b80009560 tx=0x7f0b80008030 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 msgr2=0x7f0b90141a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 0x7f0b90141a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b900b5c00 tx=0x7f0b7800c760 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 shutdown_connections 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f0b900b57f0 0x7f0b901f4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f0b9006f700 0x7f0b90141a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f0b7006bbd0 0x7f0b7006e090 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 --2- 172.21.15.81:0/2927092068 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b9006b1c0 0x7f0b901404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.936+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 >> 172.21.15.81:0/2927092068 conn(0x7f0b900b2a40 msgr2=0x7f0b900b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:07.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.937+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 shutdown_connections 2024-03-18T07:15:07.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:07.937+0000 7f0b96177640 1 -- 172.21.15.81:0/2927092068 wait complete. 2024-03-18T07:15:07.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T07:15:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.237+0000 7ff30faf8640 1 Processor -- start 2024-03-18T07:15:08.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.237+0000 7ff30faf8640 1 -- start start 2024-03-18T07:15:08.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.239+0000 7ff30faf8640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff3080d0b20 0x7ff3080cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.239+0000 7ff30faf8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3080cfc10 con 0x7ff3080d2950 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.239+0000 7ff30faf8640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3080cfed0 con 0x7ff30815c470 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.239+0000 7ff30faf8640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff3080d01b0 con 0x7ff3080d0b20 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30d894640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7ff30815c470 0x7ff3080d0410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:58726/0 (socket says 172.21.15.81:58726) 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30d894640 1 -- 172.21.15.81:0/2058805503 learned_addr learned my addr 172.21.15.81:0/2058805503 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:08.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30d093640 1 --2- 172.21.15.81:0/2058805503 >> v2:172.21.15.81:3300/0 conn(0x7ff3080d0b20 0x7ff3080cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183509432 0 0) 0x7ff3080cfed0 con 0x7ff30815c470 2024-03-18T07:15:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2f4003520 con 0x7ff30815c470 2024-03-18T07:15:08.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189476664 0 0) 0x7ff3080cfc10 con 0x7ff3080d2950 2024-03-18T07:15:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3080cfed0 con 0x7ff3080d2950 2024-03-18T07:15:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.240+0000 7ff30d093640 1 -- 172.21.15.81:0/2058805503 >> v1:172.21.15.136:6789/0 conn(0x7ff30815c470 legacy=0x7ff3080d0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.241+0000 7ff30d093640 1 -- 172.21.15.81:0/2058805503 >> v1:172.21.15.81:6789/0 conn(0x7ff3080d2950 legacy=0x7ff3080b1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.241+0000 7ff30d093640 1 -- 172.21.15.81:0/2058805503 --> v2:172.21.15.81:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3080b1470 con 0x7ff3080d0b20 2024-03-18T07:15:08.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.243+0000 7ff30d093640 1 --2- 172.21.15.81:0/2058805503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff3080cee70 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097a0 tx=0x7ff2f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6798f183393de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.243+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8034070 con 0x7ff3080d0b20 2024-03-18T07:15:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.243+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f8030610 con 0x7ff3080d0b20 2024-03-18T07:15:08.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.243+0000 7ff30c892640 1 -- 172.21.15.81:0/2058805503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80309c0 con 0x7ff3080d0b20 2024-03-18T07:15:08.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.244+0000 7ff30faf8640 1 -- 172.21.15.81:0/2058805503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 msgr2=0x7ff3080cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.244+0000 7ff30faf8640 1 --2- 172.21.15.81:0/2058805503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff3080cee70 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097a0 tx=0x7ff2f802b960 comp rx=0 tx=0).stop 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.244+0000 7ff30faf8640 1 -- 172.21.15.81:0/2058805503 shutdown_connections 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.244+0000 7ff30faf8640 1 --2- 172.21.15.81:0/2058805503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff3080cee70 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.244+0000 7ff30faf8640 1 -- 172.21.15.81:0/2058805503 >> 172.21.15.81:0/2058805503 conn(0x7ff3080d1e30 msgr2=0x7ff3080d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.245+0000 7ff30faf8640 1 -- 172.21.15.81:0/2058805503 shutdown_connections 2024-03-18T07:15:08.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.245+0000 7ff30faf8640 1 -- 172.21.15.81:0/2058805503 wait complete. 2024-03-18T07:15:08.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.246+0000 7ff30faf8640 1 Processor -- start 2024-03-18T07:15:08.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.246+0000 7ff30faf8640 1 -- start start 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff308159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 0x7ff308158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3080b2660 con 0x7ff3080d0b20 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff3080b1a30 con 0x7ff3080d2950 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.247+0000 7ff30faf8640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff3080b27e0 con 0x7ff30815c470 2024-03-18T07:15:08.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff308159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30e095640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 0x7ff308158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:53078/0 (socket says 172.21.15.81:53078) 2024-03-18T07:15:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d894640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff308159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56966/0 (socket says 172.21.15.81:56966) 2024-03-18T07:15:08.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 -- 172.21.15.81:0/304910879 learned_addr learned my addr 172.21.15.81:0/304910879 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:08.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 -- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 msgr2=0x7ff308158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 0x7ff308158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 -- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 msgr2=0x7ff308159820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff308159820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30d093640 1 -- 172.21.15.81:0/304910879 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30815ce90 con 0x7ff3080d2950 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.248+0000 7ff30e095640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 0x7ff308158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff30d093640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8034040 con 0x7ff3080d2950 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f8030410 con 0x7ff3080d2950 2024-03-18T07:15:08.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30815d170 con 0x7ff3080d2950 2024-03-18T07:15:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8006e10 con 0x7ff3080d2950 2024-03-18T07:15:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.249+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30815d730 con 0x7ff3080d2950 2024-03-18T07:15:08.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.251+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff2f8037070 con 0x7ff3080d2950 2024-03-18T07:15:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.252+0000 7ff2fe7fc640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 0x7ff2ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.252+0000 7ff30d894640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 0x7ff2ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.252+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30804f5b0 con 0x7ff3080d2950 2024-03-18T07:15:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.252+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff2f80ac4e0 con 0x7ff3080d2950 2024-03-18T07:15:08.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.253+0000 7ff30d894640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 0x7ff2ec06e090 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff304000f60 tx=0x7ff304007d70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:08.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.257+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff2f807ac70 con 0x7ff3080d2950 2024-03-18T07:15:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.780+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff3081591d0 con 0x7ff2ec06bbd0 2024-03-18T07:15:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.782+0000 7ff2fe7fc640 1 -- 172.21.15.81:0/304910879 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13459 (secure 0 0 0) 0x7ff3081591d0 con 0x7ff2ec06bbd0 2024-03-18T07:15:08.788 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:15:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.785+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 msgr2=0x7ff2ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.785+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 0x7ff2ec06e090 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7ff304000f60 tx=0x7ff304007d70 comp rx=0 tx=0).stop 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 msgr2=0x7ff308158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8000c00 tx=0x7ff2f80046c0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 shutdown_connections 2024-03-18T07:15:08.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff30815c470 0x7ff308158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff3080d2950 0x7ff308158750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff2ec06bbd0 0x7ff2ec06e090 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 --2- 172.21.15.81:0/304910879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3080d0b20 0x7ff308159820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 >> 172.21.15.81:0/304910879 conn(0x7ff3080d1e30 msgr2=0x7ff3080708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 shutdown_connections 2024-03-18T07:15:08.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:08.786+0000 7ff30faf8640 1 -- 172.21.15.81:0/304910879 wait complete. 2024-03-18T07:15:08.816 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":12324,"stamp":"2024-03-18T07:15:07.697101+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12488636,"kb_used_data":4328,"kb_used_omap":35044,"kb_used_meta":12449179,"kb_avail":742486084,"statfs":{"total":773094113280,"available":760305750016,"internally_reserved":0,"allocated":4431872,"data_stored":2446592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35885454,"internal_metadata":12747959922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002163"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":401,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T07:14:52.850454+0000","last_change":"2024-03-18T00:25:12.736298+0000","last_active":"2024-03-18T07:14:52.850454+0000","last_peered":"2024-03-18T07:14:52.850454+0000","last_clean":"2024-03-18T07:14:52.850454+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T07:14:52.850454+0000","last_undegraded":"2024-03-18T07:14:52.850454+0000","last_fullsized":"2024-03-18T07:14:52.850454+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T00:25:11.465657+0000","last_clean_scrub_stamp":"2024-03-18T00:25:11.465657+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T00:25:31.157142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579756,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1730460,"kb_used_data":976,"kb_used_omap":2540,"kb_used_meta":1726931,"kb_avail":92641380,"statfs":{"total":96636764160,"available":94864773120,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2601338,"internal_metadata":1768377990},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834579768,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670748,"kb_used_data":396,"kb_used_omap":4049,"kb_used_meta":1666286,"kb_avail":92701092,"statfs":{"total":96636764160,"available":94925918208,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4146349,"internal_metadata":1706277715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834579751,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1229336,"kb_used_data":396,"kb_used_omap":4155,"kb_used_meta":1224772,"kb_avail":93142504,"statfs":{"total":96636764160,"available":95377924096,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4255044,"internal_metadata":1254167228},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834579749,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883608,"kb_used_data":396,"kb_used_omap":7579,"kb_used_meta":1875620,"kb_avail":92488232,"statfs":{"total":96636764160,"available":94707949568,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7761481,"internal_metadata":1920635319},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834579734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1485012,"kb_used_data":396,"kb_used_omap":7694,"kb_used_meta":1476913,"kb_avail":92886828,"statfs":{"total":96636764160,"available":95116111872,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7878685,"internal_metadata":1512359907},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834579750,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1238228,"kb_used_data":396,"kb_used_omap":1523,"kb_used_meta":1236300,"kb_avail":93133612,"statfs":{"total":96636764160,"available":95368818688,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560274,"internal_metadata":1265971502},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834579744,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742420,"kb_used_data":396,"kb_used_omap":5638,"kb_used_meta":1736377,"kb_avail":92629420,"statfs":{"total":96636764160,"available":94852526080,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5774261,"internal_metadata":1778050123},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579761,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1508824,"kb_used_data":976,"kb_used_omap":1863,"kb_used_meta":1505976,"kb_avail":92863016,"statfs":{"total":96636764160,"available":95091728384,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1908022,"internal_metadata":1542120138},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T07:15:08.819 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T00:25:11.465657+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=0, tm_min=25, tm_sec=11, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=7, tm_min=14, tm_sec=59, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T07:15:08.819 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T07:15:28.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T07:15:29.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.090+0000 7f8a4bc97640 1 Processor -- start 2024-03-18T07:15:29.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.090+0000 7f8a4bc97640 1 -- start start 2024-03-18T07:15:29.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.094+0000 7f8a4bc97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a440b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.094+0000 7f8a4bc97640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a440b44c0 0x7f8a440b4950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.094+0000 7f8a4bc97640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4406ef10 con 0x7f8a440b3ba0 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.094+0000 7f8a4bc97640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4406f1c0 con 0x7f8a440b44c0 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.094+0000 7f8a4bc97640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4406f4a0 con 0x7f8a440cf3f0 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49232640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a440b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a4a234640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7f8a440b44c0 0x7f8a440b4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49a33640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7f8a440b3ba0 0x7f8a4406e800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48830/0 (socket says 172.21.15.81:48830) 2024-03-18T07:15:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49a33640 1 -- 172.21.15.81:0/3142923330 learned_addr learned my addr 172.21.15.81:0/3142923330 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:29.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49232640 1 -- 172.21.15.81:0/3142923330 >> v2:172.21.15.136:3300/0 conn(0x7f8a440b44c0 msgr2=0x7f8a440b4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49232640 1 --2- 172.21.15.81:0/3142923330 >> v2:172.21.15.136:3300/0 conn(0x7f8a440b44c0 0x7f8a440b4950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49232640 1 -- 172.21.15.81:0/3142923330 >> v1:172.21.15.136:6789/0 conn(0x7f8a440b3ba0 legacy=0x7f8a4406e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.095+0000 7f8a49232640 1 -- 172.21.15.81:0/3142923330 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4406f780 con 0x7f8a440cf3f0 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.096+0000 7f8a49232640 1 --2- 172.21.15.81:0/3142923330 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a440b3f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a340097a0 tx=0x7f8a3402dac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2f84379c64db409 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.096+0000 7f8a48a31640 1 -- 172.21.15.81:0/3142923330 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3402f880 con 0x7f8a440cf3f0 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.097+0000 7f8a48a31640 1 -- 172.21.15.81:0/3142923330 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3402fa20 con 0x7f8a440cf3f0 2024-03-18T07:15:29.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.097+0000 7f8a48a31640 1 -- 172.21.15.81:0/3142923330 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3402fdf0 con 0x7f8a440cf3f0 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 -- 172.21.15.81:0/3142923330 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 msgr2=0x7f8a440b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/3142923330 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a440b3f80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8a340097a0 tx=0x7f8a3402dac0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 -- 172.21.15.81:0/3142923330 shutdown_connections 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/3142923330 >> v2:172.21.15.136:3300/0 conn(0x7f8a440b44c0 0x7f8a440b4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/3142923330 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a440b3f80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 -- 172.21.15.81:0/3142923330 >> 172.21.15.81:0/3142923330 conn(0x7f8a440d0d30 msgr2=0x7f8a440d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 -- 172.21.15.81:0/3142923330 shutdown_connections 2024-03-18T07:15:29.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.099+0000 7f8a4bc97640 1 -- 172.21.15.81:0/3142923330 wait complete. 2024-03-18T07:15:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.104+0000 7f8a4bc97640 1 Processor -- start 2024-03-18T07:15:29.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.104+0000 7f8a4bc97640 1 -- start start 2024-03-18T07:15:29.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 0x7f8a441e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a440b44c0 0x7f8a4415d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a44152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44144b00 con 0x7f8a440b44c0 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4406fd40 con 0x7f8a440b3ba0 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4bc97640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7f8a44144c80 con 0x7f8a440cf3f0 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a49a33640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 0x7f8a441e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a49a33640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 0x7f8a441e4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:35198/0 (socket says 172.21.15.81:35198) 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a49a33640 1 -- 172.21.15.81:0/1906377287 learned_addr learned my addr 172.21.15.81:0/1906377287 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a49232640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a440b44c0 0x7f8a4415d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.108+0000 7f8a4a234640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a44152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 -- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 msgr2=0x7f8a441e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 0x7f8a441e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 -- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a440b44c0 msgr2=0x7f8a4415d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a440b44c0 0x7f8a4415d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 -- 172.21.15.81:0/1906377287 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a44155740 con 0x7f8a440cf3f0 2024-03-18T07:15:29.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4a234640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a44152190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00efc0 tx=0x7f8a3c00c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c018020 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a3c014480 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3c014870 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a441e5030 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.109+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441e55f0 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.111+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8a3c005d10 con 0x7f8a440cf3f0 2024-03-18T07:15:29.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.111+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4404f5b0 con 0x7f8a440cf3f0 2024-03-18T07:15:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.112+0000 7f8a3a7fc640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 0x7f8a2806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.113+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7f8a3c08b530 con 0x7f8a440cf3f0 2024-03-18T07:15:29.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.113+0000 7f8a49a33640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 0x7f8a2806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.113+0000 7f8a49a33640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 0x7f8a2806e090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8a4415aad0 tx=0x7f8a40007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.116+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8a3c022030 con 0x7f8a440cf3f0 2024-03-18T07:15:29.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.643+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 --> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a44073070 con 0x7f8a2806bbd0 2024-03-18T07:15:29.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.645+0000 7f8a3a7fc640 1 -- 172.21.15.81:0/1906377287 <== mgr.4104 v2:172.21.15.81:6832/3852051639 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13467 (secure 0 0 0) 0x7f8a44073070 con 0x7f8a2806bbd0 2024-03-18T07:15:29.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:15:29.651 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 msgr2=0x7f8a2806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 0x7f8a2806e090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8a4415aad0 tx=0x7f8a40007f10 comp rx=0 tx=0).stop 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 msgr2=0x7f8a44152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a44152190 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c00efc0 tx=0x7f8a3c00c490 comp rx=0 tx=0).stop 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 shutdown_connections 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7f8a440cf3f0 0x7f8a44152190 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.648+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7f8a2806bbd0 0x7f8a2806e090 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.649+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a440b44c0 0x7f8a4415d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.649+0000 7f8a4bc97640 1 --2- 172.21.15.81:0/1906377287 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7f8a440b3ba0 0x7f8a441e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.649+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 >> 172.21.15.81:0/1906377287 conn(0x7f8a440d0d30 msgr2=0x7f8a440cf8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.649+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 shutdown_connections 2024-03-18T07:15:29.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.649+0000 7f8a4bc97640 1 -- 172.21.15.81:0/1906377287 wait complete. 2024-03-18T07:15:29.679 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":12334,"stamp":"2024-03-18T07:15:27.701805+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12488632,"kb_used_data":4328,"kb_used_omap":35044,"kb_used_meta":12449179,"kb_avail":742486088,"statfs":{"total":773094113280,"available":760305754112,"internally_reserved":0,"allocated":4431872,"data_stored":2446592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":35885454,"internal_metadata":12747959922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002836"},"pg_stats":[{"pgid":"1.0","version":"35'119","reported_seq":412,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T07:15:08.568101+0000","last_change":"2024-03-18T07:15:08.568127+0000","last_active":"2024-03-18T07:15:08.568101+0000","last_peered":"2024-03-18T07:15:08.568101+0000","last_clean":"2024-03-18T07:15:08.568101+0000","last_became_active":"2024-03-18T00:25:12.735903+0000","last_became_peered":"2024-03-18T00:25:12.735903+0000","last_unstale":"2024-03-18T07:15:08.568101+0000","last_undegraded":"2024-03-18T07:15:08.568101+0000","last_fullsized":"2024-03-18T07:15:08.568101+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'119","last_scrub_stamp":"2024-03-18T07:15:08.568036+0000","last_deep_scrub":"35'119","last_deep_scrub_stamp":"2024-03-18T07:15:08.568036+0000","last_clean_scrub_stamp":"2024-03-18T07:15:08.568036+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:40:09.679822+0000","scrub_duration":127,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834579760,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1730456,"kb_used_data":976,"kb_used_omap":2540,"kb_used_meta":1726931,"kb_avail":92641384,"statfs":{"total":96636764160,"available":94864777216,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2601338,"internal_metadata":1768377990},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834579772,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670748,"kb_used_data":396,"kb_used_omap":4049,"kb_used_meta":1666286,"kb_avail":92701092,"statfs":{"total":96636764160,"available":94925918208,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4146349,"internal_metadata":1706277715},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834579755,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1229336,"kb_used_data":396,"kb_used_omap":4155,"kb_used_meta":1224772,"kb_avail":93142504,"statfs":{"total":96636764160,"available":95377924096,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4255044,"internal_metadata":1254167228},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834579753,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1883608,"kb_used_data":396,"kb_used_omap":7579,"kb_used_meta":1875620,"kb_avail":92488232,"statfs":{"total":96636764160,"available":94707949568,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7761481,"internal_metadata":1920635319},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834579738,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1485012,"kb_used_data":396,"kb_used_omap":7694,"kb_used_meta":1476913,"kb_avail":92886828,"statfs":{"total":96636764160,"available":95116111872,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7878685,"internal_metadata":1512359907},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834579754,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1238228,"kb_used_data":396,"kb_used_omap":1523,"kb_used_meta":1236300,"kb_avail":93133612,"statfs":{"total":96636764160,"available":95368818688,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1560274,"internal_metadata":1265971502},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834579748,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1742420,"kb_used_data":396,"kb_used_omap":5638,"kb_used_meta":1736377,"kb_avail":92629420,"statfs":{"total":96636764160,"available":94852526080,"internally_reserved":0,"allocated":405504,"data_stored":158232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5774261,"internal_metadata":1778050123},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834579765,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1508824,"kb_used_data":976,"kb_used_omap":1863,"kb_used_meta":1505976,"kb_avail":92863016,"statfs":{"total":96636764160,"available":95091728384,"internally_reserved":0,"allocated":999424,"data_stored":748600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1908022,"internal_metadata":1542120138},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T07:15:29.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-18T07:15:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.950+0000 7ff9a4774640 1 Processor -- start 2024-03-18T07:15:29.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.950+0000 7ff9a4774640 1 -- start start 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a4774640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff99c15c140 0x7ff99c0d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a4774640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff99c0ce840 0x7ff99c0ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a4774640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99c0cce20 con 0x7ff99c0b7110 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a4774640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7ff99c0cf1e0 con 0x7ff99c0ce840 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a4774640 1 -- --> v2:172.21.15.136:3300/0 -- mon_getmap magic: 0 -- 0x7ff99c0cd100 con 0x7ff99c15c140 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a2510640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff99c15c140 0x7ff99c0d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a1d0f640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7ff99c0ce840 0x7ff99c0ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a2510640 1 --2- >> v2:172.21.15.136:3300/0 conn(0x7ff99c15c140 0x7ff99c0d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:35210/0 (socket says 172.21.15.81:35210) 2024-03-18T07:15:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.953+0000 7ff9a2510640 1 -- 172.21.15.81:0/3981961844 learned_addr learned my addr 172.21.15.81:0/3981961844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.954+0000 7ff9a2510640 1 -- 172.21.15.81:0/3981961844 >> v2:172.21.15.81:3300/0 conn(0x7ff99c0ce840 msgr2=0x7ff99c0ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.954+0000 7ff9a2510640 1 --2- 172.21.15.81:0/3981961844 >> v2:172.21.15.81:3300/0 conn(0x7ff99c0ce840 0x7ff99c0ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.954+0000 7ff9a2510640 1 -- 172.21.15.81:0/3981961844 >> v1:172.21.15.81:6789/0 conn(0x7ff99c0b7110 legacy=0x7ff99c0b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.954+0000 7ff9a2510640 1 -- 172.21.15.81:0/3981961844 --> v2:172.21.15.136:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c0cd3e0 con 0x7ff99c15c140 2024-03-18T07:15:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.956+0000 7ff9a2510640 1 --2- 172.21.15.81:0/3981961844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c15c140 0x7ff99c0d08c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06bbc0 tx=0x7ff99802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c432ae0aa5bf718 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.956+0000 7ff9a150e640 1 -- 172.21.15.81:0/3981961844 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99802cb20 con 0x7ff99c15c140 2024-03-18T07:15:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.956+0000 7ff9a150e640 1 -- 172.21.15.81:0/3981961844 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff99802ccc0 con 0x7ff99c15c140 2024-03-18T07:15:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.956+0000 7ff9a150e640 1 -- 172.21.15.81:0/3981961844 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff998034610 con 0x7ff99c15c140 2024-03-18T07:15:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 -- 172.21.15.81:0/3981961844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c15c140 msgr2=0x7ff99c0d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3981961844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c15c140 0x7ff99c0d08c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff99c06bbc0 tx=0x7ff99802bf80 comp rx=0 tx=0).stop 2024-03-18T07:15:29.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 -- 172.21.15.81:0/3981961844 shutdown_connections 2024-03-18T07:15:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3981961844 >> v2:172.21.15.81:3300/0 conn(0x7ff99c0ce840 0x7ff99c0ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3981961844 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c15c140 0x7ff99c0d08c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 -- 172.21.15.81:0/3981961844 >> 172.21.15.81:0/3981961844 conn(0x7ff99c09b160 msgr2=0x7ff99c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 -- 172.21.15.81:0/3981961844 shutdown_connections 2024-03-18T07:15:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.958+0000 7ff9a4774640 1 -- 172.21.15.81:0/3981961844 wait complete. 2024-03-18T07:15:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.961+0000 7ff9a4774640 1 Processor -- start 2024-03-18T07:15:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.961+0000 7ff9a4774640 1 -- start start 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.963+0000 7ff9a4774640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 0x7ff99c1f4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.963+0000 7ff9a4774640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.963+0000 7ff9a4774640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 0x7ff99c0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.963+0000 7ff9a4774640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c0b7cb0 con 0x7ff99c0b7110 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a1d0f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a4774640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7ff99c0cd9a0 con 0x7ff99c0ce840 2024-03-18T07:15:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 0x7ff99c0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 0x7ff99c1f4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a4774640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7ff99c0d0e00 con 0x7ff99c15c140 2024-03-18T07:15:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a1d0f640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3300/0 says I am v2:172.21.15.81:35218/0 (socket says 172.21.15.81:35218) 2024-03-18T07:15:29.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a1d0f640 1 -- 172.21.15.81:0/3945212382 learned_addr learned my addr 172.21.15.81:0/3945212382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 -- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 msgr2=0x7ff99c1f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 -- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 msgr2=0x7ff99c1f4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:29.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 0x7ff99c1f4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2d11640 1 -- 172.21.15.81:0/3945212382 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99c15cf20 con 0x7ff99c15c140 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a2510640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 0x7ff99c1f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.964+0000 7ff9a1d0f640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff9a2d11640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 0x7ff99c0c8f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c340 tx=0x7ff99400c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994017070 con 0x7ff99c15c140 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9940052d0 con 0x7ff99c15c140 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff99c15d1c0 con 0x7ff99c15c140 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994003830 con 0x7ff99c15c140 2024-03-18T07:15:29.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.965+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff99c15d780 con 0x7ff99c15c140 2024-03-18T07:15:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.968+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99c04f540 con 0x7ff99c15c140 2024-03-18T07:15:29.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.969+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff99401a070 con 0x7ff99c15c140 2024-03-18T07:15:29.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.970+0000 7ff992ffd640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 0x7ff98006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.970+0000 7ff9a2510640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 0x7ff98006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.970+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7ff994089990 con 0x7ff99c15c140 2024-03-18T07:15:29.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.971+0000 7ff9a2510640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 0x7ff98006e090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff998035000 tx=0x7ff998030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:29.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:29.974+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff9940581f0 con 0x7ff99c15c140 2024-03-18T07:15:30.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.505+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff99c0ce620 con 0x7ff99c15c140 2024-03-18T07:15:30.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.511+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff994005480 con 0x7ff99c15c140 2024-03-18T07:15:30.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.512+0000 7ff992ffd640 1 -- 172.21.15.81:0/3945212382 <== mon.2 v2:172.21.15.136:3301/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7ff99405e030 con 0x7ff99c15c140 2024-03-18T07:15:30.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 msgr2=0x7ff98006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 0x7ff98006e090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7ff998035000 tx=0x7ff998030000 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 msgr2=0x7ff99c0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 0x7ff99c0c8f00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c340 tx=0x7ff99400c800 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 shutdown_connections 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7ff99c15c140 0x7ff99c0c8f00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7ff99c0ce840 0x7ff99c1f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7ff98006bbd0 0x7ff98006e090 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 --2- 172.21.15.81:0/3945212382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff99c0b7110 0x7ff99c1f4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.518+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 >> 172.21.15.81:0/3945212382 conn(0x7ff99c09b160 msgr2=0x7ff99c0b5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.519+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 shutdown_connections 2024-03-18T07:15:30.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.519+0000 7ff9a4774640 1 -- 172.21.15.81:0/3945212382 wait complete. 2024-03-18T07:15:30.550 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T07:15:30.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T07:15:30.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.817+0000 7fd63054c640 1 Processor -- start 2024-03-18T07:15:30.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.817+0000 7fd63054c640 1 -- start start 2024-03-18T07:15:30.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd63054c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd6280d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd63054c640 1 --2- >> v2:172.21.15.81:3300/0 conn(0x7fd6280cef80 0x7fd6280af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd63054c640 1 -- --> v1:172.21.15.136:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6280cd510 con 0x7fd62815c780 2024-03-18T07:15:30.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd63054c640 1 -- --> v2:172.21.15.81:3300/0 -- mon_getmap magic: 0 -- 0x7fd6280cd7f0 con 0x7fd6280cef80 2024-03-18T07:15:30.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd63054c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd6280cdad0 con 0x7fd62815c3a0 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd62dae7640 1 --1- >> v1:172.21.15.136:6789/0 conn(0x7fd62815c780 0x7fd6280ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.136:6789/0 says I am v1:172.21.15.81:48838/0 (socket says 172.21.15.81:48838) 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.819+0000 7fd62dae7640 1 -- 172.21.15.81:0/1544602216 learned_addr learned my addr 172.21.15.81:0/1544602216 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62e2e8640 1 --2- 172.21.15.81:0/1544602216 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd6280d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62eae9640 1 --2- 172.21.15.81:0/1544602216 >> v2:172.21.15.81:3300/0 conn(0x7fd6280cef80 0x7fd6280af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62d2e6640 1 -- 172.21.15.81:0/1544602216 <== mon.1 v1:172.21.15.136:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618038739 0 0) 0x7fd6280cd510 con 0x7fd62815c780 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62d2e6640 1 -- 172.21.15.81:0/1544602216 --> v1:172.21.15.136:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd614003520 con 0x7fd62815c780 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62e2e8640 1 -- 172.21.15.81:0/1544602216 >> v2:172.21.15.81:3300/0 conn(0x7fd6280cef80 msgr2=0x7fd6280af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62e2e8640 1 --2- 172.21.15.81:0/1544602216 >> v2:172.21.15.81:3300/0 conn(0x7fd6280cef80 0x7fd6280af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62e2e8640 1 -- 172.21.15.81:0/1544602216 >> v1:172.21.15.136:6789/0 conn(0x7fd62815c780 legacy=0x7fd6280ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.820+0000 7fd62e2e8640 1 -- 172.21.15.81:0/1544602216 --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6280cddb0 con 0x7fd62815c3a0 2024-03-18T07:15:30.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.823+0000 7fd62e2e8640 1 --2- 172.21.15.81:0/1544602216 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd6280d2980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79cb6dcdcdffecb9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:30.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.823+0000 7fd62d2e6640 1 -- 172.21.15.81:0/1544602216 <== mon.2 v2:172.21.15.136:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624039070 con 0x7fd62815c3a0 2024-03-18T07:15:30.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.823+0000 7fd62d2e6640 1 -- 172.21.15.81:0/1544602216 <== mon.2 v2:172.21.15.136:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd62402cc50 con 0x7fd62815c3a0 2024-03-18T07:15:30.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.824+0000 7fd62d2e6640 1 -- 172.21.15.81:0/1544602216 <== mon.2 v2:172.21.15.136:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd624034440 con 0x7fd62815c3a0 2024-03-18T07:15:30.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 -- 172.21.15.81:0/1544602216 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 msgr2=0x7fd6280d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 --2- 172.21.15.81:0/1544602216 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd6280d2980 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd624009d90 tx=0x7fd62402bea0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 -- 172.21.15.81:0/1544602216 shutdown_connections 2024-03-18T07:15:30.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 --2- 172.21.15.81:0/1544602216 >> v2:172.21.15.81:3300/0 conn(0x7fd6280cef80 0x7fd6280af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 --2- 172.21.15.81:0/1544602216 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd6280d2980 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 -- 172.21.15.81:0/1544602216 >> 172.21.15.81:0/1544602216 conn(0x7fd6280d1e60 msgr2=0x7fd6280d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:30.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 -- 172.21.15.81:0/1544602216 shutdown_connections 2024-03-18T07:15:30.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.825+0000 7fd63054c640 1 -- 172.21.15.81:0/1544602216 wait complete. 2024-03-18T07:15:30.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.828+0000 7fd63054c640 1 Processor -- start 2024-03-18T07:15:30.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.828+0000 7fd63054c640 1 -- start start 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 0x7fd6280cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd628158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 0x7fd6281592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6280cf590 con 0x7fd6280cef80 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 -- --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_getmap magic: 0 -- 0x7fd6280cf410 con 0x7fd62815c780 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.830+0000 7fd63054c640 1 -- --> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] -- mon_getmap magic: 0 -- 0x7fd6280af540 con 0x7fd62815c3a0 2024-03-18T07:15:30.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62e2e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 0x7fd6280cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62dae7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd628158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 --2- >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 0x7fd6281592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62e2e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 0x7fd6280cb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35188/0 (socket says 172.21.15.81:35188) 2024-03-18T07:15:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62dae7640 1 --2- >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd628158d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.136:3301/0 says I am v2:172.21.15.81:56332/0 (socket says 172.21.15.81:56332) 2024-03-18T07:15:30.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62e2e8640 1 -- 172.21.15.81:0/3329051435 learned_addr learned my addr 172.21.15.81:0/3329051435 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-03-18T07:15:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 -- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 msgr2=0x7fd628158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd628158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 -- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 msgr2=0x7fd6280cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 0x7fd6280cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.831+0000 7fd62eae9640 1 -- 172.21.15.81:0/3329051435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6280c99e0 con 0x7fd62815c780 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd62eae9640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 0x7fd6281592b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd62000e850 tx=0x7fd62000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd620017070 con 0x7fd62815c780 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd62000c940 con 0x7fd62815c780 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6280c9cc0 con 0x7fd62815c780 2024-03-18T07:15:30.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd62000cd50 con 0x7fd62815c780 2024-03-18T07:15:30.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.832+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd628158520 con 0x7fd62815c780 2024-03-18T07:15:30.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.834+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd62804f5b0 con 0x7fd62815c780 2024-03-18T07:15:30.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.836+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd62001a070 con 0x7fd62815c780 2024-03-18T07:15:30.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.837+0000 7fd61effd640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 0x7fd60c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T07:15:30.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.837+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4943+0+0 (secure 0 0 0) 0x7fd62008aaa0 con 0x7fd62815c780 2024-03-18T07:15:30.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.837+0000 7fd62e2e8640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 0x7fd60c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T07:15:30.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.839+0000 7fd62e2e8640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 0x7fd60c06e090 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd624000f80 tx=0x7fd624030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T07:15:30.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:30.842+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd620059110 con 0x7fd62815c780 2024-03-18T07:15:31.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.483+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 --> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6280ce370 con 0x7fd62815c780 2024-03-18T07:15:31.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.484+0000 7fd61effd640 1 -- 172.21.15.81:0/3329051435 <== mon.1 v2:172.21.15.136:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+3872 (secure 0 0 0) 0x7fd62005d1b0 con 0x7fd62815c780 2024-03-18T07:15:31.491 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-03-18T07:15:31.491 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":16,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5064,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6836/844399882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6835","nonce":844399882},{"type":"v1","addr":"172.21.15.81:6836","nonce":844399882}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5067,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6837/3137419583","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3137419583},{"type":"v1","addr":"172.21.15.81:6837","nonce":3137419583}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5068,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6835/2492309486","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6833","nonce":2492309486},{"type":"v1","addr":"172.21.15.136:6835","nonce":2492309486}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5311,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.136:6834/1413363812","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6832","nonce":1413363812},{"type":"v1","addr":"172.21.15.136:6834","nonce":1413363812}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[]} 2024-03-18T07:15:31.491 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 16 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 msgr2=0x7fd60c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 0x7fd60c06e090 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd624000f80 tx=0x7fd624030000 comp rx=0 tx=0).stop 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 msgr2=0x7fd6281592b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 0x7fd6281592b0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd62000e850 tx=0x7fd62000ed10 comp rx=0 tx=0).stop 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 shutdown_connections 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] conn(0x7fd62815c780 0x7fd6281592b0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.136:3301/0,v1:172.21.15.136:6790/0] conn(0x7fd62815c3a0 0x7fd628158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:31.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:6832/3852051639,v1:172.21.15.81:6833/3852051639] conn(0x7fd60c06bbd0 0x7fd60c06e090 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 --2- 172.21.15.81:0/3329051435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6280cef80 0x7fd6280cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T07:15:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 >> 172.21.15.81:0/3329051435 conn(0x7fd6280d1e60 msgr2=0x7fd628070940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T07:15:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.488+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 shutdown_connections 2024-03-18T07:15:31.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-03-18T07:15:31.489+0000 7fd63054c640 1 -- 172.21.15.81:0/3329051435 wait complete. 2024-03-18T07:15:31.519 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-18T07:15:31.519 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-18T07:15:31.519 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T07:15:31.520 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:31.548 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T07:15:31.548 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T07:15:31.548 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:31.608 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T07:15:31.608 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T07:15:31.609 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:31.618 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T07:15:31.618 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-18T07:15:31.618 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:31.668 INFO:tasks.ceph.mds.d:Stopped 2024-03-18T07:15:31.669 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-18T07:15:31.669 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T07:15:31.669 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:37.177 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-18T07:15:37.771 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T07:15:37.772 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T07:15:37.772 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:43.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-18T07:15:43.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-18T07:15:43.873 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T07:15:43.874 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T07:15:43.874 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:49.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-18T07:15:49.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-18T07:15:49.976 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T07:15:49.976 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T07:15:49.976 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:15:55.202 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-18T07:15:55.203 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-18T07:15:56.078 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T07:15:56.079 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-18T07:15:56.079 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:01.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-18T07:16:01.010 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-18T07:16:02.181 INFO:tasks.ceph.osd.4:Stopped 2024-03-18T07:16:02.182 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-18T07:16:02.182 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:02.284 INFO:tasks.ceph.osd.5:Stopped 2024-03-18T07:16:02.284 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-18T07:16:02.284 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:06.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-18T07:16:06.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-18T07:16:08.386 INFO:tasks.ceph.osd.6:Stopped 2024-03-18T07:16:08.387 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-18T07:16:08.387 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:12.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-18T07:16:12.121 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-18T07:16:14.489 INFO:tasks.ceph.osd.7:Stopped 2024-03-18T07:16:14.490 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-18T07:16:14.490 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T07:16:14.490 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:17.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-03-18T07:16:17.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-18T07:16:20.592 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T07:16:20.593 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T07:16:20.593 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:20.619 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T07:16:20.620 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-18T07:16:20.620 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T07:16:20.620 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:20.676 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T07:16:20.676 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T07:16:20.676 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:20.694 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T07:16:20.695 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T07:16:20.695 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T07:16:20.753 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T07:16:20.753 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-18T07:16:20.754 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'mons down, quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-18T07:16:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:16:20.912 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-18T07:16:21.459 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:16:21.459 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-18T07:16:21.640 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:16:21.640 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-18T07:16:21.792 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:16:21.792 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-18T07:16:22.049 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T07:16:22.049 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-18T07:16:22.526 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-03-18T07:16:22.980 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T07:16:22.981 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-18T07:16:23.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T07:16:23.129 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-18T07:16:23.257 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T07:16:23.257 DEBUG:teuthology.orchestra.run.smithi136:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-18T07:16:23.412 INFO:tasks.ceph:Archiving mon data... 2024-03-18T07:16:23.414 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/data/mon.a.tgz 2024-03-18T07:16:23.414 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-03-18T07:16:23.448 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.WN2c3YSQPb 2024-03-18T07:16:23.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.WN2c3YSQPb 2024-03-18T07:16:23.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.WN2c3YSQPb 2024-03-18T07:16:24.074 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.WN2c3YSQPb is 581KB 2024-03-18T07:16:24.164 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.WN2c3YSQPb 2024-03-18T07:16:24.195 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/data/mon.b.tgz 2024-03-18T07:16:24.196 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-03-18T07:16:24.222 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.6z90pmUj4J 2024-03-18T07:16:24.223 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.6z90pmUj4J 2024-03-18T07:16:24.405 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.6z90pmUj4J 2024-03-18T07:16:24.501 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.6z90pmUj4J is 585KB 2024-03-18T07:16:24.598 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.6z90pmUj4J 2024-03-18T07:16:24.620 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/data/mon.c.tgz 2024-03-18T07:16:24.620 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-03-18T07:16:24.675 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.3C10SSV7yE 2024-03-18T07:16:24.675 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.3C10SSV7yE 2024-03-18T07:16:24.826 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.3C10SSV7yE 2024-03-18T07:16:24.910 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.3C10SSV7yE is 585KB 2024-03-18T07:16:25.008 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.3C10SSV7yE 2024-03-18T07:16:25.024 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-18T07:16:25.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T07:16:25.027 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T07:16:25.189 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T07:16:25.238 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T07:16:25.238 INFO:tasks.ceph:Archiving crash dumps... 2024-03-18T07:16:25.240 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi081/crash 2024-03-18T07:16:25.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T07:16:25.305 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi136/crash 2024-03-18T07:16:25.306 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T07:16:25.334 INFO:tasks.ceph:Shutting down logrotate 2024-03-18T07:19:08.426 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T07:19:08.505 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T07:19:08.628 INFO:tasks.ceph:Compressing logs... 2024-03-18T07:19:08.629 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T07:19:08.632 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T07:19:08.680 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-18T07:19:08.680 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37487.log 2024-03-18T07:19:08.681 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37287.log 2024-03-18T07:19:08.682 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.admin.37487.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-18T07:19:08.682 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2024-03-18T07:19:08.682 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-18T07:19:08.686 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37447.log 2024-03-18T07:19:08.686 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-18T07:19:08.686 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37527.log 2024-03-18T07:19:08.686 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43644.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37527.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.3.43644.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43644.log.gz 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37407.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-18T07:19:08.687 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43246.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.1.43246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37247.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43246.log.gz 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37327.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-18T07:19:08.688 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/ceph-client.admin.37327.log: /var/log/ceph/ceph-mon.c.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-18T07:19:08.690 INFO:teuthology.orchestra.run.smithi136.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-03-18T07:19:08.690 INFO:teuthology.orchestra.run.smithi136.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2024-03-18T07:19:08.691 INFO:teuthology.orchestra.run.smithi136.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.37447.log.gz 2024-03-18T07:19:08.691 INFO:teuthology.orchestra.run.smithi136.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.37487.log.gz 2024-03-18T07:19:08.693 INFO:teuthology.orchestra.run.smithi136.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37527.log.gz 2024-03-18T07:19:08.738 INFO:teuthology.orchestra.run.smithi136.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37287.log.gz 2024-03-18T07:19:08.740 INFO:teuthology.orchestra.run.smithi136.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37327.log.gz 2024-03-18T07:19:08.741 INFO:teuthology.orchestra.run.smithi136.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37247.log.gz 2024-03-18T07:19:08.741 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246313.log 2024-03-18T07:19:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.743131.log 2024-03-18T07:19:08.742 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748497.log 2024-03-18T07:19:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147623.log 2024-03-18T07:19:08.743 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259713.log 2024-03-18T07:19:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346559.log 2024-03-18T07:19:08.744 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593147.log 2024-03-18T07:19:08.745 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343393.log 2024-03-18T07:19:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721131.log 2024-03-18T07:19:08.746 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-03-18T07:19:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770361.log 2024-03-18T07:19:08.747 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889045.log 2024-03-18T07:19:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280279.log 2024-03-18T07:19:08.748 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597166.log 2024-03-18T07:19:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248725.log 2024-03-18T07:19:08.749 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129082.log 2024-03-18T07:19:08.750 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409306.log 2024-03-18T07:19:08.750 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627787.log 2024-03-18T07:19:08.751 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616805.log 2024-03-18T07:19:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890034.log 2024-03-18T07:19:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246313.log: /var/log/ceph/ceph-client.admin.743131.log: /var/log/ceph/ceph-client.admin.748497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246313.log.gz 2024-03-18T07:19:08.752 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598062.log 2024-03-18T07:19:08.753 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764770.log 2024-03-18T07:19:08.753 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308773.log 2024-03-18T07:19:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768934.log 2024-03-18T07:19:08.754 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340293.log 2024-03-18T07:19:08.755 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752795.log 2024-03-18T07:19:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596153.log 2024-03-18T07:19:08.756 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595065.log 2024-03-18T07:19:08.757 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207997.log 2024-03-18T07:19:08.758 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46873.log 2024-03-18T07:19:08.758 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750879.log 2024-03-18T07:19:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589812.log 2024-03-18T07:19:08.759 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718404.log 2024-03-18T07:19:08.760 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638271.log 2024-03-18T07:19:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167537.log 2024-03-18T07:19:08.761 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285615.log 2024-03-18T07:19:08.762 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745851.log 2024-03-18T07:19:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732411.log 2024-03-18T07:19:08.763 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407893.log 2024-03-18T07:19:08.764 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171387.log 2024-03-18T07:19:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313949.log 2024-03-18T07:19:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315216.log 2024-03-18T07:19:08.765 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239891.log 2024-03-18T07:19:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323381.log 2024-03-18T07:19:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615460.log 2024-03-18T07:19:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593147.log: /var/log/ceph/ceph-client.admin.147623.log: /var/log/ceph/ceph-client.admin.721131.log: 0.0%/var/log/ceph/ceph-client.admin.770361.log: -- replaced with /var/log/ceph/ceph-client.admin.147623.log.gz 2024-03-18T07:19:08.768 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721131.log.gz 2024-03-18T07:19:08.768 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.158490.log 2024-03-18T07:19:08.769 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.593147.log.gz 2024-03-18T07:19:08.769 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889045.log: /var/log/ceph/ceph-client.admin.597166.log: /var/log/ceph/ceph-client.admin.627787.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627787.log.gz -- replaced with /var/log/ceph/ceph-client.admin.597166.log.gz 2024-03-18T07:19:08.769 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44430.log: 0.0%/var/log/ceph/ceph-client.admin.248725.log: /var/log/ceph/ceph-client.admin.280279.log: /var/log/ceph/ceph-client.admin.616805.log: -- replaced with /var/log/ceph/ceph-client.admin.743131.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280279.log.gz 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616805.log.gz 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248725.log.gz 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.598062.log: -- replaced with /var/log/ceph/ceph-client.admin.770361.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615460.log.gz 2024-03-18T07:19:08.781 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598062.log.gz 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259713.log: 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222389.log 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.890034.log.gz 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.764770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241754.log 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198733.log 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579961.log 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195285.log 2024-03-18T07:19:08.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768934.log: /var/log/ceph/ceph-client.admin.407893.log: /var/log/ceph/ceph-client.admin.343393.log: /var/log/ceph/ceph-client.admin.346559.log: /var/log/ceph/ceph-client.admin.752795.log: 0.0%/var/log/ceph/ceph-client.admin.595065.log: /var/log/ceph/ceph-client.admin.596153.log: -- replaced with /var/log/ceph/ceph-client.admin.768934.log.gz 0.0% 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.752795.log.gz 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343393.log.gz 0.0% 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.595065.log.gz 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346559.log.gz 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596153.log.gzgzip 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.273361.log 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409306.log: /var/log/ceph/ceph-client.admin.750879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748497.log.gz 2024-03-18T07:19:08.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614425.log 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409306.log.gz 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750879.log.gz 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589812.log.gz/var/log/ceph/ceph-client.admin.638271.log: 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745851.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732411.log: /var/log/ceph/ceph-client.admin.129082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642283.log 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259713.log.gz 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638271.log.gz 2024-03-18T07:19:08.784 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.745851.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732411.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129082.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.614425.log: /var/log/ceph/ceph-client.admin.167537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614425.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233845.log 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.889045.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340293.log: /var/log/ceph/ceph-client.admin.642283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167537.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285615.log.gz 2024-03-18T07:19:08.785 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.642283.log.gz/var/log/ceph/ceph-client.admin.171387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340293.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308773.log: /var/log/ceph/ceph-client.admin.315216.log: /var/log/ceph/ceph-client.admin.239891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171387.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.207997.log: /var/log/ceph/ceph-client.admin.313949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308773.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315216.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239891.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.323381.log: /var/log/ceph/ceph-client.admin.46873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124862.log 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764770.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718404.log.gz 2024-03-18T07:19:08.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198733.log: /var/log/ceph/ceph-client.admin.241754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313949.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323381.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207997.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198733.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307126.log 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.124862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579961.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.241754.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124862.log.gz 2024-03-18T07:19:08.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158490.log: /var/log/ceph/ceph-client.admin.273361.log: /var/log/ceph/ceph-client.admin.222389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273361.log.gz/var/log/ceph/ceph-client.admin.233845.log: 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233845.log.gz 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158490.log.gz 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.195285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195285.log.gz 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222389.log.gz 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407893.log.gz 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875555.log 2024-03-18T07:19:08.788 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634958.log 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307126.log.gz 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311832.log 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279324.log 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875555.log.gz 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311832.log.gz 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.634958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589730.log 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634958.log.gz 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638783.log 2024-03-18T07:19:08.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279324.log.gz 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624616.log 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589730.log.gz 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631682.log 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242247.log 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638783.log.gz 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.631682.log: /var/log/ceph/ceph-client.admin.624616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631682.log.gz 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624616.log.gz 2024-03-18T07:19:08.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610708.log 2024-03-18T07:19:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227186.log 2024-03-18T07:19:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277904.log 2024-03-18T07:19:08.801 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242247.log.gz 2024-03-18T07:19:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227186.log.gz 2024-03-18T07:19:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161194.log 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610708.log.gz 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591535.log 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717950.log 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277904.log.gz 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.591535.log: /var/log/ceph/ceph-client.admin.161194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591535.log.gz 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269316.log 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161194.log.gz 2024-03-18T07:19:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123445.log 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717950.log: /var/log/ceph/ceph-client.admin.269316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269316.log.gz 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717950.log.gz 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47680.log 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46873.log.gz 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626977.log 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.123445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123445.log.gz 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735848.log 2024-03-18T07:19:08.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47680.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735848.log: /var/log/ceph/ceph-client.admin.626977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735848.log.gz 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221645.log 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626977.log.gz 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228613.log 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228613.log: /var/log/ceph/ceph-client.admin.221645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228613.log.gz 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358891.log 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221645.log.gz 2024-03-18T07:19:08.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264942.log 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44431.log 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341548.log 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.264942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264942.log.gz 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236268.log 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358891.log.gz 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264053.log 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236268.log: /var/log/ceph/ceph-client.admin.341548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236268.log.gz 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341548.log.gz 2024-03-18T07:19:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275911.log 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42975.log 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275911.log: /var/log/ceph/ceph-client.admin.264053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275911.log.gz 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264053.log.gz 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757163.log 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149575.log 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44431.log.gz 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757163.log: /var/log/ceph/ceph-client.admin.42975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757163.log.gz 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721852.log 2024-03-18T07:19:08.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354277.log 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.149575.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149575.log.gz 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116391.log 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.721852.log: /var/log/ceph/ceph-client.admin.354277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721852.log.gz 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354277.log.gz 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889908.log 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173021.log 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761301.log 2024-03-18T07:19:08.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720024.log 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759048.log 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889908.log: /var/log/ceph/ceph-client.admin.761301.log: /var/log/ceph/ceph-client.admin.173021.log: /var/log/ceph/ceph-client.admin.720024.log: 88.9%/var/log/ceph/ceph-client.admin.116391.log: -- replaced with /var/log/ceph/ceph-client.admin.889908.log.gz 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116391.log.gz 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.761301.log.gz --verbose -- 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.49020.log 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173021.log.gz 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720024.log.gz 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762039.log 2024-03-18T07:19:08.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759048.log: /var/log/ceph/ceph-client.admin.49020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759048.log.gz 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200484.log 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311340.log 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762039.log: /var/log/ceph/ceph-client.admin.200484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200484.log.gz 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762039.log.gz 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175586.log 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355658.log 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.175586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175586.log.gz 2024-03-18T07:19:08.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205201.log 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311340.log.gz 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660891.log 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.205201.log: /var/log/ceph/ceph-client.admin.355658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205201.log.gz 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355658.log.gz 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889339.log 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257078.log 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889339.log: /var/log/ceph/ceph-client.admin.660891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587147.log 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.889339.log.gz 2024-03-18T07:19:08.810 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660891.log.gz 2024-03-18T07:19:08.811 INFO:teuthology.orchestra.run.smithi136.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216365.log 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257078.log.gz 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300726.log 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.216365.log: /var/log/ceph/ceph-client.admin.587147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216365.log.gz 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239207.log 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587147.log.gz 2024-03-18T07:19:08.827 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255065.log 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239207.log: /var/log/ceph/ceph-client.admin.300726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239207.log.gz 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300726.log.gz 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886501.log 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649094.log 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47680.log.gz 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886501.log: /var/log/ceph/ceph-client.admin.255065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886501.log.gz 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255065.log.gz 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129617.log 2024-03-18T07:19:08.828 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.649094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217287.log 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649094.log.gz 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888835.log 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129617.log: /var/log/ceph/ceph-client.admin.217287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217287.log.gz 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129617.log.gz 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46957.log 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42975.log.gz 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225040.log 2024-03-18T07:19:08.829 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644020.log 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46957.log: /var/log/ceph/ceph-client.admin.225040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225040.log.gz 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.888835.log.gz 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735766.log 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46957.log.gz 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347006.log 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644020.log: /var/log/ceph/ceph-client.admin.735766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735766.log.gz 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644020.log.gz 2024-03-18T07:19:08.830 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204678.log 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285406.log 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.204678.log: /var/log/ceph/ceph-client.admin.347006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204678.log.gz 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347006.log.gz 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716282.log 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654714.log 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285406.log: /var/log/ceph/ceph-client.admin.716282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716282.log.gz 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285406.log.gz 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658104.log 2024-03-18T07:19:08.831 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659453.log 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654714.log.gz 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300063.log 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658104.log: /var/log/ceph/ceph-client.admin.659453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659453.log.gz 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658104.log.gz 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635313.log 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44440.log 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300063.log.gz 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353245.log 2024-03-18T07:19:08.832 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.635313.log: /var/log/ceph/ceph-client.admin.44440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635313.log.gz 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660390.log 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44440.log.gz 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.353245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114626.log 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353245.log.gz 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320759.log 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660390.log.gz 2024-03-18T07:19:08.833 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114626.log.gz 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628975.log 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44093.log 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320759.log.gz 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631230.log 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628975.log.gz 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354729.log 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.631230.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44093.log.gz 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274977.log 2024-03-18T07:19:08.834 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631230.log.gz 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350896.log 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.354729.log: /var/log/ceph/ceph-client.admin.274977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274977.log.gz 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354729.log.gz 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329181.log 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659466.log 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350896.log.gz 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208458.log 2024-03-18T07:19:08.835 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.329181.log: /var/log/ceph/ceph-client.admin.659466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659466.log.gz 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329181.log.gz 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748702.log 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230991.log 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208458.log.gz 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281555.log 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748702.log.gz 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146256.log 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230991.log: /var/log/ceph/ceph-client.admin.281555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281555.log.gz 2024-03-18T07:19:08.836 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230991.log.gz 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288237.log 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268824.log 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146256.log: /var/log/ceph/ceph-client.admin.288237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288237.log.gz 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146256.log.gz 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238715.log 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749181.log 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238715.log.gz 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.268824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767153.log 2024-03-18T07:19:08.837 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268824.log.gz 2024-03-18T07:19:08.838 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161263.log 2024-03-18T07:19:08.838 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749181.log: /var/log/ceph/ceph-client.admin.767153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767153.log.gz 2024-03-18T07:19:08.838 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749181.log.gz 2024-03-18T07:19:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158913.log 2024-03-18T07:19:08.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593431.log 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158913.log.gz/var/log/ceph/ceph-client.admin.161263.log: 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161263.log.gz 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738673.log 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627406.log 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738673.log.gz 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593431.log.gz 2024-03-18T07:19:08.874 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204747.log 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635820.log 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.627406.log: /var/log/ceph/ceph-client.admin.204747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204747.log.gz 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627406.log.gz 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140800.log 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610884.log 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.635820.log: /var/log/ceph/ceph-client.admin.140800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140800.log.gz 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635820.log.gz 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595350.log 2024-03-18T07:19:08.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720477.log 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610884.log.gz 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43376.log 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595350.log: /var/log/ceph/ceph-client.admin.720477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720477.log.gz 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595350.log.gz 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282942.log 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393387.log 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154853.log 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282942.log: /var/log/ceph/ceph-client.admin.393387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393387.log.gz 2024-03-18T07:19:08.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282942.log.gz 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43376.log.gz 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640522.log 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154853.log.gz 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339728.log 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579782.log 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640522.log: /var/log/ceph/ceph-client.admin.339728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339728.log.gz 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640522.log.gz 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639139.log 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46453.log 2024-03-18T07:19:08.877 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579782.log.gz 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874567.log 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.639139.log: /var/log/ceph/ceph-client.admin.46453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639139.log.gz 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768122.log 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639221.log 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.874567.log.gz 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407880.log 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768122.log: /var/log/ceph/ceph-client.admin.639221.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639221.log.gz 2024-03-18T07:19:08.878 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768122.log.gz 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44098.log 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.407880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655149.log 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407880.log.gz 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174601.log 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44098.log: /var/log/ceph/ceph-client.admin.655149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655149.log.gz 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144420.log 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46453.log.gz 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.877821.log 2024-03-18T07:19:08.879 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44098.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174601.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144420.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319540.log 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732164.log 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877821.log: /var/log/ceph/ceph-client.admin.319540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319540.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877821.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766227.log 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.732164.log: -- /var/log/ceph/ceph-client.admin.195802.log 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732164.log.gz 2024-03-18T07:19:08.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342243.log 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766227.log: /var/log/ceph/ceph-client.admin.195802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195802.log.gz 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766227.log.gz 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280968.log 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.342243.log: /var/log/ceph/ceph-client.admin.197726.log 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342243.log.gz 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592513.log 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280968.log: /var/log/ceph/ceph-client.admin.197726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280968.log.gz 2024-03-18T07:19:08.881 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197726.log.gz 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284174.log 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161729.log 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592513.log.gz 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115509.log 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284174.log: /var/log/ceph/ceph-client.admin.161729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161729.log.gz 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284174.log.gz 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347280.log 2024-03-18T07:19:08.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611605.log 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115509.log.gz 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157077.log 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347280.log: /var/log/ceph/ceph-client.admin.611605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347280.log.gz 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611605.log.gz 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336409.log 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.157077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890370.log 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157077.log.gz 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117571.log 2024-03-18T07:19:08.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.336409.log: /var/log/ceph/ceph-client.admin.890370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336409.log.gz 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.890370.log.gz 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148481.log 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640081.log 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117571.log.gz 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49736.log 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148481.log: /var/log/ceph/ceph-client.admin.640081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640081.log.gz 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148481.log.gz 2024-03-18T07:19:08.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883327.log 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254630.log 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732082.log 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883327.log: /var/log/ceph/ceph-client.admin.254630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254630.log.gz 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883327.log.gz 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162550.log 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732082.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49736.log.gz 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732082.log.gz 2024-03-18T07:19:08.885 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353796.log 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589352.log 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.162550.log: /var/log/ceph/ceph-client.admin.353796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353796.log.gz 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162550.log.gz 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201075.log 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716478.log 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589352.log.gz 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644089.log 2024-03-18T07:19:08.886 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.201075.log: /var/log/ceph/ceph-client.admin.716478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716478.log.gz 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201075.log.gz 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310218.log 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.644089.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.749373.log 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644089.log.gz 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409991.log 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.310218.log: /var/log/ceph/ceph-client.admin.749373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749373.log.gz 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310218.log.gz 2024-03-18T07:19:08.887 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655702.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122218.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409991.log.gz 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43922.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655702.log: /var/log/ceph/ceph-client.admin.122218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122218.log.gz 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655702.log.gz 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200553.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211768.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588031.log 2024-03-18T07:19:08.888 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200553.log: /var/log/ceph/ceph-client.admin.211768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211768.log.gz 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200553.log.gz 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722321.log 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158037.log 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588031.log.gz 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717673.log 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722321.log: /var/log/ceph/ceph-client.admin.158037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158037.log.gz 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722321.log.gz 2024-03-18T07:19:08.889 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146714.log 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650648.log 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717673.log.gz 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43922.log.gz 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.744769.log 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650648.log: /var/log/ceph/ceph-client.admin.146714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650648.log.gz 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146714.log.gz 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.743619.log 2024-03-18T07:19:08.890 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.744769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240631.log 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.744769.log.gz 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293032.log 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.743619.log: /var/log/ceph/ceph-client.admin.240631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240631.log.gz 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.743619.log.gz 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406974.log 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.293032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258671.log 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293032.log.gz 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48268.log 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406974.log: /var/log/ceph/ceph-client.admin.258671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258671.log.gz 2024-03-18T07:19:08.891 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406974.log.gz 2024-03-18T07:19:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192647.log 2024-03-18T07:19:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148751.log 2024-03-18T07:19:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231931.log 2024-03-18T07:19:08.892 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.192647.log: /var/log/ceph/ceph-client.admin.148751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148751.log.gz 2024-03-18T07:19:08.892 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192647.log.gz 2024-03-18T07:19:08.920 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283708.log 2024-03-18T07:19:08.920 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48268.log.gz 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349006.log 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231931.log.gz 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49652.log 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283708.log: /var/log/ceph/ceph-client.admin.349006.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349006.log.gz 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283708.log.gz 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298202.log 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226705.log 2024-03-18T07:19:08.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884218.log 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.298202.log: /var/log/ceph/ceph-client.admin.226705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226705.log.gz 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298202.log.gz 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49652.log.gz 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612062.log 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252110.log 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612062.log.gz 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884218.log.gz 2024-03-18T07:19:08.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719955.log 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129630.log 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719955.log.gz 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234734.log 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252110.log.gz 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610377.log 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234734.log.gz 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337518.log 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129630.log.gz 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610377.log.gz 2024-03-18T07:19:08.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651636.log 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358340.log 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304571.log 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337518.log.gz 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358340.log.gz 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651636.log.gz 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228146.log 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590008.log 2024-03-18T07:19:08.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228146.log.gz 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736408.log 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304571.log.gz 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746614.log 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736408.log.gz 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.590008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627419.log 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590008.log.gz 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646621.log 2024-03-18T07:19:08.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.627419.log: 0.0%/var/log/ceph/ceph-client.admin.746614.log: -- replaced with /var/log/ceph/ceph-client.admin.627419.log.gz 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638701.log 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746614.log.gz 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43144.log 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638701.log.gz 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318153.log 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646621.log.gz 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717591.log 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318153.log.gz 2024-03-18T07:19:08.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174575.log 2024-03-18T07:19:08.929 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189913.log 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717591.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43144.log.gz 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717591.log.gz 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731894.log 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174575.log: /var/log/ceph/ceph-client.admin.189913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174575.log.gz 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189913.log.gz 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214073.log 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151014.log 2024-03-18T07:19:08.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47518.log 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731894.log.gz 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151014.log.gz 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214073.log.gz 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578117.log 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768482.log 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578117.log.gz 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163070.log 2024-03-18T07:19:08.931 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47518.log.gz 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353783.log 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658929.log 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768482.log.gz 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.353783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353783.log.gz 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.163070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273640.log 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163070.log.gz 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327939.log 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.273640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273640.log.gz/var/log/ceph/ceph-client.admin.658929.log: 2024-03-18T07:19:08.932 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658929.log.gz 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747778.log 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730966.log 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747778.log.gz 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759913.log 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327939.log.gz 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750605.log 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759913.log.gz 2024-03-18T07:19:08.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.730966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730966.log.gz 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257091.log 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242935.log 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257091.log.gz 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217748.log 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750605.log.gz 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328131.log 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.217748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217748.log.gz 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163260.log 2024-03-18T07:19:08.934 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242935.log.gz 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264515.log 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.163260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163260.log.gz 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625561.log 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328131.log.gz 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252764.log 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625561.log.gz 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.264515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650095.log 2024-03-18T07:19:08.935 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264515.log.gz 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331920.log 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650095.log.gz 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350345.log 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252764.log.gz 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299616.log 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350345.log.gz 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285639.log 2024-03-18T07:19:08.936 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331920.log.gz 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309047.log 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285639.log.gz 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.299616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265844.log 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299616.log.gz 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331485.log 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265844.log.gz 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208010.log 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309047.log.gz 2024-03-18T07:19:08.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889614.log 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208010.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208010.log.gz 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319741.log 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331485.log.gz 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195216.log 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319741.log: /var/log/ceph/ceph-client.admin.889614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319741.log.gz 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576976.log 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128240.log 2024-03-18T07:19:08.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.576976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576976.log.gz 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.889614.log.gz 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.195216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637314.log 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195216.log.gz 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603490.log 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143948.log 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128240.log: /var/log/ceph/ceph-client.admin.603490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128240.log.gz 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603490.log.gz 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604848.log 2024-03-18T07:19:08.939 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637314.log.gz 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143948.log.gz 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662570.log 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48184.log 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731422.log 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604848.log.gz 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48184.log: /var/log/ceph/ceph-client.admin.662570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662570.log.gz 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283216.log 2024-03-18T07:19:08.940 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.48184.log.gz 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238728.log 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731422.log.gz 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410448.log 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238728.log: /var/log/ceph/ceph-client.admin.283216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238728.log.gz 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283216.log.gz 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44437.log 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143879.log 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410448.log.gz 2024-03-18T07:19:08.941 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117758.log 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143879.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44437.log.gz 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204760.log 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143879.log.gz 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883775.log 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106533.log 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.204760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117758.log.gz 2024-03-18T07:19:08.942 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204760.log.gz 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883775.log.gz 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749442.log 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106533.log.gz 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278196.log 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888877.log 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749442.log.gz 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278196.log.gz 2024-03-18T07:19:08.943 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751850.log 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318513.log 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584791.log 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318513.log: 0.0%/var/log/ceph/ceph-client.admin.751850.log: -- replaced with /var/log/ceph/ceph-client.admin.318513.log.gz 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46999.log 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751850.log.gz 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584791.log.gz 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.888877.log.gz 2024-03-18T07:19:08.944 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602065.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383047.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172813.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.383047.log: 0.0%/var/log/ceph/ceph-client.admin.602065.log: -- replaced with /var/log/ceph/ceph-client.admin.383047.log.gz 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48394.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602065.log.gz 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275898.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48394.log: /var/log/ceph/ceph-client.admin.172813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602052.log 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172813.log.gz 2024-03-18T07:19:08.945 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48394.log.gz 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323827.log 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275898.log: /var/log/ceph/ceph-client.admin.602052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602052.log.gz 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275898.log.gz 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719063.log 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113135.log 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.323827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143219.log 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323827.log.gz 2024-03-18T07:19:08.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113135.log.gz 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644642.log 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719063.log.gz 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225314.log 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644642.log.gz 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143219.log.gz 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231944.log 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123969.log 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231944.log.gz 2024-03-18T07:19:08.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158982.log 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225314.log.gz 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637755.log 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158982.log.gz 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.123969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222881.log 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123969.log.gz 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651117.log 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637755.log: /var/log/ceph/ceph-client.admin.222881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222881.log.gz 2024-03-18T07:19:08.948 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637755.log.gz 2024-03-18T07:19:08.949 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.46999.log.gz 2024-03-18T07:19:08.949 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.208389.log 2024-03-18T07:19:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612049.log 2024-03-18T07:19:08.977 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651117.log.gz 2024-03-18T07:19:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350622.log 2024-03-18T07:19:08.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208389.log: /var/log/ceph/ceph-client.admin.612049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612049.log.gz 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208389.log.gz 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115591.log 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110739.log 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350622.log.gz 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304928.log 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115591.log: /var/log/ceph/ceph-client.admin.110739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110739.log.gz 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115591.log.gz 2024-03-18T07:19:08.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235295.log 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315990.log 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304928.log.gz 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125687.log 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235295.log: /var/log/ceph/ceph-client.admin.315990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315990.log.gz 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235295.log.gz 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875021.log 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125687.log.gz 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351391.log 2024-03-18T07:19:08.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191235.log 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875021.log.gz 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47433.log 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351391.log.gz 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191235.log.gz 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310699.log 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276354.log 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47433.log: /var/log/ceph/ceph-client.admin.310699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310699.log.gz 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736604.log 2024-03-18T07:19:08.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199112.log 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47433.log.gz 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736604.log.gz 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276354.log.gz 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237226.log 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302532.log 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.199112.log: /var/log/ceph/ceph-client.admin.237226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237226.log.gz 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199112.log.gz 2024-03-18T07:19:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306368.log 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750400.log 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302532.log.gz 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332002.log 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306368.log.gz 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750400.log.gz 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266815.log 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144150.log 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332002.log.gz 2024-03-18T07:19:08.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189830.log 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266815.log.gz 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144150.log.gz 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588485.log 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.189830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381428.log 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189830.log.gz 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240165.log 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588485.log: /var/log/ceph/ceph-client.admin.381428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381428.log.gz 2024-03-18T07:19:08.983 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588485.log.gz 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597610.log 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355465.log 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597610.log: /var/log/ceph/ceph-client.admin.240165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597610.log.gz 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240165.log.gz 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591998.log 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216296.log 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.355465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355465.log.gz 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44104.log 2024-03-18T07:19:08.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.591998.log: /var/log/ceph/ceph-client.admin.216296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216296.log.gz 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591998.log.gz 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224494.log 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124399.log 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283969.log 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224494.log.gz 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44104.log.gz/var/log/ceph/ceph-client.admin.124399.log: 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302970.log 2024-03-18T07:19:08.985 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124399.log.gz 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173832.log 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283969.log.gz 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.741424.log 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302970.log.gz 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274506.log 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173832.log.gz 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.741424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653196.log 2024-03-18T07:19:08.986 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.741424.log.gz 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882761.log 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274506.log.gz 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.653196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222402.log 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653196.log.gz 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393879.log 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882761.log.gz 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279311.log 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222402.log.gz 2024-03-18T07:19:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.393879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240370.log 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393879.log.gz 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.279311.log: -- /var/log/ceph/ceph-client.admin.320044.log 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279311.log.gz 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274075.log 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240370.log.gz 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347513.log 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320044.log.gz 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126569.log 2024-03-18T07:19:08.988 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274075.log.gz 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357246.log 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347513.log.gz 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201261.log 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126569.log.gz 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.357246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889572.log 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357246.log.gz 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.201261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245946.log 2024-03-18T07:19:08.989 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201261.log.gz 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738225.log 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245946.log: 87.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.889572.log.gz -5 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.231401.log 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245946.log.gz 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318595.log 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738225.log.gz 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171305.log 2024-03-18T07:19:08.990 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231401.log.gz 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635395.log 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318595.log.gz 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251479.log 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.171305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171305.log.gz 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.635395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304489.log 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635395.log.gz 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254617.log 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251479.log.gz 2024-03-18T07:19:08.991 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751084.log 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304489.log.gz 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756161.log 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254617.log.gz 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.751084.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.328421.log 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751084.log.gz 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597597.log 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756161.log.gz 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393305.log 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328421.log.gz 2024-03-18T07:19:08.992 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626053.log 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597597.log.gz 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.393305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658022.log 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393305.log.gz 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340280.log 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626053.log.gz 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745864.log 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658022.log.gz 2024-03-18T07:19:08.993 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47806.log 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340280.log.gz 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745864.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.745864.log.gz 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.234050.log 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876917.log 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219530.log 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234050.log.gz 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733996.log 2024-03-18T07:19:08.994 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876917.log.gz 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47806.log.gz 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306852.log 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219530.log.gz 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584517.log 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733996.log.gz 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47476.log 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306852.log.gz 2024-03-18T07:19:08.995 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150088.log 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584517.log.gz 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315486.log 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645515.log 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150088.log.gz 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280776.log 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47476.log.gz 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315486.log.gz 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281037.log 2024-03-18T07:19:08.996 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645515.log.gz 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770805.log 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280776.log.gz 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222128.log 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.281037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281037.log.gz 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209893.log 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770805.log.gz 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595781.log 2024-03-18T07:19:08.997 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222128.log.gz 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338826.log 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.209893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209893.log.gz 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756586.log 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595781.log.gz 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157159.log 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.338826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338826.log.gz 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328213.log 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756586.log.gz 2024-03-18T07:19:08.998 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284858.log 2024-03-18T07:19:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.157159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157159.log.gz 2024-03-18T07:19:08.999 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658559.log 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328213.log.gz 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.878738.log 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284858.log.gz 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291857.log 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658559.log.gz 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716775.log 2024-03-18T07:19:09.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878738.log.gz 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276777.log 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291857.log.gz 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637232.log 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716775.log.gz 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381510.log 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276777.log.gz 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880083.log 2024-03-18T07:19:09.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637232.log.gz 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750139.log 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.381510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381510.log.gz 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298120.log 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880083.log.gz 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624329.log 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750139.log.gz 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329112.log 2024-03-18T07:19:09.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.298120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298120.log.gz 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717230.log 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624329.log.gz 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748963.log 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.329112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329112.log.gz 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275195.log 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717230.log.gz 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648431.log 2024-03-18T07:19:09.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748963.log.gz 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242439.log 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275195.log.gz 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335530.log 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648431.log.gz 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360800.log 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242439.log.gz 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382607.log 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335530.log.gz 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324694.log 2024-03-18T07:19:09.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.360800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763893.log 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360800.log.gz 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.324694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324694.log.gz 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271703.log 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382607.log.gz 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195298.log 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763893.log.gz 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142961.log 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271703.log.gz 2024-03-18T07:19:09.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253243.log 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.195298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195298.log.gz 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271621.log 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142961.log.gz 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145527.log 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253243.log.gz 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641764.log 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271621.log.gz 2024-03-18T07:19:09.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344787.log 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145527.log.gz 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.641764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405532.log 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641764.log.gz 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383405.log 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.344787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344787.log.gz 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759408.log 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.405532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405532.log.gz 2024-03-18T07:19:09.030 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231004.log 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.383405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383405.log.gz 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240644.log 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759408.log.gz 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885682.log 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231004.log.gz 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48310.log 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240644.log.gz 2024-03-18T07:19:09.031 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349374.log 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885682.log.gz 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305696.log 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590221.log 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349374.log.gz 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196345.log 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305696.log.gz 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.590221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150019.log 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590221.log.gz 2024-03-18T07:19:09.032 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48310.log.gz 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264502.log 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.196345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196345.log.gz 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223073.log 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150019.log.gz 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288745.log 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.264502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264502.log.gz 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358604.log 2024-03-18T07:19:09.033 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223073.log.gz 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309334.log 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288745.log.gz 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.358604.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.722334.log 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358604.log.gz 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579700.log 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309334.log.gz 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720844.log 2024-03-18T07:19:09.034 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722334.log.gz 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767637.log 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579700.log.gz 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236350.log 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720844.log.gz 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767637.log.gz 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642702.log 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236350.log.gz 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657825.log 2024-03-18T07:19:09.035 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.642702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577941.log 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642702.log.gz 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747312.log 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657825.log.gz 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649544.log 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577941.log.gz 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288306.log 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747312.log.gz 2024-03-18T07:19:09.036 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.649544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46915.log 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649544.log.gz 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199194.log 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288306.log.gz 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658546.log 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348254.log 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.199194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199194.log.gz 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594873.log 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658546.log.gz 2024-03-18T07:19:09.037 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753971.log 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46915.log.gz 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348254.log: gzip 0.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.348254.log.gz /var/log/ceph/ceph-client.admin.291124.log 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594873.log.gz 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300050.log 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753971.log.gz 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272672.log 2024-03-18T07:19:09.038 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291124.log.gz 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146431.log 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300050.log.gz 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718862.log 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272672.log.gz 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274698.log 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146431.log.gz 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194824.log 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718862.log.gz 2024-03-18T07:19:09.039 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112778.log 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274698.log.gz 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874196.log 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194824.log.gz 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756148.log 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112778.log.gz 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610091.log 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.874196.log.gz 2024-03-18T07:19:09.040 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143043.log 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756148.log.gz 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145973.log 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610091.log.gz 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590659.log 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143043.log.gz 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148738.log 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145973.log.gz 2024-03-18T07:19:09.041 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174562.log 2024-03-18T07:19:09.070 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.590659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590659.log.gz 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159904.log 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148738.log.gz 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381714.log 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174562.log.gz 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313574.log 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.159904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159904.log.gz 2024-03-18T07:19:09.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719600.log 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.381714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381714.log.gz 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200566.log 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.313574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313574.log.gz 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337059.log 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719600.log.gz 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172284.log 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200566.log.gz 2024-03-18T07:19:09.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615818.log 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337059.log.gz 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343772.log 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.172284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172284.log.gz 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230065.log 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615818.log.gz 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.877369.log 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.343772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343772.log.gz 2024-03-18T07:19:09.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601536.log 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230065.log.gz 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252123.log 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877369.log.gz 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890160.log 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601536.log.gz 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311631.log 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252123.log.gz 2024-03-18T07:19:09.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336788.log 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229074.log 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311631.log.gz 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.890160.log.gz 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.336788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648418.log 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336788.log.gz 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271427.log 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229074.log.gz 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260611.log 2024-03-18T07:19:09.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648418.log.gz 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592886.log 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271427.log.gz 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881439.log 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.260611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260611.log.gz 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252833.log 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592886.log.gz 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330613.log 2024-03-18T07:19:09.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.881439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881439.log.gz 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889087.log 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252833.log.gz 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889740.log 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330613.log.gz 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769882.log 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337247.log 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889740.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.889087.log.gz 2024-03-18T07:19:09.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197265.log 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.769882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769882.log.gz 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.889740.log.gz 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594791.log 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337247.log.gz 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216757.log 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197265.log.gz 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287085.log 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594791.log.gz 2024-03-18T07:19:09.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576262.log 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.216757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216757.log.gz 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253678.log 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.287085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287085.log.gz 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358809.log 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.576262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576262.log.gz 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628701.log 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253678.log.gz 2024-03-18T07:19:09.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275461.log 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358809.log.gz 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336422.log 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628701.log.gz 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244026.log 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275461.log.gz 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.336422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253051.log 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336422.log.gz 2024-03-18T07:19:09.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347980.log 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244026.log.gz 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633124.log 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253051.log.gz 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118275.log 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347980.log.gz 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633124.log.gz 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611161.log 2024-03-18T07:19:09.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750892.log 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118275.log.gz 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173008.log 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611161.log.gz 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122287.log 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750892.log.gz 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260529.log 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173008.log.gz 2024-03-18T07:19:09.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.122287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328200.log 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122287.log.gz 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.260529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305477.log 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260529.log.gz 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210746.log 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328200.log.gz 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338357.log 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305477.log.gz 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.210746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224753.log 2024-03-18T07:19:09.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210746.log.gz 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.338357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338357.log.gz 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642201.log 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230457.log 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224753.log.gz 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.642201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240152.log 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642201.log.gz 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737684.log 2024-03-18T07:19:09.084 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230457.log.gz 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307618.log 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240152.log.gz 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271414.log 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737684.log.gz 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580179.log 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307618.log.gz 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771779.log 2024-03-18T07:19:09.085 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271414.log.gz 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355452.log 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580179.log.gz 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191692.log 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771779.log.gz 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.355452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149213.log 0.0% 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.355452.log.gz 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288963.log 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191692.log.gz 2024-03-18T07:19:09.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.149213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194376.log 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149213.log.gz 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217679.log 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288963.log.gz 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316298.log 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194376.log.gz 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.217679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44762.log 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217679.log.gz 2024-03-18T07:19:09.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193523.log 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316298.log.gz 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616534.log 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.193523.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.747024.log 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193523.log.gz 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598526.log 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616534.log.gz 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44762.log.gz 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597528.log 2024-03-18T07:19:09.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747024.log.gz 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343406.log 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598526.log.gz 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144338.log 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597528.log.gz 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327721.log 2024-03-18T07:19:09.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.343406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343406.log.gz 2024-03-18T07:19:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580719.log 2024-03-18T07:19:09.116 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144338.log.gz 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249879.log 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327721.log.gz 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356704.log 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580719.log.gz 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171835.log 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249879.log.gz 2024-03-18T07:19:09.117 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.356704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652188.log 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356704.log.gz 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761970.log 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.171835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171835.log.gz 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293101.log 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652188.log.gz 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213530.log 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.761970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761970.log.gz 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173750.log 2024-03-18T07:19:09.118 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.293101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293101.log.gz 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.213530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613047.log 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213530.log.gz 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300448.log 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173750.log.gz 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235282.log 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613047.log.gz 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300448.log.gz 2024-03-18T07:19:09.119 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890118.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235282.log.gz 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336340.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46705.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409319.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46705.log: /var/log/ceph/ceph-client.admin.336340.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.890118.log.gz 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336340.log.gz 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646608.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71573.log 2024-03-18T07:19:09.120 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409319.log.gz 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315473.log 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646608.log: /var/log/ceph/ceph-client.admin.71573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646608.log.gz 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.877382.log 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147554.log 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315473.log.gz 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49185.log 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877382.log.gz 2024-03-18T07:19:09.121 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46705.log.gz 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109921.log 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147554.log.gz 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309321.log 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146243.log 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109921.log.gz 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127710.log 2024-03-18T07:19:09.122 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146243.log: /var/log/ceph/ceph-client.admin.309321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146243.log.gz 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309321.log.gz 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359343.log 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.127710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661639.log 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127710.log.gz 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49185.log.gz 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.359343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167468.log 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359343.log.gz 2024-03-18T07:19:09.123 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.71573.log.gz 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661639.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.661639.log.gz -- 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.325911.log 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.167468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46495.log 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167468.log.gz 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586699.log 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325911.log.gz 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658477.log 2024-03-18T07:19:09.124 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.586699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612978.log 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586699.log.gz 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153883.log 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658477.log.gz 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634945.log 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46495.log.gz 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577928.log 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612978.log.gz 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.153883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128253.log 2024-03-18T07:19:09.125 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153883.log.gz 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577928.log: /var/log/ceph/ceph-client.admin.634945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577928.log.gz 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634945.log.gz 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615900.log 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254548.log 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128253.log.gz 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615900.log.gz 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882372.log 2024-03-18T07:19:09.126 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633998.log 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254548.log.gz 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229156.log 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882372.log.gz 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610626.log 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633998.log.gz 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611980.log 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229156.log.gz 2024-03-18T07:19:09.127 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221841.log 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610626.log.gz 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112696.log 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611980.log.gz 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141698.log 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221841.log.gz 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247263.log 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112696.log.gz 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45266.log 2024-03-18T07:19:09.128 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141698.log.gz 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193536.log 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247263.log.gz 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494547.log 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610179.log 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193536.log.gz 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227941.log 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.494547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.494547.log.gz 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626258.log 2024-03-18T07:19:09.129 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45266.log.gz 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610179.log.gz 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326777.log 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227941.log.gz 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342256.log 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626258.log.gz 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.326777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639659.log 2024-03-18T07:19:09.130 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326777.log.gz 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720926.log 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342256.log.gz 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.639659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313505.log 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639659.log.gz 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384334.log 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720926.log.gz 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.313505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291870.log 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313505.log.gz 2024-03-18T07:19:09.131 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.384334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142571.log 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384334.log.gz 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651623.log 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291870.log.gz 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594575.log 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142571.log.gz 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.651623.log: /var/log/ceph/ceph-client.admin.256804.log 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651623.log.gz 2024-03-18T07:19:09.132 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.594575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.144407.log 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594575.log.gz 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.256804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174064.log 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256804.log.gz 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735551.log 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144407.log.gz 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722056.log 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174064.log.gz 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286810.log 2024-03-18T07:19:09.133 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735551.log.gz 2024-03-18T07:19:09.134 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722056.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.722056.log.gz --verbose 2024-03-18T07:19:09.134 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.323394.log 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274493.log 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286810.log.gz 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.323394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335894.log 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323394.log.gz 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881809.log 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274493.log.gz 2024-03-18T07:19:09.151 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349915.log 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335894.log.gz 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.881809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255935.log 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881809.log.gz 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277917.log 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349915.log.gz 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170434.log 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255935.log.gz 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198272.log 2024-03-18T07:19:09.152 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277917.log.gz 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.170434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124412.log 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170434.log.gz 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313587.log 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198272.log.gz 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.124412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237034.log 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124412.log.gz 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.313587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216826.log 2024-03-18T07:19:09.153 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313587.log.gz 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.237034.log: --verbose -- /var/log/ceph/ceph-client.admin.890244.log 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237034.log.gz 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.216826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753958.log 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216826.log.gz 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610421.log 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304997.log 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.890244.log.gz 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753958.log.gz 2024-03-18T07:19:09.154 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351860.log 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610421.log.gz 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600655.log 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304997.log.gz 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250140.log 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351860.log.gz 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.600655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592067.log 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600655.log.gz 2024-03-18T07:19:09.155 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.250140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342050.log 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250140.log.gz 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222868.log 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592067.log.gz 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352795.log 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342050.log.gz 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234529.log 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222868.log.gz 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.352795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2024-03-18T07:19:09.156 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352795.log.gz 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.234529.log: -- /var/log/ceph/ceph-client.admin.647784.log 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234529.log.gz 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337880.log 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.647784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613248.log 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647784.log.gz 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745331.log 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337880.log.gz 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gz 2024-03-18T07:19:09.157 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271895.log 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613248.log.gz 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327652.log 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.745331.log.gz 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760855.log 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271895.log.gz 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173388.log 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327652.log.gz 2024-03-18T07:19:09.158 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.760855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883706.log 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760855.log.gz 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.173388.log: --verbose -- /var/log/ceph/ceph-client.admin.158477.log 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173388.log.gz 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385094.log 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883706.log.gz 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875090.log 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158477.log.gz 2024-03-18T07:19:09.159 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.385094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242029.log 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385094.log.gz 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247332.log 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875090.log.gz 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322956.log 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242029.log.gz 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610289.log 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247332.log.gz 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739622.log 2024-03-18T07:19:09.160 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322956.log.gz 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189900.log 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610289.log.gz 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885669.log 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739622.log.gz 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.189900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592444.log 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189900.log.gz 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881891.log 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885669.log.gz 2024-03-18T07:19:09.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321450.log 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592444.log.gz 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.881891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106449.log 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881891.log.gz 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145514.log 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321450.log.gz 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.106449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629241.log 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106449.log.gz 2024-03-18T07:19:09.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346194.log 2024-03-18T07:19:09.163 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145514.log.gz 2024-03-18T07:19:09.173 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258753.log 2024-03-18T07:19:09.173 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629241.log.gz 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.346194.log: --verbose -- /var/log/ceph/ceph-client.admin.614343.log 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346194.log.gz 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.258753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737252.log 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258753.log.gz 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.614343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764783.log 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614343.log.gz 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.737252.log: -- /var/log/ceph/ceph-client.admin.147636.log 2024-03-18T07:19:09.174 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737252.log.gz 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.764783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126619.log 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764783.log.gz 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767357.log 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147636.log.gz 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.742012.log 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126619.log.gz 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730953.log 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767357.log.gz 2024-03-18T07:19:09.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.742012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318071.log 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.742012.log.gz 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757374.log 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.730953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730953.log.gz 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303408.log 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318071.log.gz 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757374.log.gz 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286400.log 2024-03-18T07:19:09.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.303408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265857.log 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303408.log.gz 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333735.log 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286400.log.gz 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140813.log 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265857.log.gz 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246866.log 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333735.log.gz 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.140813.log: /var/log/ceph/ceph-client.admin.248221.log 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140813.log.gz 2024-03-18T07:19:09.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330325.log 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246866.log.gz 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173375.log 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248221.log.gz 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.330325.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.595052.log 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330325.log.gz 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287788.log 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173375.log.gz 2024-03-18T07:19:09.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278598.log 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595052.log.gz 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.287788.log: -- /var/log/ceph/ceph-client.admin.734927.log 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287788.log.gz 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258175.log 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278598.log.gz 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600737.log 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734927.log.gz 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325478.log/var/log/ceph/ceph-client.admin.258175.log: 2024-03-18T07:19:09.179 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258175.log.gz 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.600737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286126.log 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600737.log.gz 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592968.log 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325478.log.gz 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.286126.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.739553.log 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286126.log.gz 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624342.log 2024-03-18T07:19:09.180 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592968.log.gz 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147853.log 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739553.log.gz 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733414.log 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624342.log.gz 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411390.log 2024-03-18T07:19:09.181 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147853.log.gz 2024-03-18T07:19:09.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656343.log 2024-03-18T07:19:09.190 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733414.log.gz 2024-03-18T07:19:09.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.411390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321248.log 2024-03-18T07:19:09.190 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411390.log.gz 2024-03-18T07:19:09.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.656343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43838.log 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656343.log.gz 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316285.log 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321248.log: /var/log/ceph/ceph-client.admin.43838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321248.log.gz 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770169.log 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625082.log 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316285.log.gz 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43838.log.gz 2024-03-18T07:19:09.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306163.log 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770169.log.gz 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154409.log 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306163.log.gz 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625082.log.gz 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285852.log 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338908.log 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154409.log.gz 2024-03-18T07:19:09.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771333.log 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.338908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338908.log.gz 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285852.log.gz 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339446.log 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733914.log 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771333.log.gz 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269764.log 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733914.log.gz 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321724.log 2024-03-18T07:19:09.193 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339446.log.gz 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126528.log 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321724.log: 0.0%/var/log/ceph/ceph-client.admin.269764.log: -- replaced with /var/log/ceph/ceph-client.admin.321724.log.gz 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269764.log.gz 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344219.log 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407364.log 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126528.log.gz 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.344219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303395.log 2024-03-18T07:19:09.194 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344219.log.gz 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.407364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308089.log 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407364.log.gz 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594112.log 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.303395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303395.log.gz 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876378.log 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308089.log.gz 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144866.log 2024-03-18T07:19:09.195 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594112.log.gz 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599846.log 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876378.log.gz 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315977.log 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144866.log.gz 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.599846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306437.log 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599846.log.gz 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166146.log 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315977.log.gz 2024-03-18T07:19:09.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238253.log 2024-03-18T07:19:09.197 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306437.log.gz 2024-03-18T07:19:09.208 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.166146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661900.log 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166146.log.gz 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238253.log.gz 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49522.log 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110808.log 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661900.log.gz 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231483.log 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47980.log 2024-03-18T07:19:09.209 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110808.log.gz 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266528.log 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231483.log.gz 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49522.log.gz 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321998.log 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307139.log 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266528.log.gz 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47980.log.gz/var/log/ceph/ceph-client.admin.321998.log: 2024-03-18T07:19:09.210 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758602.log 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321998.log.gz 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211755.log 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307139.log.gz 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.758602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224044.log 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758602.log.gz 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737321.log 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211755.log.gz 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233584.log 2024-03-18T07:19:09.211 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224044.log.gz 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270461.log 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737321.log.gz 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594588.log 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233584.log.gz 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239604.log 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270461.log.gz 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716200.log 2024-03-18T07:19:09.212 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594588.log.gz 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633558.log 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239604.log.gz 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753492.log 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716200.log.gz 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633558.log.gz 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213991.log 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753492.log.gz 2024-03-18T07:19:09.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114089.log 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.213991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337893.log 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213991.log.gz 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273074.log 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114089.log.gz 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715757.log 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337893.log.gz 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.273074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325980.log 2024-03-18T07:19:09.214 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273074.log.gz 2024-03-18T07:19:09.215 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889866.log 2024-03-18T07:19:09.215 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715757.log.gz 2024-03-18T07:19:09.215 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263971.log 2024-03-18T07:19:09.215 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325980.log.gz 2024-03-18T07:19:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224236.log 2024-03-18T07:19:09.231 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.263971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206030.log 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.889866.log.gz 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263971.log.gz 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770443.log 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224236.log.gz 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.206030.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.769451.log 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206030.log.gz 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636760.log 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770443.log.gz 2024-03-18T07:19:09.232 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.769451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732668.log 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769451.log.gz 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747983.log 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636760.log.gz 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754711.log 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732668.log.gz 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662378.log 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747983.log.gz 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639208.log 2024-03-18T07:19:09.233 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754711.log.gz 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.662378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210285.log 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662378.log.gz 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.639208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288950.log 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639208.log.gz 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.210285.log: --verbose -- /var/log/ceph/ceph-client.admin.616345.log 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210285.log.gz 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658998.log 2024-03-18T07:19:09.234 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288950.log.gz 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645502.log 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616345.log.gz 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.658998.log: -- /var/log/ceph/ceph-client.admin.580249.log 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658998.log.gz 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126022.log 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645502.log.gz 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611536.log 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580249.log.gz 2024-03-18T07:19:09.235 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.126022.log: -- /var/log/ceph/ceph-client.admin.878656.log 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126022.log.gz 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661349.log 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611536.log.gz 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155738.log 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878656.log.gz 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578400.log 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661349.log.gz 2024-03-18T07:19:09.236 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631304.log 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155738.log.gz 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49946.log 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578400.log.gz 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.631304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252846.log 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631304.log.gz 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605359.log 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733130.log 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252846.log.gz 2024-03-18T07:19:09.237 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408095.log 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605359.log.gz 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348541.log 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733130.log.gz 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142128.log 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408095.log.gz 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193716.log 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348541.log.gz 2024-03-18T07:19:09.238 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48478.log 2024-03-18T07:19:09.239 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142128.log.gz 2024-03-18T07:19:09.239 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610355.log 2024-03-18T07:19:09.239 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193716.log.gz 2024-03-18T07:19:09.239 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.48478.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.251032.log 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229535.log 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49946.log.gz 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610355.log.gz 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279590.log 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251032.log.gz 2024-03-18T07:19:09.256 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888961.log 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229535.log.gz 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228682.log 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279590.log.gz 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300530.log 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228682.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.888961.log.gz 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127351.log 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228682.log.gz 2024-03-18T07:19:09.257 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190362.log 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300530.log.gz 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220670.log 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.127351.log: /var/log/ceph/ceph-client.admin.190362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190362.log.gz 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127351.log.gz 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145715.log 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48940.log 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220670.log: /var/log/ceph/ceph-client.admin.145715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145715.log.gz 2024-03-18T07:19:09.258 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220670.log.gz 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632731.log 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.383474.log 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48478.log.gz 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214452.log 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632731.log: /var/log/ceph/ceph-client.admin.383474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383474.log.gz 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632731.log.gz 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255052.log 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300517.log 2024-03-18T07:19:09.259 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214452.log.gz 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658280.log 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255052.log.gz 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143420.log 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300517.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48940.log.gz 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223347.log 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300517.log.gz 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307413.log 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658280.log.gz 2024-03-18T07:19:09.260 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223347.log.gz 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737942.log 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143420.log.gz 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160830.log 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307413.log.gz 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880535.log 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737942.log.gz 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265775.log 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.160830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160830.log.gz 2024-03-18T07:19:09.261 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753684.log 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880535.log.gz 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193454.log 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265775.log.gz 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604930.log 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753684.log.gz 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750331.log 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193454.log.gz 2024-03-18T07:19:09.262 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143502.log 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604930.log.gz 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153952.log 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750331.log.gz 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202362.log 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143502.log.gz 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338621.log/var/log/ceph/ceph-client.admin.153952.log: 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153952.log.gz 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722518.log 2024-03-18T07:19:09.263 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202362.log.gz 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.338621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629515.log 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338621.log.gz 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212677.log 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722518.log.gz 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768109.log 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629515.log.gz 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112257.log 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212677.log.gz 2024-03-18T07:19:09.264 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587065.log 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768109.log.gz 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264955.log 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112257.log.gz 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.587065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49312.log 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587065.log.gz 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.264955.log: -- /var/log/ceph/ceph-client.admin.43544.log 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264955.log.gz 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326426.log 2024-03-18T07:19:09.265 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874112.log 2024-03-18T07:19:09.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.326426.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.331129.log 2024-03-18T07:19:09.286 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326426.log.gz 2024-03-18T07:19:09.286 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43544.log.gz 2024-03-18T07:19:09.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323312.log 2024-03-18T07:19:09.286 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49312.log.gz 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.874112.log.gz 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596874.log 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331129.log.gz 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.323312.log: --verbose -- /var/log/ceph/ceph-client.admin.114557.log 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323312.log.gz 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.596874.log: /var/log/ceph/ceph-client.admin.358617.log 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596874.log.gz 2024-03-18T07:19:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170352.log 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114557.log.gz 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283503.log 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358617.log.gz 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.170352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411117.log 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170352.log.gz 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165719.log 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283503.log.gz 2024-03-18T07:19:09.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.411117.log: --verbose -- /var/log/ceph/ceph-client.admin.603024.log 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411117.log.gz 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.165719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221910.log 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165719.log.gz 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275829.log 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603024.log.gz 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331116.log 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221910.log.gz 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43334.log 2024-03-18T07:19:09.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275829.log.gz 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766698.log 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331116.log.gz 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288758.log 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126825.log 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766698.log.gz 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263514.log 2024-03-18T07:19:09.290 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43334.log.gz 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288758.log.gz 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330047.log 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126825.log.gz 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.263514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241041.log 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263514.log.gz 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228215.log 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330047.log.gz 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220032.log 2024-03-18T07:19:09.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241041.log.gz 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290096.log 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228215.log.gz 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347305.log 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220032.log.gz 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115284.log 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290096.log.gz 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604917.log 2024-03-18T07:19:09.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347305.log.gz 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156609.log 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115284.log.gz 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655080.log 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604917.log.gz 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636038.log 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156609.log.gz 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348459.log 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655080.log.gz 2024-03-18T07:19:09.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332355.log 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636038.log.gz 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716465.log 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348459.log.gz 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142773.log 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332355.log.gz 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251397.log 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716465.log.gz 2024-03-18T07:19:09.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172731.log 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142773.log.gz 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117300.log 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251397.log.gz 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.172731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613957.log 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172731.log.gz 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174832.log 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117300.log.gz 2024-03-18T07:19:09.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772256.log 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613957.log.gz 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230922.log 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174832.log: /var/log/ceph/ceph-client.admin.772256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772256.log.gz 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174832.log.gz 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191166.log 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242234.log 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230922.log.gz 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216378.log 2024-03-18T07:19:09.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191166.log: /var/log/ceph/ceph-client.admin.242234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242234.log.gz 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191166.log.gz 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746819.log 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.216378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626964.log 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216378.log.gz 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220944.log 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746819.log: /var/log/ceph/ceph-client.admin.626964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626964.log.gz 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746819.log.gz 2024-03-18T07:19:09.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233571.log 2024-03-18T07:19:09.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769381.log 2024-03-18T07:19:09.323 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220944.log.gz 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747299.log 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233571.log: /var/log/ceph/ceph-client.admin.769381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769381.log.gz 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233571.log.gz 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385081.log 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289429.log 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747299.log.gz 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643208.log 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.385081.log: /var/log/ceph/ceph-client.admin.289429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289429.log.gz 2024-03-18T07:19:09.324 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385081.log.gz 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301788.log 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146444.log 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643208.log.gz 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661831.log 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301788.log.gz 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610245.log 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146444.log.gz 2024-03-18T07:19:09.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629721.log 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661831.log.gz 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646813.log 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610245.log.gz 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754245.log 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629721.log.gz 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580262.log 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646813.log.gz 2024-03-18T07:19:09.326 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284940.log 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754245.log.gz 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234542.log 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580262.log.gz 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284940.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.284940.log.gz -5 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.128610.log 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597084.log 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234542.log.gz 2024-03-18T07:19:09.327 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299534.log 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128610.log.gz 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200101.log 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597084.log.gz 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.299534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733427.log 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299534.log.gz 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.873717.log 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200101.log.gz 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631318.log 2024-03-18T07:19:09.328 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733427.log.gz 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.873717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142059.log 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.873717.log.gz 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.631318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223552.log 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631318.log.gz 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126894.log 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142059.log.gz 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407811.log 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223552.log.gz 2024-03-18T07:19:09.329 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349019.log 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126894.log.gz 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.407811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880522.log 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407811.log.gz 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43670.log 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349019.log.gz 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889171.log 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880522.log.gz 2024-03-18T07:19:09.330 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577410.log 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886061.log 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159835.log 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577410.log.gz 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.889171.log.gz 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737334.log 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886061.log.gz 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43670.log.gz 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.159835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596222.log 2024-03-18T07:19:09.331 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159835.log.gz 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125983.log 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737334.log.gz 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.596222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150574.log 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596222.log.gz 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755682.log 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125983.log.gz 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755203.log 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150574.log.gz 2024-03-18T07:19:09.332 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739090.log 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755682.log.gz 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251905.log 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755203.log.gz 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190786.log 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739090.log.gz 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144137.log 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251905.log.gz 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.190786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721770.log 2024-03-18T07:19:09.333 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190786.log.gz 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284653.log 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144137.log.gz 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.721770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212229.log 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721770.log.gz 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217218.log 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284653.log.gz 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600279.log 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212229.log.gz 2024-03-18T07:19:09.334 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.217218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603216.log 2024-03-18T07:19:09.335 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217218.log.gz 2024-03-18T07:19:09.335 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.600279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114172.log 2024-03-18T07:19:09.337 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600279.log.gz 2024-03-18T07:19:09.337 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735367.log 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603216.log.gz 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197910.log 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114172.log.gz 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242521.log 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735367.log.gz 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334532.log 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197910.log.gz 2024-03-18T07:19:09.338 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115956.log 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242521.log.gz 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223360.log 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334532.log.gz 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161276.log 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115956.log.gz 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884894.log 2024-03-18T07:19:09.339 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223360.log.gz 2024-03-18T07:19:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49396.log 2024-03-18T07:19:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.161276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161276.log.gz 2024-03-18T07:19:09.367 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633193.log 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884894.log.gz 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652615.log 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247071.log 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633193.log.gz 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49396.log.gz 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204433.log 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652615.log.gz 2024-03-18T07:19:09.368 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245864.log 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247071.log.gz 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283421.log 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.204433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204433.log.gz 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344705.log 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245864.log.gz 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761314.log 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283421.log.gz 2024-03-18T07:19:09.369 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.344705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222115.log 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344705.log.gz 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242042.log 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.761314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761314.log.gz 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659200.log 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222115.log.gz 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887498.log 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242042.log.gz 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331989.log 2024-03-18T07:19:09.370 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.659200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659200.log.gz 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406101.log/var/log/ceph/ceph-client.admin.887498.log: 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887498.log.gz 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233366.log 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331989.log.gz 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653209.log 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406101.log.gz 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48604.log 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233366.log.gz 2024-03-18T07:19:09.371 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252397.log 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.653209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653209.log.gz 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282289.log 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885600.log 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252397.log.gz 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888572.log 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282289.log.gz 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48604.log.gz 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267773.log 2024-03-18T07:19:09.372 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885600.log.gz 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765591.log 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308363.log 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267773.log.gz 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.888572.log.gz 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.765591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609357.log 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765591.log.gz 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116938.log 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308363.log.gz 2024-03-18T07:19:09.373 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609357.log.gz 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144596.log 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116938.log.gz 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43102.log 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615020.log 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144596.log.gz 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2024-03-18T07:19:09.374 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237992.log 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45014.log 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615020.log.gz 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43102.log.gz 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631751.log 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237992.log.gz 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129813.log 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.631751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126336.log 2024-03-18T07:19:09.375 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45014.log.gz 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631751.log.gz 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129813.log.gz 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297679.log 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283024.log 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126336.log.gz 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.297679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254195.log 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297679.log.gz 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208650.log 2024-03-18T07:19:09.376 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283024.log.gz 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221358.log 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254195.log.gz 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604451.log 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208650.log.gz 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737766.log 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221358.log.gz 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579769.log 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604451.log.gz 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347582.log 2024-03-18T07:19:09.377 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737766.log.gz 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46193.log 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579769.log.gz 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879629.log 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347582.log.gz 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.46193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763880.log 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46193.log.gz 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.879629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651913.log 2024-03-18T07:19:09.378 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879629.log.gz 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268317.log 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763880.log.gz 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762962.log 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651913.log.gz 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.268317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200019.log 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268317.log.gz 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762962.log.gz 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31373.log 2024-03-18T07:19:09.379 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887958.log 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200019.log.gz 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.31373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735835.log 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31373.log.gz 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358258.log 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887958.log.gz 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722531.log 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735835.log.gz 2024-03-18T07:19:09.380 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305408.log 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358258.log.gz 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147353.log 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722531.log.gz 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49694.log 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305408.log.gz 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263596.log 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147353.log.gz 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126048.log 2024-03-18T07:19:09.381 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.263596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254113.log 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263596.log.gz 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126048.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126048.log.gz 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290644.log 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49694.log.gz 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254113.log.gz 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613060.log 2024-03-18T07:19:09.382 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291111.log 2024-03-18T07:19:09.383 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290644.log.gz 2024-03-18T07:19:09.383 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223826.log 2024-03-18T07:19:09.383 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613060.log.gz 2024-03-18T07:19:09.419 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887235.log 2024-03-18T07:19:09.419 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291111.log.gz 2024-03-18T07:19:09.419 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208663.log 2024-03-18T07:19:09.419 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223826.log.gz 2024-03-18T07:19:09.419 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214995.log 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887235.log.gz 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125946.log 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208663.log.gz 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318787.log 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214995.log.gz 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218222.log 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125946.log.gz 2024-03-18T07:19:09.420 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327279.log 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318787.log.gz 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408877.log 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.218222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218222.log.gz 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766423.log 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327279.log.gz 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221149.log 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408877.log.gz 2024-03-18T07:19:09.421 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766423.log.gz 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751289.log 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217761.log 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221149.log.gz 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.751289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644368.log 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751289.log.gz 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.217761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286879.log 2024-03-18T07:19:09.422 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217761.log.gz 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576989.log 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644368.log.gz 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302015.log 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286879.log.gz 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.576989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241480.log 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576989.log.gz 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584809.log 2024-03-18T07:19:09.423 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302015.log.gz 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635833.log 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241480.log.gz 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346112.log 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584809.log.gz 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.635833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758149.log 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635833.log.gz 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.346112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304055.log 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346112.log.gz 2024-03-18T07:19:09.424 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718225.log 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.758149.log: /var/log/ceph/ceph-client.admin.304055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304055.log.gz 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758149.log.gz 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226221.log 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646260.log 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718225.log.gz 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308568.log 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226221.log: /var/log/ceph/ceph-client.admin.646260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646260.log.gz 2024-03-18T07:19:09.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226221.log.gz 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584771.log 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614412.log 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308568.log.gz 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213599.log 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584771.log: /var/log/ceph/ceph-client.admin.614412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614412.log.gz 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584771.log.gz 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245036.log 2024-03-18T07:19:09.426 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.213599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625779.log 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213599.log.gz 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166159.log 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245036.log: /var/log/ceph/ceph-client.admin.625779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625779.log.gz 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245036.log.gz 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353327.log 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.166159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270243.log 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166159.log.gz 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256387.log 2024-03-18T07:19:09.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.353327.log: /var/log/ceph/ceph-client.admin.270243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353327.log.gz 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270243.log.gz 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247811.log 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.256387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885120.log 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256387.log.gz 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260598.log 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885120.log: /var/log/ceph/ceph-client.admin.247811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885120.log.gz 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247811.log.gz 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158995.log 2024-03-18T07:19:09.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.260598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649628.log 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260598.log.gz 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306176.log 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158995.log.gz 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.649628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624821.log 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649628.log.gz 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344774.log 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306176.log.gz 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662296.log 2024-03-18T07:19:09.429 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624821.log.gz 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.344774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410714.log 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344774.log.gz 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.662296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602545.log 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662296.log.gz 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147161.log 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410714.log.gz 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333294.log 2024-03-18T07:19:09.430 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602545.log.gz 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153497.log 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147161.log.gz 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46537.log 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333294.log.gz 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.153497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756394.log 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153497.log.gz 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255487.log 2024-03-18T07:19:09.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212690.log 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756394.log.gz 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746138.log 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255487.log.gz 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319553.log 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212690.log.gz 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722043.log 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746138.log: /var/log/ceph/ceph-client.admin.319553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319553.log.gz 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746138.log.gz 2024-03-18T07:19:09.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332437.log 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.722043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392454.log 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722043.log.gz 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224507.log 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332437.log.gz 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.392454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.884905.log 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46537.log.gz 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392454.log.gz 2024-03-18T07:19:09.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249217.log 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224507.log.gz 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382594.log 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884905.log.gz 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284461.log 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249217.log.gz 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206670.log 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382594.log.gz 2024-03-18T07:19:09.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652106.log 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284461.log.gz 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220045.log 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206670.log.gz 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766629.log 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652106.log.gz 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220045.log.gz 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267760.log 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889213.log 2024-03-18T07:19:09.435 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766629.log.gz 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715386.log 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267760.log.gz 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251466.log 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715386.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.889213.log.gz 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250071.log 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715386.log.gz 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42664.log 2024-03-18T07:19:09.436 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251466.log.gz 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.250071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237021.log 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250071.log.gz 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660308.log 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601605.log 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237021.log.gz 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351668.log 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660308.log.gz 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42664.log.gz 2024-03-18T07:19:09.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605729.log 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601605.log.gz 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281637.log 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351668.log.gz 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117558.log 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605729.log.gz 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.281637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625095.log 2024-03-18T07:19:09.438 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281637.log.gz 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350635.log 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117558.log.gz 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344493.log 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625095.log.gz 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248016.log 2024-03-18T07:19:09.485 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350635.log.gz 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.344493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46621.log 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344493.log.gz 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749660.log 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248016.log.gz 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613518.log 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238184.log 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749660.log.gz 2024-03-18T07:19:09.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443309.log 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613518.log.gz 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46621.log.gz 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754450.log 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238184.log.gz 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.443309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648226.log 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.443309.log.gz 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342708.log 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754450.log.gz 2024-03-18T07:19:09.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648226.log.gz 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648715.log 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718875.log 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342708.log.gz 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155294.log 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648715.log.gz 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214982.log 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718875.log.gz 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155294.log.gz 2024-03-18T07:19:09.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653127.log 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637824.log/var/log/ceph/ceph-client.admin.214982.log: 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214982.log.gz 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.653127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616088.log 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653127.log.gz 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292105.log 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637824.log.gz 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283229.log 2024-03-18T07:19:09.489 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616088.log.gz 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.292105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125757.log 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292105.log.gz 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340554.log 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283229.log.gz 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410727.log 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125757.log.gz 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205629.log 2024-03-18T07:19:09.490 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340554.log.gz 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650925.log 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410727.log.gz 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.205629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258958.log 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205629.log.gz 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657563.log 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650925.log.gz 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.258958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598513.log 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258958.log.gz 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657563.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.657563.log.gz --verbose 2024-03-18T07:19:09.491 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.48856.log 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232628.log 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598513.log.gz 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600210.log 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594099.log 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232628.log.gz 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.600210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198190.log 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600210.log.gz 2024-03-18T07:19:09.492 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161742.log 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48856.log.gz 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594099.log.gz 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193078.log 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198190.log.gz 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.161742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113596.log 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161742.log.gz 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652628.log 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193078.log.gz 2024-03-18T07:19:09.493 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222799.log 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113596.log.gz 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246395.log 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652628.log.gz 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335976.log 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222799.log.gz 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333748.log 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246395.log.gz 2024-03-18T07:19:09.494 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459791.log 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335976.log.gz 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339459.log 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333748.log.gz 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.459791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593907.log 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.459791.log.gz 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288676.log 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339459.log.gz 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882358.log 2024-03-18T07:19:09.495 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593907.log.gz 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771251.log 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288676.log.gz 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644102.log 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882358.log.gz 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735354.log 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771251.log.gz 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648213.log 2024-03-18T07:19:09.496 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644102.log.gz 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151911.log 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735354.log.gz 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265404.log 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648213.log.gz 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610135.log 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151911.log.gz 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749921.log 2024-03-18T07:19:09.497 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265404.log.gz 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160318.log 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610135.log.gz 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625492.log 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749921.log.gz 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.160318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.878725.log 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160318.log.gz 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45404.log 2024-03-18T07:19:09.498 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625492.log.gz 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585015.log 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878725.log.gz 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144609.log 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.585015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145784.log 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585015.log.gz 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253325.log 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144609.log.gz 2024-03-18T07:19:09.499 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45404.log.gz 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349645.log 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145784.log.gz 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109233.log 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253325.log.gz 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349645.log.gz 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229996.log 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.873647.log 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109233.log.gz 2024-03-18T07:19:09.500 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735285.log 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229996.log.gz 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.873647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628409.log 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.873647.log.gz 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735285.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.735285.log.gz --verbose 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.244109.log 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599777.log 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628409.log.gz 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888530.log 2024-03-18T07:19:09.501 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244109.log.gz 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.599777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578847.log 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599777.log.gz 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284666.log 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.888530.log.gz 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195720.log 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578847.log.gz 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391905.log 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284666.log.gz 2024-03-18T07:19:09.502 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.195720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607663.log 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195720.log.gz 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.391905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215904.log 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391905.log.gz 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.607663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273348.log 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607663.log.gz 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.215904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215904.log.gz 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125310.log 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.273348.log: --verbose -- /var/log/ceph/ceph-client.admin.601164.log 2024-03-18T07:19:09.503 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273348.log.gz 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223278.log 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125310.log.gz 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886583.log 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601164.log.gz 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223086.log 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223278.log.gz 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49778.log 2024-03-18T07:19:09.504 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886583.log.gz 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650566.log 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223086.log.gz 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633640.log 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166606.log 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650566.log.gz 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305216.log 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633640.log.gz 2024-03-18T07:19:09.505 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49778.log.gz 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.166606.log: /var/log/ceph/ceph-client.admin.308294.log 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166606.log.gz 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657632.log 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305216.log.gz 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411403.log 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308294.log.gz 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347796.log 2024-03-18T07:19:09.506 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657632.log.gz 2024-03-18T07:19:09.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.411403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167002.log 2024-03-18T07:19:09.507 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411403.log.gz 2024-03-18T07:19:09.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762501.log 2024-03-18T07:19:09.507 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347796.log.gz 2024-03-18T07:19:09.507 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.167002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616276.log 2024-03-18T07:19:09.509 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167002.log.gz 2024-03-18T07:19:09.509 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662557.log 2024-03-18T07:19:09.509 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762501.log.gz 2024-03-18T07:19:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616276.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.616276.log.gz 2024-03-18T07:19:09.510 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.144797.log 2024-03-18T07:19:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.662557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240562.log 2024-03-18T07:19:09.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662557.log.gz 2024-03-18T07:19:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221427.log 2024-03-18T07:19:09.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144797.log.gz 2024-03-18T07:19:09.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240562.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.240562.log.gz -- 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.754724.log 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889950.log 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221427.log.gz 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768040.log 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754724.log.gz 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654645.log 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768040.log: gzip -5 --verbose -- 89.2% -- replaced with /var/log/ceph/ceph-client.admin.889950.log.gz 2024-03-18T07:19:09.548 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.736902.log 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768040.log.gz 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623575.log 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654645.log.gz 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214534.log 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736902.log.gz 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.623575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614638.log 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623575.log.gz 2024-03-18T07:19:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214534.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.660377.log 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.214534.log.gz 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.614638.log: -- /var/log/ceph/ceph-client.admin.332872.log 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614638.log.gz 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304558.log 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660377.log.gz 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889698.log 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332872.log.gz 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261058.log 2024-03-18T07:19:09.550 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304558.log.gz 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610267.log 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.261058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302084.log 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.889698.log.gz 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261058.log.gz 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170867.log 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610267.log: /var/log/ceph/ceph-client.admin.302084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302084.log.gz 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610267.log.gz 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260131.log 2024-03-18T07:19:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.170867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290562.log 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170867.log.gz 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358878.log 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290562.log: /var/log/ceph/ceph-client.admin.260131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290562.log.gz 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260131.log.gz 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284448.log 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740858.log 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358878.log.gz 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71615.log 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.740858.log: /var/log/ceph/ceph-client.admin.284448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.740858.log.gz 2024-03-18T07:19:09.552 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284448.log.gz 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309774.log 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123887.log 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319728.log 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309774.log: /var/log/ceph/ceph-client.admin.123887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123887.log.gz 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309774.log.gz 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340844.log 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48898.log 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319728.log.gz 2024-03-18T07:19:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736039.log 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340844.log: /var/log/ceph/ceph-client.admin.48898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340844.log.gz 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329676.log 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.71615.log.gz 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738143.log 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.877300.log 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736039.log.gz 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738143.log.gz 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48898.log.gz 2024-03-18T07:19:09.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.329676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291674.log 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329676.log.gz 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877300.log.gz 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122683.log 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252315.log 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291674.log: /var/log/ceph/ceph-client.admin.122683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122683.log.gz 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291674.log.gz 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766711.log 2024-03-18T07:19:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236816.log 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252315.log.gz 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605798.log 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766711.log: /var/log/ceph/ceph-client.admin.236816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236816.log.gz 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766711.log.gz 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156691.log 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171752.log 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156691.log.gz 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605798.log.gz 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302450.log 2024-03-18T07:19:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625971.log 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.171752.log: /var/log/ceph/ceph-client.admin.302450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302450.log.gz 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171752.log.gz 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232901.log 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628962.log 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232901.log.gz 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625971.log.gz 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256400.log 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226981.log 2024-03-18T07:19:09.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628962.log: /var/log/ceph/ceph-client.admin.256400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256400.log.gz 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628962.log.gz 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301048.log 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305203.log 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226981.log.gz 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223565.log 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301048.log: /var/log/ceph/ceph-client.admin.305203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305203.log.gz 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301048.log.gz 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197713.log 2024-03-18T07:19:09.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662105.log 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197713.log.gz 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223565.log.gz 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772431.log 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271201.log 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.662105.log: /var/log/ceph/ceph-client.admin.772431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772431.log.gz 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662105.log.gz 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321929.log 2024-03-18T07:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410262.log 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321929.log.gz 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271201.log.gz 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332424.log 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348062.log 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410262.log: /var/log/ceph/ceph-client.admin.332424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332424.log.gz 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410262.log.gz 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330626.log 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204138.log 2024-03-18T07:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348062.log.gz 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330626.log: /var/log/ceph/ceph-client.admin.204138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204138.log.gz 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330626.log.gz 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581823.log 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286605.log 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.581823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581823.log.gz 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887511.log 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645789.log 2024-03-18T07:19:09.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887511.log: /var/log/ceph/ceph-client.admin.286605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887511.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286605.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145986.log 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645789.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645789.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765674.log 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340831.log 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145986.log: /var/log/ceph/ceph-client.admin.765674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765674.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145986.log.gz 2024-03-18T07:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656330.log 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884149.log 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340831.log.gz 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.656330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626532.log 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656330.log.gz 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884149.log.gz 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232423.log 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215835.log 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232423.log.gz 2024-03-18T07:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626532.log.gz 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289224.log 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213138.log 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.215835.log: /var/log/ceph/ceph-client.admin.289224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289224.log.gz 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215835.log.gz 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247537.log 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.213138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610897.log 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213138.log.gz 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282739.log 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247537.log: /var/log/ceph/ceph-client.admin.610897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610897.log.gz 2024-03-18T07:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247537.log.gz 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889255.log 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641833.log 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282739.log.gz 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282563.log 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889255.log: /var/log/ceph/ceph-client.admin.641833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641833.log.gz 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348732.log 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.889255.log.gz 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156678.log 2024-03-18T07:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348732.log.gz 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282563.log.gz 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634876.log 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37747.log 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156678.log: /var/log/ceph/ceph-client.admin.634876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634876.log.gz 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156678.log.gz 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875103.log 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604656.log 2024-03-18T07:19:09.566 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875103.log.gz 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292648.log 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44435.log 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.292648.log: /var/log/ceph/ceph-client.admin.604656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292648.log.gz 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604656.log.gz 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874182.log 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289237.log 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.874182.log.gz 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602942.log 2024-03-18T07:19:09.567 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114639.log 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.289237.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44435.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289237.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605372.log 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114639.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602942.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765953.log 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735564.log 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605372.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.765953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765953.log.gz 2024-03-18T07:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127797.log 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299102.log 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.127797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127797.log.gz 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.735564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735564.log.gz 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659384.log 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144879.log 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.299102.log: /var/log/ceph/ceph-client.admin.659384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299102.log.gz 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659384.log.gz 2024-03-18T07:19:09.569 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234063.log 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270653.log 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234063.log.gz 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.144879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306934.log 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144879.log.gz 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151456.log 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.37747.log.gz 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306934.log.gz 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588844.log 2024-03-18T07:19:09.570 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270653.log.gz 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322874.log 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588844.log.gz 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192121.log 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151456.log.gz 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636747.log 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.192121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192121.log.gz 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170880.log 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322874.log.gz 2024-03-18T07:19:09.571 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110363.log 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.170880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170880.log.gz 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341036.log 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636747.log.gz 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125228.log 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341036.log.gz 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757387.log 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110363.log.gz 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354290.log 2024-03-18T07:19:09.572 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757387.log.gz 2024-03-18T07:19:09.573 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601177.log 2024-03-18T07:19:09.573 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125228.log.gz 2024-03-18T07:19:09.573 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220875.log 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601177.log.gz 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.354290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244096.log 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354290.log.gz 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276341.log 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244096.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244096.log.gz 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407446.log 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220875.log.gz 2024-03-18T07:19:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271908.log 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.407446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407446.log.gz 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311644.log 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276341.log.gz 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611092.log 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311644.log.gz 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213069.log 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271908.log.gz 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747107.log 2024-03-18T07:19:09.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.213069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213069.log.gz 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651199.log 0.0% 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.611092.log.gz 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125959.log 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651199.log.gz 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343324.log 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747107.log.gz 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229617.log 2024-03-18T07:19:09.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.343324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343324.log.gz 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125959.log.gz 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128692.log 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280763.log 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128692.log.gz 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650013.log 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229617.log.gz 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118262.log 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650013.log.gz 2024-03-18T07:19:09.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611618.log 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280763.log.gz 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585097.log 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611618.log.gz 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264873.log 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118262.log.gz 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221162.log 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.264873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264873.log.gz 2024-03-18T07:19:09.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.585097.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.585097.log.gz /var/log/ceph/ceph-client.admin.225232.log 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324612.log 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225232.log.gz 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300979.log 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221162.log.gz 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340485.log 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300979.log: /var/log/ceph/ceph-client.admin.324612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300979.log.gz 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.324612.log.gz /var/log/ceph/ceph-client.admin.651186.log 2024-03-18T07:19:09.616 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634067.log 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651186.log.gz 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.873731.log 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340485.log.gz 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305957.log 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.873731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.873731.log.gz 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.634067.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.111338.log 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.634067.log.gz 2024-03-18T07:19:09.617 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267280.log 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111338.log.gz 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747573.log 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305957.log.gz 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209432.log 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747573.log.gz 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310712.log 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267280.log.gz 2024-03-18T07:19:09.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239399.log 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.310712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310712.log.gz 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.209432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225795.log 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209432.log.gz 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280558.log 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225795.log.gz 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343841.log 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239399.log.gz 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259631.log 2024-03-18T07:19:09.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.343841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343841.log.gz 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276982.log 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280558.log.gz 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331047.log 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276982.log: 0.0%/var/log/ceph/ceph-client.admin.259631.log: -- replaced with /var/log/ceph/ceph-client.admin.276982.log.gz 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765940.log 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259631.log.gz 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326344.log 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.765940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765940.log.gz 2024-03-18T07:19:09.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112326.log 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331047.log.gz 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609567.log 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112326.log.gz 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.326344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270735.log 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326344.log.gz 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322490.log 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270735.log.gz 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47722.log 2024-03-18T07:19:09.621 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609567.log.gz 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279521.log 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47722.log: /var/log/ceph/ceph-client.admin.322490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191248.log 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322490.log.gz 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737955.log 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47722.log.gz 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191248.log.gz 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279521.log.gz 2024-03-18T07:19:09.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591163.log 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335011.log 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737955.log: /var/log/ceph/ceph-client.admin.591163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591163.log.gz 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737955.log.gz 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283900.log 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660600.log 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335011.log.gz 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406987.log 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283900.log: /var/log/ceph/ceph-client.admin.660600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660600.log.gz 2024-03-18T07:19:09.623 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283900.log.gz 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198259.log 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174304.log 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406987.log.gz 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142760.log 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198259.log: /var/log/ceph/ceph-client.admin.174304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174304.log.gz 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198259.log.gz 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651900.log 2024-03-18T07:19:09.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127269.log 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142760.log.gz 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732493.log 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651900.log: /var/log/ceph/ceph-client.admin.127269.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127269.log.gz 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.651900.log.gz 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320498.log 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591094.log 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732493.log.gz 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200993.log 2024-03-18T07:19:09.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320498.log: /var/log/ceph/ceph-client.admin.591094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591094.log.gz 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320498.log.gz 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234337.log 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248738.log 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200993.log.gz 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302888.log 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234337.log.gz 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49904.log 2024-03-18T07:19:09.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302888.log.gz 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248738.log.gz 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254182.log 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880453.log 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254182.log: /var/log/ceph/ceph-client.admin.49904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254182.log.gz 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755887.log 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247058.log 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151387.log 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880453.log.gz 2024-03-18T07:19:09.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247058.log.gz 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755887.log.gz 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642771.log 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250582.log 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.642771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642771.log.gz 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275392.log 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151387.log.gz 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637532.log 2024-03-18T07:19:09.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275392.log.gz 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.250582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317551.log 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250582.log.gz 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239194.log 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.317551.log: /var/log/ceph/ceph-client.admin.637532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317551.log.gz 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.637532.log.gz -5 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.259151.log 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49904.log.gz 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337582.log 2024-03-18T07:19:09.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239194.log: /var/log/ceph/ceph-client.admin.259151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259151.log.gz 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239194.log.gz 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159480.log 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279037.log 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337582.log.gz 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654727.log 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.159480.log: /var/log/ceph/ceph-client.admin.279037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279037.log.gz 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159480.log.gz 2024-03-18T07:19:09.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656154.log 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255922.log 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654727.log.gz 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160387.log 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.656154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656154.log.gz 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255922.log.gz 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593636.log 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193091.log 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.160387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160387.log.gz 2024-03-18T07:19:09.631 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319266.log 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593636.log: /var/log/ceph/ceph-client.admin.193091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193091.log.gz 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593636.log.gz 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301277.log 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604173.log 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319266.log.gz 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770430.log 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301277.log: /var/log/ceph/ceph-client.admin.604173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604173.log.gz 2024-03-18T07:19:09.632 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301277.log.gz 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360787.log 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166077.log 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770430.log.gz 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887945.log 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.360787.log: /var/log/ceph/ceph-client.admin.166077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166077.log.gz 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360787.log.gz 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321235.log 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233858.log 2024-03-18T07:19:09.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887945.log.gz 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244559.log 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321235.log: /var/log/ceph/ceph-client.admin.233858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233858.log.gz 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321235.log.gz 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260989.log 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408795.log 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244559.log.gz 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627869.log 2024-03-18T07:19:09.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.260989.log: /var/log/ceph/ceph-client.admin.408795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408795.log.gz 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260989.log.gz 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342444.log 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.627869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887220.log 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627869.log.gz 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638258.log 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342444.log: /var/log/ceph/ceph-client.admin.887220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887220.log.gz 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342444.log.gz 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763355.log 2024-03-18T07:19:09.635 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215456.log 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763355.log.gz 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638258.log.gz 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282084.log 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.215456.log: /var/log/ceph/ceph-client.admin.282084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215456.log.gz 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282084.log.gz 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42852.log 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287596.log 2024-03-18T07:19:09.636 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760412.log 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42852.log: /var/log/ceph/ceph-client.admin.287596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287596.log.gz 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384416.log 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42852.log.gz 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224305.log 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.760412.log: /var/log/ceph/ceph-client.admin.384416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384416.log.gz 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760412.log.gz 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624603.log 2024-03-18T07:19:09.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224305.log.gz 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313065.log 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882843.log 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624603.log.gz 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.313065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313065.log.gz 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117827.log 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266733.log 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882843.log: /var/log/ceph/ceph-client.admin.117827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117827.log.gz 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882843.log.gz 2024-03-18T07:19:09.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579272.log 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266733.log.gz 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255500.log 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147836.log 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579272.log: /var/log/ceph/ceph-client.admin.255500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255500.log.gz 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579272.log.gz 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226290.log 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147836.log.gz 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112339.log 2024-03-18T07:19:09.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640012.log 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226290.log: /var/log/ceph/ceph-client.admin.112339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112339.log.gz 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226290.log.gz 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232888.log 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640012.log.gz 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289716.log 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881357.log 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232888.log: /var/log/ceph/ceph-client.admin.289716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289716.log.gz 2024-03-18T07:19:09.640 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232888.log.gz 2024-03-18T07:19:09.641 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143961.log 2024-03-18T07:19:09.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.881357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881357.log.gz 2024-03-18T07:19:09.641 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336857.log 2024-03-18T07:19:09.642 INFO:teuthology.orchestra.run.smithi136.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-18T07:19:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626895.log 2024-03-18T07:19:09.690 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143961.log: /var/log/ceph/ceph-client.admin.336857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336857.log.gz 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143961.log.gz 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256886.log 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626895.log.gz 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310414.log 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738212.log 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.256886.log: /var/log/ceph/ceph-client.admin.310414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310414.log.gz 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256886.log.gz 2024-03-18T07:19:09.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351378.log 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738212.log.gz 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632159.log 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49143.log 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351378.log: /var/log/ceph/ceph-client.admin.632159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632159.log.gz 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351378.log.gz 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578387.log 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290178.log 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49143.log.gz 2024-03-18T07:19:09.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349443.log 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578387.log: /var/log/ceph/ceph-client.admin.290178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578387.log.gz 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290178.log.gz 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149657.log 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283011.log 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349443.log: /var/log/ceph/ceph-client.admin.149657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149657.log.gz 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349443.log.gz 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109302.log 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283011.log.gz 2024-03-18T07:19:09.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541579.log 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652546.log 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109302.log.gz 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162988.log 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.541579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.541579.log.gz 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652546.log.gz 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654279.log 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760343.log 2024-03-18T07:19:09.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.162988.log: /var/log/ceph/ceph-client.admin.654279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654279.log.gz 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162988.log.gz 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626245.log 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.760343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760343.log.gz 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207928.log 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48520.log 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626245.log: /var/log/ceph/ceph-client.admin.207928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207928.log.gz 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626245.log.gz 2024-03-18T07:19:09.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43230.log 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768551.log 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48520.log.gz 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558211.log 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.768551.log: /var/log/ceph/ceph-client.admin.43230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768551.log.gz 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405798.log 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636230.log 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.405798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405798.log.gz 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.558211.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43230.log.gz 2024-03-18T07:19:09.696 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306450.log 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558211.log.gz 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636230.log.gz 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338344.log 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.744199.log 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306450.log: /var/log/ceph/ceph-client.admin.338344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338344.log.gz 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306450.log.gz 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158050.log 2024-03-18T07:19:09.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.744199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.744199.log.gz 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594314.log 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212147.log 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158050.log.gz 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594314.log.gz 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205119.log 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197923.log 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212147.log: /var/log/ceph/ceph-client.admin.205119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205119.log.gz 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212147.log.gz 2024-03-18T07:19:09.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348267.log 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197923.log.gz 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732681.log 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157519.log 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348267.log: /var/log/ceph/ceph-client.admin.732681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732681.log.gz 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348267.log.gz 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637301.log 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.157519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157519.log.gz 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236337.log 2024-03-18T07:19:09.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645776.log 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637301.log: /var/log/ceph/ceph-client.admin.236337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236337.log.gz 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637301.log.gz 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243524.log 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645776.log.gz 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326413.log 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276708.log 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.326413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326413.log.gz 2024-03-18T07:19:09.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.243524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243524.log.gz 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162187.log 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276708.log.gz 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255853.log 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321737.log 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.162187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162187.log.gz 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255853.log.gz 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274062.log 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272188.log 2024-03-18T07:19:09.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274062.log.gz 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354716.log 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.272188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272188.log.gz 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.321737.log.gz 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754163.log 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347075.log 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175517.log 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754163.log.gz 2024-03-18T07:19:09.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.354716.log: /var/log/ceph/ceph-client.admin.347075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347075.log.gz 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.354716.log.gz -- 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.142502.log 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.175517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175517.log.gz 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352394.log 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292635.log 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142502.log: /var/log/ceph/ceph-client.admin.352394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352394.log.gz 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142502.log.gz 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214913.log 2024-03-18T07:19:09.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.292635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292635.log.gz 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661362.log 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721839.log 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214913.log.gz 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661362.log.gz 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208898.log 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239686.log 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.721839.log: /var/log/ceph/ceph-client.admin.208898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208898.log.gz 2024-03-18T07:19:09.704 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721839.log.gz 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284379.log 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239686.log.gz 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157601.log 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384403.log 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284379.log: /var/log/ceph/ceph-client.admin.157601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157601.log.gz 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284379.log.gz 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271132.log 2024-03-18T07:19:09.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.384403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384403.log.gz 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580650.log 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324247.log 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271132.log: /var/log/ceph/ceph-client.admin.580650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580650.log.gz 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271132.log.gz 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280074.log 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.324247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324247.log.gz 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409803.log 2024-03-18T07:19:09.706 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122300.log 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280074.log: /var/log/ceph/ceph-client.admin.409803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409803.log.gz 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280074.log.gz 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760425.log 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.122300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122300.log.gz 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591176.log 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167084.log 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.760425.log: /var/log/ceph/ceph-client.admin.591176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591176.log.gz 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760425.log.gz 2024-03-18T07:19:09.707 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313147.log 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.167084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167084.log.gz 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274711.log 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.761232.log 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.313147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313147.log.gz 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274711.log.gz 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318992.log 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592955.log 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.761232.log: /var/log/ceph/ceph-client.admin.318992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318992.log.gz 2024-03-18T07:19:09.708 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.761232.log.gz 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266323.log 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592955.log.gz 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635382.log 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887876.log 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266323.log: /var/log/ceph/ceph-client.admin.635382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635382.log.gz 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266323.log.gz 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719518.log 2024-03-18T07:19:09.709 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887876.log.gz 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49862.log 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650635.log 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719518.log: /var/log/ceph/ceph-client.admin.49862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719518.log.gz 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309060.log 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650635.log.gz 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756079.log 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340003.log 2024-03-18T07:19:09.710 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309060.log: /var/log/ceph/ceph-client.admin.756079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756079.log.gz 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309060.log.gz 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331567.log 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340003.log.gz 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160843.log 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342037.log 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331567.log: /var/log/ceph/ceph-client.admin.160843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160843.log.gz 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331567.log.gz 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160400.log 2024-03-18T07:19:09.711 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342037.log.gz 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721398.log 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268399.log 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.160400.log: /var/log/ceph/ceph-client.admin.721398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721398.log.gz 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160400.log.gz 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715839.log 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.268399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268399.log.gz 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222594.log 2024-03-18T07:19:09.712 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277630.log 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715839.log: /var/log/ceph/ceph-client.admin.222594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222594.log.gz 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715839.log.gz 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755600.log 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277630.log.gz 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284927.log 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206288.log 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755600.log: /var/log/ceph/ceph-client.admin.284927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284927.log.gz 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755600.log.gz 2024-03-18T07:19:09.713 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321043.log 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206288.log: 88.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206288.log.gz 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49862.log.gz 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351309.log 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298639.log 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351309.log.gz 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286892.log 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321043.log.gz 2024-03-18T07:19:09.714 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.298639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298639.log.gz 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334806.log 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286892.log.gz 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888751.log 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47848.log 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888751.log: /var/log/ceph/ceph-client.admin.334806.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.888751.log.gz 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249135.log 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334806.log.gz 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240849.log 2024-03-18T07:19:09.715 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249135.log.gz 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46747.log 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240849.log.gz 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732480.log 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607593.log 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732480.log.gz 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278401.log 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46747.log: /var/log/ceph/ceph-client.admin.607593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607593.log.gz 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47848.log.gz 2024-03-18T07:19:09.716 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407433.log 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392847.log 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.407433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.407433.log.gz 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46747.log.gz 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277699.log 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278401.log.gz 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150561.log 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277699.log.gz 2024-03-18T07:19:09.717 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748415.log 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.392847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633206.log 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392847.log.gz 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748415.log.gz 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628688.log 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150561.log.gz 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633206.log.gz 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146174.log 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718674.log 2024-03-18T07:19:09.718 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146174.log.gz 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226787.log 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628688.log.gz 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718674.log.gz 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126907.log 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226787.log.gz 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250153.log 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771709.log 2024-03-18T07:19:09.719 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.250153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250153.log.gz 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126907.log.gz 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279603.log 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258257.log 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279603.log.gz 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152128.log 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604438.log 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771709.log.gz 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.152128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152128.log.gz 2024-03-18T07:19:09.720 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.258257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253312.log 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258257.log.gz 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604438.log.gz 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285921.log 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254983.log 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285921.log.gz 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654022.log 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253312.log.gz 2024-03-18T07:19:09.721 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.254983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254983.log.gz 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344301.log 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734914.log 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654022.log: /var/log/ceph/ceph-client.admin.344301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344301.log.gz 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654022.log.gz 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642270.log 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589995.log 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.642270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642270.log.gz/var/log/ceph/ceph-client.admin.734914.log: 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734914.log.gz 2024-03-18T07:19:09.722 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644573.log 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306655.log 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589995.log: /var/log/ceph/ceph-client.admin.47938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589995.log.gz 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236829.log 0.0% 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.644573.log.gz 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306655.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306655.log.gz 2024-03-18T07:19:09.723 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615447.log 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353314.log 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236829.log.gz 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615447.log.gz 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190349.log 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285337.log 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.190349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190349.log.gz 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.353314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765226.log 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353314.log.gz 2024-03-18T07:19:09.724 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314206.log 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.765226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765226.log.gz 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771508.log 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.314206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285337.log.gz 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314206.log.gz 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335448.log 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771508.log.gz 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350358.log 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599420.log 2024-03-18T07:19:09.725 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350358.log.gz 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335448.log.gz 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151924.log 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.599420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599420.log.gz 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610695.log 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45224.log 2024-03-18T07:19:09.726 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610695.log.gz 2024-03-18T07:19:09.776 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151924.log.gz 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590290.log 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45224.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45224.log.gz 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614938.log 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111325.log 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.614938.log: /var/log/ceph/ceph-client.admin.590290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614938.log.gz 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757579.log 2024-03-18T07:19:09.777 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590290.log.gz 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111325.log.gz 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308581.log 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113678.log 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757579.log: /var/log/ceph/ceph-client.admin.308581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757579.log.gz 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308581.log.gz 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587591.log 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113678.log.gz 2024-03-18T07:19:09.778 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238920.log 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145055.log 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.587591.log: /var/log/ceph/ceph-client.admin.238920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238920.log.gz 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587591.log.gz 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337811.log 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145055.log.gz 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646342.log 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592526.log 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646342.log.gz 2024-03-18T07:19:09.779 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174386.log 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337811.log.gz 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.592526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592526.log.gz 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226512.log 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174386.log.gz 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234803.log 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636025.log 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234803.log: /var/log/ceph/ceph-client.admin.226512.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234803.log.gz 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269969.log 2024-03-18T07:19:09.780 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226512.log.gz 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636025.log.gz 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321056.log 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269969.log.gz 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890495.log 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312707.log 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890495.log: /var/log/ceph/ceph-client.admin.321056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192565.log 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.890495.log.gz 2024-03-18T07:19:09.781 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321056.log.gz 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.312707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312707.log.gz 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42756.log 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.192565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192565.log.gz 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223839.log 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334102.log 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223839.log.gz 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351929.log 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247550.log 2024-03-18T07:19:09.782 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351929.log.gz 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334102.log.gz 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754642.log 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593362.log 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247550.log.gz 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268386.log 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593362.log.gz 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754642.log.gz 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124793.log 2024-03-18T07:19:09.783 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408316.log 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.124793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124793.log.gz 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.268386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268386.log.gz 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214521.log 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748894.log 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214521.log.gz 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408316.log.gz 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259233.log 2024-03-18T07:19:09.784 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595794.log 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748894.log.gz 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42756.log.gz 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230539.log 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259233.log.gz 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279119.log 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595794.log.gz 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147092.log 2024-03-18T07:19:09.785 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230539.log: /var/log/ceph/ceph-client.admin.279119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230539.log.gz 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279119.log.gz 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227666.log 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126541.log 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147092.log.gz 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635751.log 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227666.log.gz 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654210.log 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126541.log.gz 2024-03-18T07:19:09.786 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.635751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629708.log 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635751.log.gz 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346641.log 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654210.log.gz 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587134.log 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629708.log.gz 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.346641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720037.log 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346641.log.gz 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.587134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748052.log 2024-03-18T07:19:09.787 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587134.log.gz 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748976.log 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720037.log.gz 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143678.log 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748052.log.gz 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43460.log 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748976.log.gz 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292566.log 2024-03-18T07:19:09.788 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304137.log 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143678.log.gz 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.877752.log 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.304137.log: /var/log/ceph/ceph-client.admin.292566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304137.log.gz 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292566.log.gz 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596600.log 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328710.log 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877752.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43460.log.gz 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877752.log.gz 2024-03-18T07:19:09.789 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.596600.log: /var/log/ceph/ceph-client.admin.196276.log 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596600.log.gz 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241123.log 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328710.log.gz 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659011.log 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.196276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196276.log.gz 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238266.log 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241123.log.gz 2024-03-18T07:19:09.790 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148943.log 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.659011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659011.log.gz 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885408.log 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238266.log.gz 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357315.log 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148943.log.gz 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657838.log 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885408.log.gz 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300764.log 2024-03-18T07:19:09.791 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.357315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357315.log.gz 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116925.log 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657838.log.gz 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44930.log 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300764.log.gz 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46579.log 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116925.log.gz 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338275.log 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736617.log 2024-03-18T07:19:09.792 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46579.log: /var/log/ceph/ceph-client.admin.338275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610201.log 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338275.log.gz 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46579.log.gz 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593920.log 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736617.log.gz 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880974.log 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610201.log.gz 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238933.log 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593920.log: /var/log/ceph/ceph-client.admin.880974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880974.log.gz 2024-03-18T07:19:09.793 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593920.log.gz 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347267.log 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.238933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594396.log 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238933.log.gz 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745659.log 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347267.log: /var/log/ceph/ceph-client.admin.594396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347267.log.gz 0.0% 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.594396.log.gz 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209824.log 2024-03-18T07:19:09.794 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338634.log 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.745659.log.gz 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733983.log 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.209824.log: /var/log/ceph/ceph-client.admin.338634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209824.log.gz 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338634.log.gz 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586616.log 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732938.log 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733983.log.gz 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.586616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227461.log 2024-03-18T07:19:09.795 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586616.log.gz 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762514.log 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732938.log.gz 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227461.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.227461.log.gz -- 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.753000.log 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308842.log 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753000.log: /var/log/ceph/ceph-client.admin.762514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753000.log.gz 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.593623.log -- replaced with /var/log/ceph/ceph-client.admin.762514.log.gz 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.796 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308842.log.gz 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732951.log 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659187.log 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732951.log.gz 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593623.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44930.log.gz 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879177.log 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593623.log.gz 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318140.log 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.879177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879177.log.gz 2024-03-18T07:19:09.797 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.659187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659187.log.gz 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752534.log 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392385.log 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752534.log.gz 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318140.log.gz 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731907.log 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.392385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762893.log 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392385.log.gz 2024-03-18T07:19:09.798 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145338.log 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731907.log: /var/log/ceph/ceph-client.admin.762893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762893.log.gz 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731907.log.gz 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316216.log 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110376.log 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145338.log.gz 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236747.log 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316216.log: /var/log/ceph/ceph-client.admin.110376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110376.log.gz 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316216.log.gz 2024-03-18T07:19:09.799 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721329.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738891.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236747.log.gz 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43060.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.721329.log: /var/log/ceph/ceph-client.admin.738891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738891.log.gz 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721329.log.gz 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272877.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159917.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876008.log 2024-03-18T07:19:09.800 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272877.log: /var/log/ceph/ceph-client.admin.159917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159917.log.gz 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272877.log.gz 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43754.log 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43060.log.gz 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876008.log.gz 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248303.log 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875925.log 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43754.log: /var/log/ceph/ceph-client.admin.248303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248303.log.gz 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632662.log 2024-03-18T07:19:09.801 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408385.log 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632662.log.gz 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875925.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43754.log.gz 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875925.log.gz 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344288.log 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408385.log.gz 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206112.log 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129164.log 2024-03-18T07:19:09.802 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206112.log: /var/log/ceph/ceph-client.admin.344288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206112.log.gz 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344288.log.gz 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599338.log 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762052.log 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129164.log.gz 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731409.log 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762052.log: /var/log/ceph/ceph-client.admin.599338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762052.log.gz 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599338.log.gz 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163057.log 2024-03-18T07:19:09.803 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731409.log.gz 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309252.log 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50072.log 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309252.log.gz 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.163057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163057.log.gz 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602258.log 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771792.log 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602258.log.gz 2024-03-18T07:19:09.804 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284187.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603886.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.284187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284187.log.gz 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287390.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771792.log.gz 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603886.log.gz 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752042.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49820.log: /var/log/ceph/ceph-client.admin.287390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576275.log 2024-03-18T07:19:09.805 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287390.log.gz 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752042.log.gz 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299603.log 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.50072.log.gz 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.576275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576275.log.gz 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43186.log 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889992.log 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43186.log: gzip/var/log/ceph/ceph-client.admin.299603.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.598715.log 2024-03-18T07:19:09.806 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299603.log.gz 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.889992.log.gz 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45056.log 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43186.log.gz 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609370.log 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598715.log: /var/log/ceph/ceph-client.admin.45056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598715.log.gz 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45056.log.gz 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46369.log 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326846.log 2024-03-18T07:19:09.807 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609370.log: /var/log/ceph/ceph-client.admin.46369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609370.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760842.log 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46369.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657647.log 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.326846.log: /var/log/ceph/ceph-client.admin.760842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760842.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326846.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615378.log 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657647.log.gz 2024-03-18T07:19:09.808 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45753.log 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641327.log 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615378.log: /var/log/ceph/ceph-client.0.45753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45753.log.gz 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615378.log.gz 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153965.log 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.641327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641327.log.gz 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757081.log 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345247.log 2024-03-18T07:19:09.809 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.153965.log: /var/log/ceph/ceph-client.admin.757081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153965.log.gz 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757081.log.gz 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647702.log 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658091.log 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.345247.log: /var/log/ceph/ceph-client.admin.647702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647702.log.gz 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345247.log.gz 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337505.log 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.658091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658091.log.gz 2024-03-18T07:19:09.810 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49438.log 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337505.log.gz 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355745.log 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356786.log 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49438.log: /var/log/ceph/ceph-client.admin.355745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355745.log.gz 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603503.log 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211478.log 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603503.log.gz 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.356786.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49438.log.gz 2024-03-18T07:19:09.811 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.356786.log.gz --verbose 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.339741.log 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211478.log.gz 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148468.log 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612772.log 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339741.log: /var/log/ceph/ceph-client.admin.148468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148468.log.gz 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339741.log.gz 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159467.log 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612772.log.gz 2024-03-18T07:19:09.812 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141242.log 2024-03-18T07:19:09.813 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125297.log 2024-03-18T07:19:09.813 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141242.log: /var/log/ceph/ceph-client.admin.159467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141242.log.gz 2024-03-18T07:19:09.813 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159467.log.gz 2024-03-18T07:19:09.827 INFO:teuthology.orchestra.run.smithi136.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-18T07:19:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638495.log 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125297.log.gz 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587949.log 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410249.log 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638495.log: /var/log/ceph/ceph-client.admin.587949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587949.log.gz 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638495.log.gz 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715399.log 2024-03-18T07:19:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410249.log.gz 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259700.log 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354647.log 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715399.log.gz 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259700.log.gz 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175599.log 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116460.log 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.175599.log: /var/log/ceph/ceph-client.admin.354647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175599.log.gz 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354647.log.gz 2024-03-18T07:19:09.857 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577341.log 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116460.log.gz 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313134.log 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330129.log 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577341.log: /var/log/ceph/ceph-client.admin.313134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313134.log.gz 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577341.log.gz 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756381.log 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330129.log.gz 2024-03-18T07:19:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268755.log 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740221.log 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756381.log: /var/log/ceph/ceph-client.admin.268755.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756381.log.gz -- replaced with /var/log/ceph/ceph-client.admin.268755.log.gz 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627337.log 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329194.log 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.740221.log: /var/log/ceph/ceph-client.admin.627337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627337.log.gz 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.740221.log.gz 2024-03-18T07:19:09.859 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.615007.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.329194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329194.log.gz 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650374.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302519.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650374.log: /var/log/ceph/ceph-client.admin.615007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650374.log.gz 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615007.log.gz 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272864.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302519.log.gz 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335963.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322203.log 2024-03-18T07:19:09.860 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272864.log: /var/log/ceph/ceph-client.admin.335963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335963.log.gz 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272864.log.gz 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315802.log 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322203.log.gz 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576907.log 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585084.log 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315802.log: /var/log/ceph/ceph-client.admin.576907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576907.log.gz 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315802.log.gz 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587578.log 2024-03-18T07:19:09.861 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.585084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585084.log.gz 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251019.log 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243004.log 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.587578.log: /var/log/ceph/ceph-client.admin.251019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251019.log.gz 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587578.log.gz 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266049.log 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.243004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243004.log.gz 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597980.log 2024-03-18T07:19:09.862 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576193.log 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597980.log: /var/log/ceph/ceph-client.admin.266049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597980.log.gz 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266049.log.gz 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314031.log 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.576193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576193.log.gz 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209445.log 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172353.log 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.314031.log: /var/log/ceph/ceph-client.admin.209445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314031.log.gz 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209445.log.gz 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581178.log 2024-03-18T07:19:09.863 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129151.log 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.581178.log: /var/log/ceph/ceph-client.admin.172353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581178.log.gz 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172353.log.gz 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153510.log 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129151.log.gz 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353714.log 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625287.log 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.153510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153510.log.gz 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.353714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353714.log.gz 2024-03-18T07:19:09.864 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252384.log 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246382.log 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.252384.log: /var/log/ceph/ceph-client.admin.625287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252384.log.gz 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625287.log.gz 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579203.log 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246382.log.gz 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283490.log 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637519.log 2024-03-18T07:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579203.log.gz 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579974.log 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283490.log.gz 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607676.log 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637519.log.gz 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.579974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644381.log 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579974.log.gz 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.607676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337538.log 2024-03-18T07:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607676.log.gz 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308102.log 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644381.log: /var/log/ceph/ceph-client.admin.337538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644381.log.gz 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337538.log.gz 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317107.log 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155281.log 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308102.log.gz 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.317107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201062.log 2024-03-18T07:19:09.867 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317107.log.gz 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285602.log 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155281.log.gz 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.201062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148290.log 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201062.log.gz 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123956.log 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285602.log.gz 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222607.log 2024-03-18T07:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148290.log.gz 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.123956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149131.log 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123956.log.gz 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47270.log 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222607.log: /var/log/ceph/ceph-client.admin.149131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222607.log.gz 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149131.log.gz 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746125.log 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325127.log 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345178.log 2024-03-18T07:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746125.log.gz 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649613.log 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325127.log.gz 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616358.log 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.345178.log: /var/log/ceph/ceph-client.admin.649613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649613.log.gz 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47270.log.gz 0.0% 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.345178.log.gz 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-18T07:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616358.log.gz 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228695.log 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-osd.3.log: -- /var/log/ceph/ceph-client.admin.148930.log 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240836.log 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228695.log.gz 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732095.log 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148930.log.gz 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600292.log 2024-03-18T07:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240836.log: /var/log/ceph/ceph-client.admin.732095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732095.log.gz 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240836.log.gz 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272659.log 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45098.log 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.600292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600292.log.gz 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478795.log 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272659.log: /var/log/ceph/ceph-client.admin.45098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272659.log.gz 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291317.log 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45098.log.gz 2024-03-18T07:19:09.872 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266802.log 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.478795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.478795.log.gz 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771320.log 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291317.log: /var/log/ceph/ceph-client.admin.266802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266802.log.gz 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291317.log.gz 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613235.log 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884233.log 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771320.log.gz 2024-03-18T07:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612759.log 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613235.log: /var/log/ceph/ceph-client.admin.884233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884233.log.gz 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613235.log.gz 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156184.log 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299115.log 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612759.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.612759.log.gz /var/log/ceph/ceph-client.admin.265132.log 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156184.log: /var/log/ceph/ceph-client.admin.299115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299115.log.gz 2024-03-18T07:19:09.874 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156184.log.gz 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759491.log 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328628.log 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265132.log.gz 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112765.log 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759491.log: /var/log/ceph/ceph-client.admin.328628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328628.log.gz 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759491.log.gz 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884610.log 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.112765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112765.log.gz 2024-03-18T07:19:09.875 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383931.log 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274990.log 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220957.log 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884610.log.gz 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274990.log: /var/log/ceph/ceph-client.admin.383931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274990.log.gz 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383931.log.gz 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199623.log 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257365.log 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220957.log: /var/log/ceph/ceph-client.admin.199623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220957.log.gz 2024-03-18T07:19:09.876 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199623.log.gz 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275474.log 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257365.log.gz 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756885.log 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333307.log 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275474.log.gz 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277712.log 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756885.log.gz 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335517.log 2024-03-18T07:19:09.877 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277712.log.gz 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333307.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333307.log.gz 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.218602.log 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335517.log.gz 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337046.log 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.218602.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218602.log.gz 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.890328.log 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625766.log 2024-03-18T07:19:09.878 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337046.log.gz 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890328.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.890328.log.gz 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656072.log 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646882.log 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625766.log.gz 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224822.log 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.656072.log: /var/log/ceph/ceph-client.admin.646882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646882.log.gz 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656072.log.gz 2024-03-18T07:19:09.879 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211686.log 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717148.log 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224822.log.gz 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875473.log 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211686.log.gz 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717148.log.gz 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624137.log 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49270.log 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875473.log.gzgzip 2024-03-18T07:19:09.880 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.211465.log 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624137.log: /var/log/ceph/ceph-client.admin.49270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624137.log.gz 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384855.log 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301801.log 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211465.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49270.log.gz 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211465.log.gz 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.384855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384855.log.gz 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263583.log 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301592.log 2024-03-18T07:19:09.881 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301801.log.gz 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.263583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263583.log.gz 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199554.log 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629254.log 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301592.log.gz 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.199554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752316.log 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199554.log.gz 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208687.log 2024-03-18T07:19:09.882 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629254.log: /var/log/ceph/ceph-client.admin.752316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752316.log.gz 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629254.log.gz 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240083.log 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282002.log 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208687.log.gz 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328903.log 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240083.log.gz 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291330.log 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282002.log: /var/log/ceph/ceph-client.admin.328903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328903.log.gz 2024-03-18T07:19:09.883 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282002.log.gz 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718605.log 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291330.log.gz 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736338.log 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197252.log 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718605.log.gz 2024-03-18T07:19:09.884 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325993.log 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736338.log.gz 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628148.log 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197252.log.gz 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598049.log 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325993.log.gz 2024-03-18T07:19:09.916 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628148.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.141255.log 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.628148.log.gz 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.649163.log 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598049.log.gz 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267691.log 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141255.log.gz 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640535.log 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.649163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649163.log.gz 2024-03-18T07:19:09.917 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162174.log 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267691.log.gz 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48772.log 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640535.log.gz 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218209.log 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.162174.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.406547.log 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.218209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218209.log.gz 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162174.log.gz 2024-03-18T07:19:09.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882289.log 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509886.log 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406547.log.gz 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638770.log 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882289.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48772.log.gz 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111256.log 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882289.log.gz 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638770.log.gz/var/log/ceph/ceph-client.admin.509886.log: 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525111.log 2024-03-18T07:19:09.919 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.509886.log.gz 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327734.log 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111256.log.gz 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44846.log 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.525111.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.525111.log.gz 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329689.log 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308376.log 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327734.log.gz 2024-03-18T07:19:09.920 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44846.log: /var/log/ceph/ceph-client.admin.329689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329689.log.gz 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748065.log 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217300.log 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308376.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44846.log.gz 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308376.log.gz 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146632.log 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748065.log.gz 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44636.log 2024-03-18T07:19:09.921 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.217300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217300.log.gz 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204446.log 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146632.log.gz 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239673.log 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235660.log 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.204446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204446.log.gz 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44636.log.gz 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245499.log 2024-03-18T07:19:09.922 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239673.log.gz 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602271.log 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235660.log.gz 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129548.log 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245499.log.gz 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47764.log 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602271.log.gz 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211207.log 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277261.log 2024-03-18T07:19:09.923 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129548.log.gz 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211207.log: /var/log/ceph/ceph-client.admin.47764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211207.log.gz 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202280.log 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327210.log 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277261.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47764.log.gz 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277261.log.gz 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427992.log 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202280.log.gz 2024-03-18T07:19:09.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770887.log 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.427992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.427992.log.gz 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232615.log 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327210.log.gz 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632460.log 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770887.log: /var/log/ceph/ceph-client.admin.232615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232615.log.gz 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770887.log.gz 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266062.log 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109315.log 2024-03-18T07:19:09.925 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632460.log.gz 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612577.log 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266062.log: /var/log/ceph/ceph-client.admin.109315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109315.log.gz 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266062.log.gz 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318582.log 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237774.log 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612577.log.gz 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320567.log 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318582.log.gz 2024-03-18T07:19:09.926 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588018.log 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237774.log.gz 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320567.log.gz 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588926.log 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279795.log 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588018.log.gz 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290850.log 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279795.log: /var/log/ceph/ceph-client.admin.588926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279795.log.gz 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.588926.log.gz /var/log/ceph/ceph-client.admin.250595.log 2024-03-18T07:19:09.927 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290850.log.gz 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641846.log 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257798.log 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.641846.log: /var/log/ceph/ceph-client.admin.250595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641846.log.gz 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250595.log.gz 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196722.log 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257798.log.gz 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745645.log 2024-03-18T07:19:09.928 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44678.log 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.745645.log.gz 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.196722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196722.log.gz 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599407.log 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734374.log 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.599407.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44678.log.gz 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599407.log.gz 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750618.log 2024-03-18T07:19:09.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227954.log 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734374.log.gz 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410180.log 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750618.log.gz 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227954.log.gz 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143232.log 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629446.log 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410180.log.gz 2024-03-18T07:19:09.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350276.log 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143232.log: /var/log/ceph/ceph-client.admin.629446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629446.log.gz 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143232.log.gz 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331554.log 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337604.log 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350276.log.gz 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156197.log 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.331554.log: /var/log/ceph/ceph-client.admin.337604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337604.log.gz 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331554.log.gz 2024-03-18T07:19:09.931 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750126.log 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408603.log 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156197.log.gz 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737753.log 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750126.log: /var/log/ceph/ceph-client.admin.408603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408603.log.gz 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750126.log.gz 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166593.log 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48436.log 2024-03-18T07:19:09.932 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.737753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737753.log.gz 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.166593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610311.log 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166593.log.gz 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765144.log 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410461.log 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610311.log: /var/log/ceph/ceph-client.admin.765144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765144.log.gz 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610311.log.gz 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613436.log 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48436.log.gz 2024-03-18T07:19:09.933 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748484.log 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.410461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410461.log.gz 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228228.log 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613436.log: /var/log/ceph/ceph-client.admin.748484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748484.log.gz 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613436.log.gz 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762432.log 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751097.log 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.228228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228228.log.gz 2024-03-18T07:19:09.934 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409978.log 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762432.log: /var/log/ceph/ceph-client.admin.751097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751097.log.gz 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762432.log.gz 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.652175.log 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758520.log 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409978.log.gz 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327926.log 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.652175.log: /var/log/ceph/ceph-client.admin.758520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758520.log.gz 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.652175.log.gz 2024-03-18T07:19:09.935 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150932.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769964.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327926.log.gz 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339377.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150932.log: /var/log/ceph/ceph-client.admin.769964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769964.log.gz 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150932.log.gz 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236542.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111760.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272393.log 2024-03-18T07:19:09.936 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339377.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236542.log: /var/log/ceph/ceph-client.admin.111760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111760.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236542.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234816.log 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350909.log 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272393.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43274.log 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234816.log: /var/log/ceph/ceph-client.admin.350909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350909.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234816.log.gz 2024-03-18T07:19:09.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610399.log 2024-03-18T07:19:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879108.log 2024-03-18T07:19:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634081.log 2024-03-18T07:19:09.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610399.log: /var/log/ceph/ceph-client.admin.879108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879108.log.gz 2024-03-18T07:19:09.938 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610399.log.gz 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890454.log 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.634081.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.584753.log 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634081.log.gz 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.890454.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.633627.log 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43274.log.gz 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584753.log.gz 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659933.log 2024-03-18T07:19:09.968 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.890454.log.gz 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126254.log 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.633627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633627.log.gz 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623657.log 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.659933.log: /var/log/ceph/ceph-client.admin.126254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126254.log.gz 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659933.log.gz 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249592.log 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299981.log 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.623657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623657.log.gz 2024-03-18T07:19:09.969 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191891.log 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249592.log.gz 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.299981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879190.log 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299981.log.gz 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722252.log 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191891.log.gz 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747586.log 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.879190.log: /var/log/ceph/ceph-client.admin.722252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722252.log.gz 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879190.log.gz 2024-03-18T07:19:09.970 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625574.log 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736026.log 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747586.log.gz 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280571.log 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625574.log: /var/log/ceph/ceph-client.admin.736026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736026.log.gz 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625574.log.gz 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345733.log 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337329.log 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280571.log.gz 2024-03-18T07:19:09.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594383.log 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.345733.log: /var/log/ceph/ceph-client.admin.337329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337329.log.gz 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345733.log.gz 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301306.log 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47125.log 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594383.log.gz 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610333.log 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301306.log: /var/log/ceph/ceph-client.admin.47125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301306.log.gz 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240357.log 2024-03-18T07:19:09.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644949.log 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610333.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47125.log.gz 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610333.log.gz 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.240357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317620.log 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240357.log.gz 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772243.log 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644949.log.gz 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717660.log 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.317620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317620.log.gz 2024-03-18T07:19:09.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.772243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409237.log 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772243.log.gz 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290837.log 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717660.log: /var/log/ceph/ceph-client.admin.409237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409237.log.gz 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717660.log.gz 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278667.log 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44434.log 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290837.log.gz 2024-03-18T07:19:09.974 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.656141.log 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278667.log.gz 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198651.log 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638465.log 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.656141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.656141.log.gz 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117382.log 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198651.log: /var/log/ceph/ceph-client.admin.638465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638465.log.gz 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198651.log.gz 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298626.log 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44434.log.gz 2024-03-18T07:19:09.975 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117369.log 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117382.log: /var/log/ceph/ceph-client.admin.298626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298626.log.gz 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117382.log.gz 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595712.log 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281050.log 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117369.log.gz 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278114.log 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595712.log.gz 2024-03-18T07:19:09.976 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237295.log 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.281050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281050.log.gz 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.771521.log 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278114.log.gz 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201274.log 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237295.log.gz 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43418.log 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.771521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.771521.log.gz 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.201274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344480.log 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201274.log.gz 2024-03-18T07:19:09.977 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324178.log 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43418.log: /var/log/ceph/ceph-client.admin.344480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344480.log.gz 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749852.log 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.324178.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.324178.log.gz -5 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.345746.log 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721411.log 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43418.log.gz 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749852.log: /var/log/ceph/ceph-client.admin.345746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345746.log.gz 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749852.log.gz 2024-03-18T07:19:09.978 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335080.log 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.721411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291042.log 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721411.log.gz 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267198.log 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335080.log.gz 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298557.log 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291042.log.gz 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886570.log 2024-03-18T07:19:09.979 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267198.log.gz 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.298557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299033.log 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298557.log.gz 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650912.log 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886570.log.gz 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.299033.log: /var/log/ceph/ceph-client.admin.162619.log 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299033.log.gz 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352381.log 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650912.log: /var/log/ceph/ceph-client.admin.162619.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650912.log.gz 2024-03-18T07:19:09.980 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162619.log.gz 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319074.log 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586686.log 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.352381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352381.log.gz 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290165.log 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319074.log.gz 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.586686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586686.log.gz 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162105.log 2024-03-18T07:19:09.981 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290165.log.gz 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600724.log 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.162105.log: /var/log/ceph/ceph-client.admin.600724.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600724.log.gz 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162105.log.gz 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.48730.log 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260062.log 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338895.log 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.260062.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.751768.log 2024-03-18T07:19:09.982 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260062.log.gz 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355728.log 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48730.log.gz 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.751768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751768.log.gz 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.338895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338895.log.gz 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382333.log 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409721.log 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.355728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355728.log.gz 2024-03-18T07:19:09.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752055.log 2024-03-18T07:19:09.984 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382333.log.gz 2024-03-18T07:19:09.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167550.log 2024-03-18T07:19:09.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409721.log.gz 2024-03-18T07:19:09.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392180.log 2024-03-18T07:19:09.984 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752055.log.gz 2024-03-18T07:19:10.011 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.167550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247824.log 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167550.log.gz 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.392180.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44096.log 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392180.log.gz 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247824.log.gz 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736889.log 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279106.log 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325045.log 2024-03-18T07:19:10.012 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736889.log: /var/log/ceph/ceph-client.admin.279106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279106.log.gz 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736889.log.gz 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49988.log 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731825.log 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325045.log: /var/log/ceph/ceph-client.admin.49988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44096.log.gz 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325045.log.gz 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328436.log 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49988.log.gz 2024-03-18T07:19:10.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145068.log 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731825.log.gz 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234255.log 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328436.log.gz 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193729.log 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145068.log.gz 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628340.log 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234255.log.gz 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116025.log 2024-03-18T07:19:10.014 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193729.log.gz 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156115.log 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628340.log.gz 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270722.log 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116025.log.gz 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320772.log 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156115.log.gz 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116038.log 2024-03-18T07:19:10.015 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270722.log.gz 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213151.log 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320772.log.gz 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653833.log 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116038.log.gz 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879560.log 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.653833.log: /var/log/ceph/ceph-client.admin.213151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653833.log.gz 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213151.log.gz 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.642784.log 2024-03-18T07:19:10.016 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196804.log 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.879560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879560.log.gz 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174901.log 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.642784.log: /var/log/ceph/ceph-client.admin.196804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196804.log.gz 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.642784.log.gz 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250513.log 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581191.log 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174901.log.gz 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750810.log 2024-03-18T07:19:10.017 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.581191.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581191.log.gz 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.250513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250513.log.gz 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730884.log 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750810.log.gz 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392929.log 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.748689.log 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.730884.log: /var/log/ceph/ceph-client.admin.392929.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392929.log.gz 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730884.log.gz 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196358.log 2024-03-18T07:19:10.018 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.748689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.748689.log.gz 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116473.log 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116473.log.gz 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.196358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191679.log 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.47560.log: -- replaced with /var/log/ceph/ceph-client.admin.196358.log.gz 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886963.log 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191679.log.gz 2024-03-18T07:19:10.019 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226003.log 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886963.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886963.log.gz 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243606.log 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226003.log.gz 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212216.log 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655162.log 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212216.log.gz 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.243606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602737.log 2024-03-18T07:19:10.020 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243606.log.gz 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655162.log.gz 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885202.log 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604643.log 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885202.log.gz 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237787.log 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602737.log.gz 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604643.log.gz 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239412.log 2024-03-18T07:19:10.021 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598702.log 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239412.log.gz 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237787.log.gz 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598985.log 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739159.log 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598985.log.gz 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236555.log 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.598702.log.gz /var/log/ceph/ceph-client.admin.121822.log 2024-03-18T07:19:10.022 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.236555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747791.log 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236555.log.gz 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739159.log: /var/log/ceph/ceph-client.admin.121822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121822.log.gz 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739159.log.gz 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772444.log 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.747791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747791.log.gz 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581810.log 2024-03-18T07:19:10.023 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755190.log 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.772444.log: /var/log/ceph/ceph-client.admin.581810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581810.log.gz 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.772444.log.gz -5 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.165706.log 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755190.log.gz 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258244.log 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593444.log 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.165706.log: /var/log/ceph/ceph-client.admin.258244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258244.log.gz 2024-03-18T07:19:10.024 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165706.log.gz 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640453.log 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593444.log.gz 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579285.log 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628893.log 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640453.log: /var/log/ceph/ceph-client.admin.579285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579285.log.gz 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640453.log.gz 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257283.log 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628893.log.gz 2024-03-18T07:19:10.025 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322477.log 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46411.log 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257283.log: /var/log/ceph/ceph-client.admin.322477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322477.log.gz 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257283.log.gz 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171374.log 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348745.log 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46411.log.gz 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307897.log 2024-03-18T07:19:10.026 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.171374.log: /var/log/ceph/ceph-client.admin.348745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348745.log.gz 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171374.log.gz 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220396.log 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307897.log.gz 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721118.log 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341731.log 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220396.log: /var/log/ceph/ceph-client.admin.721118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721118.log.gz 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220396.log.gz 2024-03-18T07:19:10.027 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647771.log 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253747.log 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341731.log: /var/log/ceph/ceph-client.admin.647771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647771.log.gz 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341731.log.gz 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110821.log 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253747.log.gz 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406534.log 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280489.log 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110821.log: /var/log/ceph/ceph-client.admin.406534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406534.log.gz 2024-03-18T07:19:10.028 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110821.log.gz 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283982.log 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280489.log.gz 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238646.log 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626519.log 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283982.log: /var/log/ceph/ceph-client.admin.238646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238646.log.gz 2024-03-18T07:19:10.029 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283982.log.gz 2024-03-18T07:19:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716788.log 2024-03-18T07:19:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393892.log 2024-03-18T07:19:10.071 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626519.log: /var/log/ceph/ceph-client.admin.716788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716788.log.gz 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626519.log.gz 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603955.log 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.393892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393892.log.gz 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758589.log 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880987.log 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603955.log: /var/log/ceph/ceph-client.admin.758589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758589.log.gz 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603955.log.gz 2024-03-18T07:19:10.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218140.log 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880987.log.gz 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273993.log 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269303.log 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.218140.log: /var/log/ceph/ceph-client.admin.273993.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273993.log.gz 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218140.log.gz 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612564.log 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269303.log.gz 2024-03-18T07:19:10.073 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257352.log 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382056.log 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257352.log.gz 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291883.log 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612564.log.gz 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382056.log.gz 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202898.log 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720913.log 2024-03-18T07:19:10.074 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202898.log.gz 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291883.log.gz 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392193.log 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720913.log.gz 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212608.log 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888919.log 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.212608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212608.log.gz 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.392193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220465.log 2024-03-18T07:19:10.075 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392193.log.gz 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.888919.log.gzgzip 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.302097.log 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220465.log.gz 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44888.log 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581619.log 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44888.log: /var/log/ceph/ceph-client.admin.302097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350827.log 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302097.log.gz/var/log/ceph/ceph-client.admin.581619.log: 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581619.log.gz 2024-03-18T07:19:10.076 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753274.log 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.350827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350827.log.gz 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279808.log 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156387.log 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.279808.log: /var/log/ceph/ceph-client.admin.753274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279808.log.gz 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233776.log 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753274.log.gz 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156387.log.gz 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261071.log 2024-03-18T07:19:10.077 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233776.log.gz 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276272.log 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289703.log 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276272.log.gz 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.261071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233093.log 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.289703.log: -- replaced with /var/log/ceph/ceph-client.admin.261071.log.gz 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289703.log.gz 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46663.log 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233093.log.gz 2024-03-18T07:19:10.078 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715317.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616818.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715317.log.gz 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257811.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616818.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616818.log.gz 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227474.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165637.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227474.log: /var/log/ceph/ceph-client.admin.257811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227474.log.gz 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659946.log 2024-03-18T07:19:10.079 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257811.log.gz 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.165637.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.165637.log.gz 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286618.log 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339172.log 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286618.log: /var/log/ceph/ceph-client.admin.659946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286618.log.gz 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270256.log 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659946.log.gz 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339172.log.gz 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758162.log 2024-03-18T07:19:10.080 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44888.log.gz 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270448.log 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.758162.log: /var/log/ceph/ceph-client.admin.270256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758162.log.gz 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.149200.log 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.270256.log.gz 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270448.log.gz 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161660.log 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754916.log 2024-03-18T07:19:10.081 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.161660.log: /var/log/ceph/ceph-client.admin.149200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161660.log.gz 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46663.log.gz 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149200.log.gz 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345262.log 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754916.log.gz 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216839.log 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45140.log 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.345262.log: /var/log/ceph/ceph-client.admin.216839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216839.log.gz 2024-03-18T07:19:10.082 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345262.log.gz 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661626.log 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640972.log 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45140.log.gz 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.661626.log: -- /var/log/ceph/ceph-client.admin.596669.log 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661626.log.gz 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640972.log.gz 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126601.log 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319975.log 2024-03-18T07:19:10.083 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.596669.log: /var/log/ceph/ceph-client.admin.126601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126601.log.gz 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596669.log.gz 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319975.log.gz 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304124.log 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309692.log 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.304124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304124.log.gz 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351942.log 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601618.log 2024-03-18T07:19:10.084 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309692.log: /var/log/ceph/ceph-client.admin.351942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351942.log.gz 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233297.log 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309692.log.gz 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601618.log.gz 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256873.log 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233297.log.gz 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662365.log 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.879642.log 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.662365.log: /var/log/ceph/ceph-client.admin.256873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662365.log.gz 2024-03-18T07:19:10.085 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889782.log 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256873.log.gz 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.879642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.879642.log.gz 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640959.log 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270174.log 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640959.log: /var/log/ceph/ceph-client.admin.889782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640959.log.gz 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256318.log 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.270174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270174.log.gz 2024-03-18T07:19:10.086 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158408.log 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.256318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256318.log.gz 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.889782.log.gz 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653820.log 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334601.log 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.158408.log: /var/log/ceph/ceph-client.admin.653820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653820.log.gz 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158408.log.gz 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755874.log 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334601.log.gz 2024-03-18T07:19:10.087 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224544.log 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110294.log 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755874.log: /var/log/ceph/ceph-client.admin.224544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224544.log.gz 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755874.log.gz 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884694.log 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.110294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110294.log.gz 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746543.log 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45182.log 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884694.log.gz 2024-03-18T07:19:10.088 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226304.log 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746543.log.gz 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310205.log 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584567.log 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226304.log.gz 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45182.log: gzip/var/log/ceph/ceph-client.admin.310205.log: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310205.log.gz 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose --/var/log/ceph/ceph-client.admin.584567.log: /var/log/ceph/ceph-client.admin.298189.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584567.log.gz 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603229.log 2024-03-18T07:19:10.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.298189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.298189.log.gz 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45182.log.gz 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655715.log 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603229.log.gz 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603421.log 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655715.log.gz 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330312.log 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603421.log.gz 2024-03-18T07:19:10.090 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154840.log 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330312.log.gz 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225301.log 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154840.log.gz 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152115.log 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225301.log.gz 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589365.log 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.152115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152115.log.gz 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251918.log 2024-03-18T07:19:10.091 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589365.log.gz 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115578.log 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251918.log.gz 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886143.log 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.115578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115578.log.gz 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584430.log 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886143.log.gz 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637837.log 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.584430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584430.log.gz 2024-03-18T07:19:10.092 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336870.log 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.637837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637837.log.gz 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219133.log 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.336870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336870.log.gz 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733345.log 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219133.log.gz 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141173.log 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.733345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733345.log.gz 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383862.log 2024-03-18T07:19:10.093 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141173.log.gz 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155669.log 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.383862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383862.log.gz 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411199.log 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155669.log.gz 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609848.log 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.411199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411199.log.gz 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604369.log 2024-03-18T07:19:10.094 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609848.log.gz 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219963.log 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.604369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604369.log.gz 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.760773.log 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219963.log.gz 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226774.log 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.760773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.760773.log.gz 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306642.log 2024-03-18T07:19:10.095 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226774.log.gz 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46831.log 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306642.log.gz 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129826.log 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225713.log 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.129826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129826.log.gz 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348528.log 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225713.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46831.log.gz 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225713.log.gz 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352877.log 2024-03-18T07:19:10.096 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348528.log.gz 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715826.log 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.352877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352877.log.gz 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660809.log 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.715826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715826.log.gz 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151469.log 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660809.log.gz 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734456.log 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151469.log.gz 2024-03-18T07:19:10.097 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305888.log 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734456.log.gz 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759982.log 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305888.log.gz 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140731.log 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759982.log.gz 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268837.log 2024-03-18T07:19:10.098 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.140731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.140731.log.gz 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301264.log 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.268837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268837.log.gz 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127810.log 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301264.log.gz 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643663.log 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.127810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127810.log.gz 2024-03-18T07:19:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224031.log 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643663.log.gz 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245417.log 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224031.log.gz 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593838.log 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245417.log.gz 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643139.log 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593838.log.gz 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613944.log 2024-03-18T07:19:10.162 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643139.log.gz 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286331.log 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613944.log.gz 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241768.log 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286331.log.gz 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625013.log 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241768.log.gz 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598903.log 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625013.log.gz 2024-03-18T07:19:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890202.log 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598903.log.gz 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249661.log 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271214.log 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.890202.log.gz 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249661.log.gz 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125770.log 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271214.log.gz 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638189.log 2024-03-18T07:19:10.164 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.125770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125770.log.gz 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154771.log 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.638189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638189.log.gz 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356773.log 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154771.log.gz 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646895.log 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.356773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356773.log.gz 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219064.log 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646895.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646895.log.gz 2024-03-18T07:19:10.165 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734443.log 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219064.log.gz 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880001.log 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734443.log.gz 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756655.log 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880001.log.gz 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148208.log 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756655.log.gz 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151842.log 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148208.log.gz 2024-03-18T07:19:10.166 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889381.log 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.151842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151842.log.gz 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278183.log 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320057.log 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.889381.log.gz 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278183.log.gz 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767339.log 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320057.log.gz 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408864.log 2024-03-18T07:19:10.167 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767339.log.gz 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334614.log 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408864.log.gz 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753013.log 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334614.log.gz 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738686.log 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753013.log.gz 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719163.log 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738686.log.gz 2024-03-18T07:19:10.168 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316744.log 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719163.log.gz 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883245.log 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316744.log.gz 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890286.log 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883245.log.gz 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628135.log 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890286.log: gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.890286.log.gz 2024-03-18T07:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.628135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628135.log.gz 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640094.log 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346181.log 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640094.log.gz 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr: 90.2% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767140.log 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219146.log 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767140.log: 0.0%/var/log/ceph/ceph-client.admin.346181.log: -- replaced with /var/log/ceph/ceph-client.admin.767140.log.gz 2024-03-18T07:19:10.170 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211276.log 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346181.log.gz 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219146.log.gz 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.211276.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211276.log.gz 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.616548.log 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210367.log 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616548.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616548.log.gz 2024-03-18T07:19:10.171 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876848.log 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.210367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210367.log.gz 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237513.log 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876848.log.gz 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305970.log 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237513.log.gz 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357328.log 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305970.log.gz 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167071.log 2024-03-18T07:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.357328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357328.log.gz 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127338.log 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.167071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167071.log.gz 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160761.log 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.127338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127338.log.gz 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288319.log 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.160761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160761.log.gz 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883314.log 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.288319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288319.log.gz 2024-03-18T07:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199636.log 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883314.log.gz 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578834.log 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.199636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199636.log.gz 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233379.log 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578834.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578834.log.gz 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339934.log 2024-03-18T07:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233379.log.gz 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265335.log 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339934.log.gz 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166524.log 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265335.log.gz 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625300.log 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.166524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.166524.log.gz 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334184.log 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.625300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625300.log.gz 2024-03-18T07:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235742.log 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334184.log.gz 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876478.log 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235742.log.gz 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287377.log 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876478.log.gz 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577423.log 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.287377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287377.log.gz 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113217.log 2024-03-18T07:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577423.log.gz 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598444.log 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113217.log.gz 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118193.log 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598444.log.gz 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755121.log 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.118193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118193.log.gz 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260144.log 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755121.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755121.log.gz 2024-03-18T07:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148669.log 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.260144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260144.log.gz 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157968.log 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148669.log.gz 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237705.log 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.157968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157968.log.gz 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890545.log 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237705.log.gz 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244490.log 2024-03-18T07:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322011.log 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.890545.log.gz 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244490.log.gz 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599859.log 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322011.log.gz 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243017.log 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.599859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599859.log.gz 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305490.log 2024-03-18T07:19:10.179 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191904.log 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305490.log.gz 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.243017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243017.log.gz 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654009.log 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655633.log 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191904.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249866.log 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.191904.log.gz 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654009.log: /var/log/ceph/ceph-client.admin.655633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655633.log.gz 2024-03-18T07:19:10.180 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654009.log.gz 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285419.log 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.285419.log: --/var/log/ceph/ceph-client.admin.249866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285419.log.gz 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.649176.log 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249866.log.gz 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590741.log 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.649176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.649176.log.gz 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128679.log 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391987.log 2024-03-18T07:19:10.181 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128679.log: 0.0%/var/log/ceph/ceph-client.admin.590741.log: -- replaced with /var/log/ceph/ceph-client.admin.128679.log.gz 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751837.log 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590741.log.gz 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.391987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391987.log.gz 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746332.log 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.751837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751837.log.gz 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641396.log 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.640890.log 2024-03-18T07:19:10.182 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.641396.log: 0.0%/var/log/ceph/ceph-client.admin.746332.log: -- replaced with /var/log/ceph/ceph-client.admin.641396.log.gz 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280005.log 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746332.log.gz 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.640890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.640890.log.gz 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307331.log 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280005.log.gz 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235729.log 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311069.log 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235729.log.gz 2024-03-18T07:19:10.183 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736425.log 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307331.log.gz 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311069.log.gz 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192190.log 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266254.log 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736425.log.gz 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307605.log 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.192190.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.575989.log 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.192190.log.gz/var/log/ceph/ceph-client.admin.307605.log: 2024-03-18T07:19:10.184 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307605.log.gz 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266254.log.gz 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231196.log 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596682.log 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231196.log.gz 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.575989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575989.log.gz 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647334.log 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-03-18T07:19:10.185 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.596682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596682.log.gz 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324681.log 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.647334.log: /var/log/ceph/ceph-client.admin.44438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647334.log.gz 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581632.log 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636299.log 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.324681.log: /var/log/ceph/ceph-client.admin.581632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581632.log.gz 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324681.log.gz 2024-03-18T07:19:10.186 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739172.log 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770874.log 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636299.log.gz 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273143.log 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739172.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739172.log.gz 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose --/var/log/ceph/ceph-client.admin.273143.log: /var/log/ceph/ceph-client.admin.391974.log 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273143.log.gz 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.770874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770874.log.gz 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320580.log 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.391974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.391974.log.gz 2024-03-18T07:19:10.187 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48106.log 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287308.log 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.320580.log: /var/log/ceph/ceph-client.admin.48106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320580.log.gz 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624124.log 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48106.log.gz 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.287308.log: --verbose -- /var/log/ceph/ceph-client.admin.308855.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287308.log.gz 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884681.log 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624124.log.gz 2024-03-18T07:19:10.188 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.308855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308855.log.gz 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754929.log 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277274.log 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884681.log.gz 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316731.log 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754929.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756668.log 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.754929.log.gz 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316731.log: 0.0%/var/log/ceph/ceph-client.admin.277274.log: -- replaced with /var/log/ceph/ceph-client.admin.316731.log.gz 2024-03-18T07:19:10.189 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277274.log.gz 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37392.log 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352312.log 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756668.log: /var/log/ceph/ceph-client.admin.37392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756668.log.gz 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.772172.log 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.352312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352312.log.gz 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204220.log 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.772172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360718.log 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.772172.log.gz 2024-03-18T07:19:10.190 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605811.log 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.360718.log: /var/log/ceph/ceph-client.admin.204220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360718.log.gz 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248290.log 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605811.log.gz 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204220.log.gz 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147174.log 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248290.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37392.log.gz 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248290.log.gz 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172800.log 2024-03-18T07:19:10.191 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147174.log.gz 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210815.log 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.172800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172800.log.gz 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218684.log 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.210815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210815.log.gz 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150101.log 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.218684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218684.log.gz 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646055.log 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150101.log.gz 2024-03-18T07:19:10.192 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384786.log 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646055.log.gz 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889129.log 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.384786.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384786.log.gz 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349632.log 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889129.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.889129.log.gz 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626450.log 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111829.log 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626450.log.gz 2024-03-18T07:19:10.193 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192634.log 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349632.log.gz 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111829.log.gz 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332790.log 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.192634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192634.log.gz 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356270.log 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611174.log 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332790.log: /var/log/ceph/ceph-client.admin.356270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356270.log.gz 2024-03-18T07:19:10.194 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332790.log.gz 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271690.log 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.611174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611174.log.gz 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43586.log 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145797.log 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.271690.log: /var/log/ceph/ceph-client.admin.43586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271690.log.gzgzip 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.718143.log 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145797.log.gz 2024-03-18T07:19:10.195 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249674.log 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47320.log: gzip/var/log/ceph/ceph-client.admin.718143.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.596887.log 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249674.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718143.log.gz 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.249674.log.gz 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43586.log.gz 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235213.log 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339185.log 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2024-03-18T07:19:10.196 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235213.log: 0.0%/var/log/ceph/ceph-client.admin.596887.log: -- replaced with /var/log/ceph/ceph-client.admin.235213.log.gz 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885189.log 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.339185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596887.log.gz 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339185.log.gz 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632243.log 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355104.log 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738878.log 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632243.log.gz 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.885189.log: /var/log/ceph/ceph-client.admin.355104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885189.log.gz 2024-03-18T07:19:10.197 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747094.log 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355104.log.gz 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.738878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738878.log.gz 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202349.log 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382320.log 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202349.log: /var/log/ceph/ceph-client.admin.747094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202349.log.gz 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48814.log 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747094.log.gz 2024-03-18T07:19:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382320.log.gz 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233106.log 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764335.log 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.233106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610067.log 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233106.log.gz 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48814.log: /var/log/ceph/ceph-client.admin.764335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764335.log.gz 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767069.log 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610067.log.gz 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48814.log.gz 2024-03-18T07:19:10.199 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765661.log 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352864.log 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767069.log: /var/log/ceph/ceph-client.admin.765661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765661.log.gz 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767069.log.gz 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr: -5/var/log/ceph/ceph-client.admin.352864.log: --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352864.log.gz 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.588472.log 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588472.log.gz 2024-03-18T07:19:10.200 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749934.log 2024-03-18T07:19:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171822.log 2024-03-18T07:19:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749934.log.gz 2024-03-18T07:19:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588913.log 2024-03-18T07:19:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.171822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.171822.log.gz 2024-03-18T07:19:10.275 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342526.log 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111842.log 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342526.log: 0.0%/var/log/ceph/ceph-client.admin.588913.log: -- replaced with /var/log/ceph/ceph-client.admin.342526.log.gz 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.146701.log -- replaced with /var/log/ceph/ceph-client.admin.588913.log.gz 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.111842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111842.log.gz 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632230.log 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146701.log.gz 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876447.log 2024-03-18T07:19:10.276 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647321.log 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876447.log.gz 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632230.log.gz 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754232.log 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.647321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647321.log.gz 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272106.log 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328697.log 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272106.log: 0.0%/var/log/ceph/ceph-client.admin.754232.log: -- replaced with /var/log/ceph/ceph-client.admin.272106.log.gz 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614729.log 2024-03-18T07:19:10.277 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754232.log.gz 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328697.log.gz 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44102.log 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148277.log 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44102.log: /var/log/ceph/ceph-client.admin.614729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269492.log 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614729.log.gz 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.148277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148277.log.gz 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44102.log.gz 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114159.log 2024-03-18T07:19:10.278 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227255.log 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.114159.log: /var/log/ceph/ceph-client.admin.269492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114159.log.gz 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645154.log 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269492.log.gz 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227255.log.gz 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273558.log 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610054.log 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.273558.log: /var/log/ceph/ceph-client.admin.645154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273558.log.gz 2024-03-18T07:19:10.279 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154396.log 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645154.log.gz 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610054.log.gz 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208471.log 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253038.log 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208471.log.gz 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408398.log 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154396.log.gz 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253038.log.gz 2024-03-18T07:19:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282276.log 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408398.log.gz 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300739.log 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752521.log 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.300739.log: /var/log/ceph/ceph-client.admin.282276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300739.log.gz 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282276.log.gz 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881426.log 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763437.log 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752521.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.752521.log.gz 2024-03-18T07:19:10.281 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.661913.log 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763437.log: /var/log/ceph/ceph-client.admin.881426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763437.log.gz 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753479.log 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881426.log.gz 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661913.log.gz 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328916.log 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194344.log 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.328916.log: /var/log/ceph/ceph-client.admin.753479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328916.log.gz 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889003.log 2024-03-18T07:19:10.282 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753479.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194344.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769018.log 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123527.log 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.769018.log: /var/log/ceph/ceph-client.admin.889003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769018.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634521.log 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.123527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123527.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655428.log 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.634521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634521.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.889003.log.gz 2024-03-18T07:19:10.283 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639577.log 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655428.log.gz 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246853.log 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44103.log 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246853.log: /var/log/ceph/ceph-client.admin.639577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246853.log.gz 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248930.log 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639577.log.gz 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733143.log 2024-03-18T07:19:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248930.log.gz 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248943.log 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.653751.log 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248943.log: 0.0%/var/log/ceph/ceph-client.admin.733143.log: -- replaced with /var/log/ceph/ceph-client.admin.248943.log.gz 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358327.log 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733143.log.gz 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.653751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.653751.log.gz 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731340.log 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.358327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358327.log.gz 2024-03-18T07:19:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880905.log 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341744.log 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880905.log.gz 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.731340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731340.log.gz 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311138.log 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341744.log.gz 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44101.log 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221923.log 2024-03-18T07:19:10.286 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44101.log: /var/log/ceph/ceph-client.admin.311138.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44103.log.gz 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311138.log.gz 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751358.log 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221923.log.gz 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734845.log 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225782.log 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734845.log: /var/log/ceph/ceph-client.admin.751358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734845.log.gz 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751358.log.gz 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287857.log 2024-03-18T07:19:10.287 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225782.log.gz 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143489.log 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202816.log 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143489.log.gz 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.287857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287857.log.gz 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42933.log 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202816.log.gz 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113665.log 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322943.log 2024-03-18T07:19:10.288 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42933.log: /var/log/ceph/ceph-client.admin.113665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113665.log.gz 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333666.log 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322943.log.gz 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221440.log 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44101.log.gz 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48562.log 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333666.log: /var/log/ceph/ceph-client.admin.221440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221440.log.gz 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333666.log.gz 2024-03-18T07:19:10.289 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42933.log.gz 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149644.log 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146890.log 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.149644.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149644.log.gz 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48562.log: --verbose/var/log/ceph/ceph-client.admin.146890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146890.log.gz 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.590728.log 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258740.log 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.590728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590728.log.gz 2024-03-18T07:19:10.290 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147366.log 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48562.log.gz 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.258740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273627.log 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258740.log.gz 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.147366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147366.log.gz 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612495.log 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276790.log 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.612495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752726.log 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.273627.log: -- replaced with /var/log/ceph/ceph-client.admin.612495.log.gz 2024-03-18T07:19:10.291 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0%/var/log/ceph/ceph-client.admin.276790.log: -- replaced with /var/log/ceph/ceph-client.admin.273627.log.gz 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214060.log 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276790.log.gz 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752726.log.gz 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749168.log 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749168.log.gz 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.214060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734638.log 2024-03-18T07:19:10.292 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214060.log.gz 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49610.log 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.734638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734638.log.gz 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325560.log 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356257.log 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325560.log.gz 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159398.log 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.356257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356257.log.gz 2024-03-18T07:19:10.293 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220478.log 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223757.log 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220478.log.gz 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.159398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277192.log 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159398.log.gz 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.223757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223757.log.gz 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312625.log 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297761.log 2024-03-18T07:19:10.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.312625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312625.log.gz 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.277192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239125.log 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277192.log.gz 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247345.log 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290631.log 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239125.log.gz 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.297761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.880070.log 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297761.log.gz 2024-03-18T07:19:10.295 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247345.log.gz 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.290631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605290.log 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290631.log.gz 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.880070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.880070.log.gz 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49610.log.gz 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.347595.log 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646329.log 2024-03-18T07:19:10.296 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347595.log.gz 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.605290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605290.log.gz 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888793.log 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221632.log 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888793.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.888793.log.gz 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345664.log 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767568.log 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646329.log.gz 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.345664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345664.log.gz 2024-03-18T07:19:10.297 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44804.log 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.221632.log: /var/log/ceph/ceph-client.admin.767568.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767568.log.gz 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221632.log.gz 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311562.log 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278680.log 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578318.log 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278680.log.gz 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311562.log.gz 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359330.log 2024-03-18T07:19:10.298 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578318.log.gz 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644655.log 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44804.log.gz 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.644655.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644655.log.gz 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.629528.log 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.359330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359330.log.gz 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301061.log 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.629528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629528.log.gz 2024-03-18T07:19:10.299 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225508.log 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43880.log 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335093.log 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225508.log.gz 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301061.log: /var/log/ceph/ceph-client.admin.43880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301061.log.gz 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276995.log 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.335093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335093.log.gz 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194837.log 2024-03-18T07:19:10.300 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719587.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194837.log.gz 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.276995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276995.log.gz 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874650.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719587.log.gz 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.655441.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225027.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307815.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874650.log: /var/log/ceph/ceph-client.admin.225027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.657358.log 2024-03-18T07:19:10.301 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.874650.log.gz 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225027.log.gz 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.655441.log: /var/log/ceph/ceph-client.admin.307815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327292.log 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307815.log.gz 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.655441.log.gz 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.657358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.657358.log.gz 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286413.log 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749455.log 2024-03-18T07:19:10.302 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286413.log.gz 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.327292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632744.log 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327292.log.gz 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47083.log 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.632744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632744.log.gz 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257729.log 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408590.log 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749455.log.gz 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.257729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888488.log 2024-03-18T07:19:10.303 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257729.log.gz 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47083.log: /var/log/ceph/ceph-client.admin.408590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408590.log.gz 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174626.log 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580732.log 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174626.log: /var/log/ceph/ceph-client.admin.888488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174626.log.gz 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206301.log 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580732.log.gz 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636312.log 2024-03-18T07:19:10.304 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206301.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.888488.log.gz 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206301.log.gz 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340016.log 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43880.log.gz 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636312.log.gz 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291592.log 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.47083.log.gz 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382965.log 2024-03-18T07:19:10.305 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291592.log: /var/log/ceph/ceph-client.admin.340016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291592.log.gz 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340016.log.gz 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282550.log 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382965.log.gz 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357836.log 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154327.log 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.357836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357836.log.gz 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243593.log 2024-03-18T07:19:10.306 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282550.log.gz 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.154327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154327.log.gz 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43628.log 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.644962.log 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43628.log: /var/log/ceph/ceph-client.admin.243593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243593.log.gz 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142141.log 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.644962.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.644962.log.gz 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227735.log 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.142141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46327.log 2024-03-18T07:19:10.307 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142141.log.gz 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.227735.log: /var/log/ceph/ceph-client.admin.46327.log: /var/log/ceph/ceph-client.admin.249204.log 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227735.log.gz 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43628.log.gz 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317189.log 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.249204.log: 87.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249204.log.gz -- replaced with /var/log/ceph/ceph-client.admin.46327.log.gz 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351655.log 2024-03-18T07:19:10.308 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291347.log 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.351655.log: 0.0%/var/log/ceph/ceph-client.admin.317189.log: -- replaced with /var/log/ceph/ceph-client.admin.351655.log.gz 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.592080.log 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317189.log.gz 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291347.log.gz 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610223.log 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319279.log 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610223.log: /var/log/ceph/ceph-client.admin.592080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610223.log.gz 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-18T07:19:10.309 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.592080.log.gz 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319279.log.gz 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50326.log 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589283.log 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.50326.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50326.log.gz 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234324.log 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.589283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589283.log.gz 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717937.log 2024-03-18T07:19:10.310 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.234324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234324.log.gz 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.883788.log 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717937.log.gz 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239878.log 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.883788.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.883788.log.gz 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757150.log 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.239878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239878.log.gz 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163247.log 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757150.log.gz 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382525.log 2024-03-18T07:19:10.311 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.163247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163247.log.gz 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220683.log 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382525.log.gz 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245023.log 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.220683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220683.log.gz 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291899.log 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245023.log.gz 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736820.log 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.291899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291899.log.gz 2024-03-18T07:19:10.312 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194755.log 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.736820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736820.log.gz 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278388.log 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194755.log.gz 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150492.log 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.278388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278388.log.gz 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219599.log 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.150492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150492.log.gz 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.884879.log 2024-03-18T07:19:10.313 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219599.log.gz 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128171.log 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.884879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.884879.log.gz 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210354.log 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.128171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128171.log.gz 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.646068.log 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.210354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210354.log.gz 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211289.log 2024-03-18T07:19:10.314 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.646068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.646068.log.gz 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203336.log 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.211289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211289.log.gz 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406114.log 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.203336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203336.log.gz 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162632.log 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406114.log.gz 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259220.log 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.162632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162632.log.gz 2024-03-18T07:19:10.315 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753287.log 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.753287.log: -- /var/log/ceph/ceph-client.admin.157146.log 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753287.log.gz 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259220.log.gz 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231470.log 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314219.log/var/log/ceph/ceph-client.admin.157146.log: /var/log/ceph/ceph-client.admin.231470.log: 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231470.log.gz 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157146.log.gz 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.314219.log: /var/log/ceph/ceph-client.admin.732869.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314219.log.gz 2024-03-18T07:19:10.316 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.641409.log 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.732869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732869.log.gz 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751576.log 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.641409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.641409.log.gz 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226994.log 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.751576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751576.log.gz 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197644.log 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.226994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226994.log.gz 2024-03-18T07:19:10.317 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769464.log 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.197644.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197644.log.gz 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109934.log 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.769464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769464.log.gz 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244954.log 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109934.log.gz 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381767.log 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244954.log.gz 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248656.log 2024-03-18T07:19:10.318 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.381767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381767.log.gz 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319061.log 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.248656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248656.log.gz 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349902.log 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319061.log.gz 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291661.log 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349902.log.gz 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636678.log 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578130.log 2024-03-18T07:19:10.319 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.636678.log: /var/log/ceph/ceph-client.admin.291661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636678.log.gz 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291661.log.gz 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289155.log 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578130.log.gz 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409495.log 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283695.log 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.289155.log: /var/log/ceph/ceph-client.admin.409495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409495.log.gz 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170797.log 2024-03-18T07:19:10.320 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289155.log.gz 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.283695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283695.log.gz 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.170797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170797.log.gz 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199181.log 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.882830.log 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.199181.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199181.log.gz 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408108.log 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.882830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.882830.log.gz 2024-03-18T07:19:10.321 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317176.log 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.408108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408108.log.gz 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174373.log 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.317176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317176.log.gz 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190717.log 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.174373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174373.log.gz 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.190717.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190717.log.gz 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.316662.log 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122752.log 2024-03-18T07:19:10.322 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.316662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316662.log.gz 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203418.log 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.122752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122752.log.gz 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225521.log 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.203418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203418.log.gz 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.878286.log 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.225521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225521.log.gz 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601983.log 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878286.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878286.log.gz 2024-03-18T07:19:10.323 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141685.log 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.601983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601983.log.gz 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321519.log 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141685.log.gz 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145325.log 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321519.log.gz 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406032.log 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145325.log.gz 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355186.log 2024-03-18T07:19:10.324 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406032.log.gz 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141616.log 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.355186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355186.log.gz 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332859.log 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.141616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151001.log 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141616.log.gz 2024-03-18T07:19:10.325 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309761.log 2024-03-18T07:19:10.424 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.332859.log: /var/log/ceph/ceph-client.admin.151001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332859.log.gz 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151001.log.gz 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232410.log 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.662092.log 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.878273.log 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232410.log.gz 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.309761.log: /var/log/ceph/ceph-client.admin.662092.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.662092.log.gz 2024-03-18T07:19:10.425 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309761.log.gz 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341535.log 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660878.log 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341535.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341535.log.gz 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878273.log: /var/log/ceph/ceph-client.admin.660878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660878.log.gz 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878273.log.gz 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764253.log 2024-03-18T07:19:10.426 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269695.log 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.764253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237500.log 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764253.log.gz 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.269695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269695.log.gz 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718212.log 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47209.log 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405614.log 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718212.log.gz 2024-03-18T07:19:10.427 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237500.log: /var/log/ceph/ceph-client.admin.47209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237500.log.gz 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237308.log 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.405614.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47209.log.gz 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405614.log.gz 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757661.log 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237308.log.gz 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591604.log 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757661.log.gz 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624534.log 2024-03-18T07:19:10.428 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.591604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591604.log.gz 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580921.log 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624534.log.gz 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222320.log 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580921.log.gz 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121835.log 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.222320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124330.log 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.121835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121835.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222320.log.gz 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.429 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643221.log 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.124330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124330.log.gz 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615887.log 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587509.log 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.615887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643221.log.gz 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615887.log.gz 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.587509.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587509.log.gz 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.241549.log 2024-03-18T07:19:10.430 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347783.log 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241549.log.gz 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343854.log 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347783.log.gz 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329607.log 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.343854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343854.log.gz 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.762975.log 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.329607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329607.log.gz 2024-03-18T07:19:10.431 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289442.log 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.762975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.762975.log.gz 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716495.log 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.289442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289442.log.gz 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194275.log 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716495.log.gz 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.638478.log 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.194275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194275.log.gz 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.638478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.638478.log.gz 2024-03-18T07:19:10.432 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.325114.log 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.661280.log 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325114.log.gz 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106520.log 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.661280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.661280.log.gz 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.106520.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106520.log.gz 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.44972.log 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227748.log 2024-03-18T07:19:10.433 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716706.log 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227748.log.gz 88.1% 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755395.log 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613875.log 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755395.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341105.log 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890412.log 2024-03-18T07:19:10.434 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613875.log.gz 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341105.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341105.log.gz 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.716706.log.gzgzip 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.877834.log 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305683.log 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.877834.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.890412.log.gz 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.877834.log.gz 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282752.log 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305683.log.gz 2024-03-18T07:19:10.435 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.876930.log 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282752.log.gz 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273156.log 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.876930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.876930.log.gz 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157588.log 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.273156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273156.log.gz 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208980.log 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.157588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157588.log.gz 2024-03-18T07:19:10.436 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.208980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208980.log.gz 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.720395.log 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.757648.log 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720395.log.gz 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196791.log 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.757648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.757648.log.gz 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752247.log 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.196791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196791.log.gz 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739635.log 2024-03-18T07:19:10.437 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752247.log.gz 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281624.log 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.739635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739635.log.gz 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603011.log 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.281624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281624.log.gz 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598972.log 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.603011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603011.log.gz 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409790.log 2024-03-18T07:19:10.438 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.598972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598972.log.gz 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49228.log 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409790.log.gz 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613505.log 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758965.log 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.613505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613505.log.gz 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.878204.log 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.758965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758965.log.gz 2024-03-18T07:19:10.439 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200088.log 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.878204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.878204.log.gz 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616075.log 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.200088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200088.log.gz 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342513.log 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.616075.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49228.log.gz 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr: -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616075.log.gz 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.604160.log 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.342513.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342513.log.gz 2024-03-18T07:19:10.440 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose --/var/log/ceph/ceph-client.admin.604160.log: /var/log/ceph/ceph-client.admin.889824.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604160.log.gz 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341466.log 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889824.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.889824.log.gz 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232819.log 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285934.log 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232819.log.gz 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341466.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.347088.log 2024-03-18T07:19:10.441 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.341466.log.gz 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285934.log.gz 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235008.log 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.347088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347088.log.gz 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889656.log 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235008.log.gz 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113204.log 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889656.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.889656.log.gz 2024-03-18T07:19:10.442 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763811.log 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609288.log 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763811.log.gz 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.113204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609554.log 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113204.log.gz 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609288.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.609288.log.gz 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.297748.log 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609554.log.gz 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206099.log 2024-03-18T07:19:10.443 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.297748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.297748.log.gz 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660573.log 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206099.log.gz 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231862.log 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660573.log.gz 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330116.log 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.231862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231862.log.gz 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230526.log 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330116.log.gz 2024-03-18T07:19:10.444 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315789.log 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.230526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230526.log.gz 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311151.log 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315789.log.gz 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.765213.log 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311151.log.gz 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580908.log 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.765213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.765213.log.gz 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326859.log 2024-03-18T07:19:10.445 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.580908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580908.log.gz 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581550.log 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.326859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326859.log.gz 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265145.log 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.581550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581550.log.gz 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145256.log 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265145.log.gz 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588403.log 2024-03-18T07:19:10.446 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.145256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145256.log.gz 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650361.log 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.588403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588403.log.gz 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405827.log 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.650361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650361.log.gz 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318800.log 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.405827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405827.log.gz 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47602.log 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.889297.log 2024-03-18T07:19:10.447 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.318800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753205.log 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318800.log.gz 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.889297.log: /var/log/ceph/ceph-client.admin.47602.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.889297.log.gz 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319471.log 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753205.log.gz 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48688.log 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.319471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319471.log.gz 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648144.log 2024-03-18T07:19:10.448 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310401.log 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648144.log.gz 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241562.log 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48688.log: /var/log/ceph/ceph-client.admin.310401.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.310401.log.gz 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.266336.log 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241562.log.gz 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382043.log 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266336.log.gz 2024-03-18T07:19:10.449 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.382043.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.382043.log.gz 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645707.log 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645223.log 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645707.log.gz 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341118.log 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645223.log.gz 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190799.log 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341118.log.gz 2024-03-18T07:19:10.450 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.654292.log 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.190799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190799.log.gz 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.639646.log 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888656.log 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.654292.log: /var/log/ceph/ceph-client.admin.639646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406905.log 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.639646.log.gz 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.654292.log.gz 2024-03-18T07:19:10.451 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247742.log 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406905.log: 0.0% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.888656.log.gz 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.406905.log.gz 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289634.log 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215917.log 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.47602.log.gz 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.289634.log: --verbose -- /var/log/ceph/ceph-client.admin.591617.log 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289634.log.gz 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.247742.log: /var/log/ceph/ceph-client.admin.215917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215917.log.gz 2024-03-18T07:19:10.452 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247742.log.gz 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322408.log 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48688.log.gz 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49101.log 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322216.log 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322408.log.gz 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.591617.log: /var/log/ceph/ceph-client.admin.49101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591617.log.gz 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320974.log 2024-03-18T07:19:10.453 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.322216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322216.log.gz 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.888614.log 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753766.log 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.888614.log: /var/log/ceph/ceph-client.admin.320974.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.888614.log.gz 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123514.log 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320974.log.gz 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.768564.log 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.123514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123514.log.gz 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156374.log 2024-03-18T07:19:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753766.log: /var/log/ceph/ceph-client.admin.768564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753766.log.gz 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.768564.log.gz 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301523.log 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405811.log 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142584.log 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.156374.log: /var/log/ceph/ceph-client.admin.405811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323814.log 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156374.log.gz 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405811.log.gz 2024-03-18T07:19:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301523.log: /var/log/ceph/ceph-client.admin.142584.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301523.log.gz -5 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.595337.log 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142584.log.gz 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.323814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323814.log.gz 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411186.log 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595337.log.gz 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.650082.log 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.411186.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2024-03-18T07:19:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411186.log.gz 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.229143.log 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.650082.log: --verbose --/var/log/ceph/ceph-client.admin.229143.log: /var/log/ceph/ceph-client.admin.393810.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229143.log.gz 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.650082.log.gz 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349833.log 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126323.log 2024-03-18T07:19:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349833.log: 0.0%/var/log/ceph/ceph-client.admin.393810.log: -- replaced with /var/log/ceph/ceph-client.admin.349833.log.gz 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232341.log 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393810.log.gz 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.126323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126323.log.gz 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235021.log 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232341.log.gz 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.597153.log 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.235021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235021.log.gz 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648646.log 2024-03-18T07:19:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.597153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.597153.log.gz 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333225.log 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648646.log.gz 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109852.log 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.333225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333225.log.gz 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337316.log 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.109852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109852.log.gz 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213612.log 2024-03-18T07:19:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.213612.log: /var/log/ceph/ceph-client.admin.121753.log/var/log/ceph/ceph-client.admin.337316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213612.log.gz 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337316.log.gz 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195789.log 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.121753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.121753.log.gz 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357754.log 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153428.log 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.357754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357754.log.gz 2024-03-18T07:19:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.195789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146903.log 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.153428.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195789.log.gz 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.153428.log.gz 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248029.log 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.146903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146903.log.gz 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44097.log 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224835.log 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44097.log: /var/log/ceph/ceph-client.admin.248029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44720.log 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248029.log.gz 2024-03-18T07:19:10.461 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224835.log.gz 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738604.log 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209363.log 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301605.log 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.209363.log: 0.0%/var/log/ceph/ceph-client.admin.738604.log: -- replaced with /var/log/ceph/ceph-client.admin.209363.log.gz 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210828.log 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738604.log.gz 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.301605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301605.log.gz 2024-03-18T07:19:10.462 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173819.log 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626040.log 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173819.log.gz 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.210828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359261.log 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210828.log.gz 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.626040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626040.log.gz 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310630.log 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.742557.log 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.359261.log: /var/log/ceph/ceph-client.admin.310630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310630.log.gz 2024-03-18T07:19:10.463 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359261.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342721.log 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.742557.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44097.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.603968.log 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.742557.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.342721.log: -5 --verbose/var/log/ceph/ceph-client.admin.603968.log: -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342721.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603968.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.192203.log 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44720.log.gz 2024-03-18T07:19:10.464 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274908.log 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752808.log 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274908.log: /var/log/ceph/ceph-client.admin.192203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274908.log.gz 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305010.log 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192203.log.gz 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752808.log.gz 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.763424.log 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48022.log 2024-03-18T07:19:10.465 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.763424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.763424.log.gz 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.305010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346628.log 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305010.log.gz/var/log/ceph/ceph-client.admin.48022.log: 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255418.log 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.346628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346628.log.gz 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609779.log 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.659864.log 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609779.log.gz 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.255418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.886130.log 2024-03-18T07:19:10.466 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255418.log.gz 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.659864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.659864.log.gz 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348049.log 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766145.log 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.886130.log: /var/log/ceph/ceph-client.admin.348049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348049.log.gz 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.886130.log.gz 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48022.log.gz 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264433.log 2024-03-18T07:19:10.467 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746345.log 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.766145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766145.log.gz 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310136.log 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746345.log: /var/log/ceph/ceph-client.admin.264433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746345.log.gz 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349456.log 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264433.log.gz 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.310136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310136.log.gz 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751563.log 2024-03-18T07:19:10.468 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267267.log 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.349456.log: /var/log/ceph/ceph-client.admin.751563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751563.log.gz 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349456.log.gz 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634439.log 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.267267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267267.log.gz 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.651554.log 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315285.log 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.651554.log: /var/log/ceph/ceph-client.admin.634439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.651554.log.gz 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272175.log 2024-03-18T07:19:10.469 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634439.log.gz 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315285.log.gz 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624808.log 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191610.log 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272175.log: /var/log/ceph/ceph-client.admin.624808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624808.log.gz 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272175.log.gz 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405601.log 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.191610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191610.log.gz 2024-03-18T07:19:10.470 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174914.log 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.405601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.405601.log.gz 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.874637.log 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393374.log 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.874637.log: /var/log/ceph/ceph-client.admin.174914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.874637.log.gz 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174914.log.gz 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.596235.log 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718417.log 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.393374.log: /var/log/ceph/ceph-client.admin.596235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.596235.log.gz 2024-03-18T07:19:10.471 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.393374.log.gz 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330544.log 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718417.log.gz 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.645236.log 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.330544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330544.log.gz 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.890076.log 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.645236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.645236.log.gz 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.766214.log 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.890076.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.890076.log.gz 2024-03-18T07:19:10.472 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43502.log 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237979.log 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43502.log: /var/log/ceph/ceph-client.admin.766214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.766214.log.gzgzip 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44429.log 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.237979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237979.log.gz 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719132.log 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383944.log 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.719132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719132.log.gz 2024-03-18T07:19:10.473 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116856.log 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.383944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383944.log.gz 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198720.log 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.116856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116856.log.gz 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43502.log.gz 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244572.log 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193009.log 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.244572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244572.log.gz 2024-03-18T07:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.198720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746627.log 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.193009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193009.log.gz 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198720.log.gz 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341968.log 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746627.log.gz 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759034.log 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.341968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341968.log.gz 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242508.log 2024-03-18T07:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759034.log.gz 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.750413.log 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.242508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242508.log.gz 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285132.log 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.750413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.750413.log.gz 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204207.log 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.285132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285132.log.gz 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251836.log 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.204207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204207.log.gz 2024-03-18T07:19:10.476 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354208.log 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.251836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251836.log.gz 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.660586.log 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.752329.log 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.660586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.660586.log.gz/var/log/ceph/ceph-client.admin.354208.log: 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206601.log 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354208.log.gz 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.752329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.752329.log.gz 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49354.log 2024-03-18T07:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.595268.log 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206601.log: /var/log/ceph/ceph-client.admin.49354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206601.log.gz 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.756872.log 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.595268.log: gzip -5 --verbose 0.0% -- replaced with /var/log/ceph/ceph-client.admin.595268.log.gz 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.334819.log 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44429.log.gz 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.756872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.756872.log.gz 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383034.log 2024-03-18T07:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49354.log.gz 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37673.log 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334819.log: /var/log/ceph/ceph-client.admin.383034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383034.log.gz 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334819.log.gz 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155212.log 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581109.log 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287583.log 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.581109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.581109.log.gz 2024-03-18T07:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155212.log.gz 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246784.log 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.287583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287583.log.gz 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.749647.log 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755408.log 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.749647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.749647.log.gz 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.246784.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246784.log.gz 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293114.log 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.755408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755408.log.gz 2024-03-18T07:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357823.log 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.594860.log 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.293114.log: /var/log/ceph/ceph-client.admin.357823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357823.log.gz 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293114.log.gz 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578765.log 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.594860.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.594860.log.gz 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292187.log 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.578765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578765.log.gz 2024-03-18T07:19:10.481 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224318.log 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.292187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292187.log.gz 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384868.log 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.224318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224318.log.gz 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348937.log 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.384868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384868.log.gz 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609862.log 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.348937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348937.log.gz 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190274.log 2024-03-18T07:19:10.482 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.609862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609862.log.gz 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643650.log 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.190274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190274.log.gz 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259439.log 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643650.log.gz 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392916.log 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259439.log.gz 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610157.log 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.392916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392916.log.gz 2024-03-18T07:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250950.log 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226499.log 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610157.log: gzip/var/log/ceph/ceph-client.admin.250950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610157.log.gz 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr: -5/var/log/ceph/ceph-client.admin.226499.log: --verbose -- /var/log/ceph/ceph-client.admin.122765.log 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250950.log.gz 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226499.log.gz 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37673.log.gz 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410645.log 2024-03-18T07:19:10.484 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173306.log 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.122765.log: /var/log/ceph/ceph-client.admin.410645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410645.log.gz 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122765.log.gz 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602463.log 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.173306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173306.log.gz 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759478.log 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.754437.log 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602463.log: /var/log/ceph/ceph-client.admin.759478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759478.log.gz 2024-03-18T07:19:10.485 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602463.log.gz 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887429.log 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.647252.log 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.754437.log: /var/log/ceph/ceph-client.admin.887429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887429.log.gz 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.754437.log.gz 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231209.log 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172366.log 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.647252.log: /var/log/ceph/ceph-client.admin.231209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231209.log.gz 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.647252.log.gz 2024-03-18T07:19:10.486 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610113.log 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.172366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172366.log.gz 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632447.log 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280292.log 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.610113.log: /var/log/ceph/ceph-client.admin.632447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632447.log.gz 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610113.log.gz 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314018.log 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280292.log.gz 2024-03-18T07:19:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.758080.log 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245486.log 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.314018.log: /var/log/ceph/ceph-client.admin.758080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.758080.log.gz 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314018.log.gz 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323745.log 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245486.log.gz 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.747504.log 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.648728.log 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.323745.log: /var/log/ceph/ceph-client.admin.747504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.747504.log.gz 2024-03-18T07:19:10.488 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323745.log.gz 2024-03-18T07:19:10.489 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203405.log 2024-03-18T07:19:10.489 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.648728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.648728.log.gz 2024-03-18T07:19:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170421.log 2024-03-18T07:19:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269982.log 2024-03-18T07:19:10.532 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.203405.log: /var/log/ceph/ceph-client.admin.170421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.170421.log.gz 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203405.log.gz 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197183.log 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269982.log.gz 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340567.log 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286139.log 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.340567.log: /var/log/ceph/ceph-client.admin.197183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340567.log.gz 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197183.log.gz 2024-03-18T07:19:10.533 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.745576.log 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.286139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286139.log.gz 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225990.log 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218671.log 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.745576.log: /var/log/ceph/ceph-client.admin.225990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225990.log.gz 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.745576.log.gz 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311819.log 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.218671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218671.log.gz 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205560.log 2024-03-18T07:19:10.534 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219612.log 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311819.log: /var/log/ceph/ceph-client.admin.205560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205560.log.gz 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311819.log.gz 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315298.log 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.219612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219612.log.gz 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.885395.log 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337560.log 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315298.log: /var/log/ceph/ceph-client.admin.885395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.885395.log.gz 2024-03-18T07:19:10.535 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315298.log.gz 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306921.log 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.658293.log 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.337560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337560.log.gz 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631764.log 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.306921.log: /var/log/ceph/ceph-client.admin.658293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.658293.log.gz 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306921.log.gz 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.643581.log 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282071.log 2024-03-18T07:19:10.536 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.643581.log: /var/log/ceph/ceph-client.admin.631764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.643581.log.gz 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355173.log 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631764.log.gz 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282071.log.gz 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321532.log 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241110.log 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.321532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321532.log.gz 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.355173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117840.log 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355173.log.gz 2024-03-18T07:19:10.537 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.241110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241110.log.gz 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245933.log 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627856.log 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.245933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245933.log.gz 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.117840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117840.log.gz 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49480.log 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.627856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627856.log.gz 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875542.log 2024-03-18T07:19:10.538 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282481.log 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875542.log: /var/log/ceph/ceph-client.admin.49480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875542.log.gz 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769951.log 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.282481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282481.log.gz 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272380.log 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.272380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272380.log.gz 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr: --/var/log/ceph/ceph-client.admin.769951.log: /var/log/ceph/ceph-client.admin.229604.log 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769951.log.gz 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49480.log.gz 2024-03-18T07:19:10.539 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311355.log 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.229604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229604.log.gz 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602532.log 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602532.log.gz 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227268.log 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311355.log.gz 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303326.log 2024-03-18T07:19:10.540 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.227268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227268.log.gz 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43018.log 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764701.log 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717217.log 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.303326.log: /var/log/ceph/ceph-client.admin.764701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303326.log.gz 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764701.log.gz 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334171.log 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.751371.log 2024-03-18T07:19:10.541 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.334171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334171.log.gz 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.717217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717217.log.gz 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.593160.log 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325547.log 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.593160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.593160.log.gz 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.751371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266541.log 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285145.log 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.751371.log.gz 2024-03-18T07:19:10.542 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.266541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356188.log 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266541.log.gz 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.325547.log: /var/log/ceph/ceph-client.admin.285145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285145.log.gz 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325547.log.gz 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311327.log 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.356188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356188.log.gz 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381497.log 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.311327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259426.log 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311327.log.gz 2024-03-18T07:19:10.543 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.381497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409508.log 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381497.log.gz 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43018.log.gz 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215443.log 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.259426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718687.log 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259426.log.gz 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.409508.log: /var/log/ceph/ceph-client.admin.215443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215443.log.gz 2024-03-18T07:19:10.544 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409508.log.gz 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269029.log 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.718687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718687.log.gz 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287098.log 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624055.log 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269029.log: /var/log/ceph/ceph-client.admin.287098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287098.log.gz 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269029.log.gz 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253760.log 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.624055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624055.log.gz 2024-03-18T07:19:10.545 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.769005.log 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.769005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.769005.log.gz 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.253760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253760.log.gz 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616736.log 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716269.log 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746832.log 2024-03-18T07:19:10.546 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.716269.log: 0.0%/var/log/ceph/ceph-client.admin.616736.log: -- replaced with /var/log/ceph/ceph-client.admin.716269.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616736.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264040.log 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.770156.log 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746832.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.264040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269777.log 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.264040.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.770156.log: -- /var/log/ceph/ceph-client.admin.232136.log 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.770156.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269777.log.gz 2024-03-18T07:19:10.547 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205188.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232136.log.gz 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50030.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317633.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.205188.log: /var/log/ceph/ceph-client.admin.50030.log: gzip -5 --verbose 0.0% -- -- replaced with /var/log/ceph/ceph-client.admin.205188.log.gz 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.232149.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.317633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317633.log.gz 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224524.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307400.log 2024-03-18T07:19:10.548 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.232149.log: /var/log/ceph/ceph-client.admin.224524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224524.log.gz 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232149.log.gz 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202885.log 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307400.log.gz 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124875.log 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215374.log 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.202885.log: /var/log/ceph/ceph-client.admin.124875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124875.log.gz 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.634508.log 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.202885.log.gz 2024-03-18T07:19:10.549 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.215374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215374.log.gz 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269505.log 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.634508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634508.log.gz 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.759995.log 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269505.log.gz 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208967.log 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.759995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.759995.log.gz 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206683.log 2024-03-18T07:19:10.550 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.208967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208967.log.gz 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269042.log 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.206683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206683.log.gz 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155751.log 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269042.log.gz 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274424.log 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.155751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155751.log.gz 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.881878.log 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.274424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274424.log.gz 2024-03-18T07:19:10.551 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205642.log 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.881878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.881878.log.gz 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381727.log 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.205642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205642.log.gz 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383487.log 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.381727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381727.log.gz 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143691.log 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.383487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383487.log.gz 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406465.log 2024-03-18T07:19:10.552 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143691.log.gz 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.406465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.406465.log.gz 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258945.log 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601095.log 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.887032.log 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.258945.log: /var/log/ceph/ceph-client.admin.601095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601095.log.gz 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258945.log.gz 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381974.log 2024-03-18T07:19:10.553 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.887032.log: --verbose --/var/log/ceph/ceph-client.admin.381974.log: /var/log/ceph/ceph-client.admin.302957.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.381974.log.gz 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887032.log.gz 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50030.log.gz 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.755669.log 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.302957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302957.log.gz 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209906.log 2024-03-18T07:19:10.554 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392467.log 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.209906.log: /var/log/ceph/ceph-client.admin.755669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209906.log.gz 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265417.log 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.755669.log.gz 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.392467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.392467.log.gz 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241960.log 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.265417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265417.log.gz 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.746056.log 2024-03-18T07:19:10.555 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.764322.log 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.746056.log: /var/log/ceph/ceph-client.admin.241960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.746056.log.gz 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602750.log 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241960.log.gz 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.764322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.764322.log.gz 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623644.log 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.602750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230078.log 0.0% 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.602750.log.gz 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272590.log 2024-03-18T07:19:10.556 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.623644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720464.log 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623644.log.gz 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.272590.log: /var/log/ceph/ceph-client.admin.230078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.875995.log 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230078.log.gz 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.720464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272590.log.gz 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720464.log.gz 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.767650.log 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.875995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.875995.log.gz 2024-03-18T07:19:10.557 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269234.log 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.767650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.767650.log.gz 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143030.log 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.269234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269234.log.gz 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307884.log 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.143030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143030.log.gz 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324260.log 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.307884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307884.log.gz 2024-03-18T07:19:10.558 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292174.log 2024-03-18T07:19:10.559 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315720.log 2024-03-18T07:19:10.561 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.324260.log: /var/log/ceph/ceph-client.admin.292174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292174.log.gz 2024-03-18T07:19:10.561 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324260.log.gz 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280087.log 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.315720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315720.log.gz 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589799.log 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287870.log 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.280087.log: /var/log/ceph/ceph-client.admin.589799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589799.log.gz 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280087.log.gz 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628422.log 2024-03-18T07:19:10.562 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275182.log 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.287870.log: /var/log/ceph/ceph-client.admin.628422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628422.log.gz 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287870.log.gz 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590303.log 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577859.log 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.590303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590303.log.gz 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.275182.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.275182.log.gz 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.887045.log 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.577859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577859.log.gz 2024-03-18T07:19:10.563 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312694.log 2024-03-18T07:19:10.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.887045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.887045.log.gz 2024-03-18T07:19:10.564 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.753753.log 2024-03-18T07:19:10.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.312694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312694.log.gz 2024-03-18T07:19:10.564 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.753753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.753753.log.gz 2024-03-18T07:19:11.371 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-18T07:19:11.497 INFO:teuthology.orchestra.run.smithi081.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-18T07:19:11.965 INFO:teuthology.orchestra.run.smithi081.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-18T07:19:12.483 INFO:teuthology.orchestra.run.smithi136.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-18T07:19:14.769 INFO:teuthology.orchestra.run.smithi136.stderr: 93.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-18T07:19:44.041 INFO:teuthology.orchestra.run.smithi081.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-18T07:20:10.590 INFO:teuthology.orchestra.run.smithi136.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-18T07:20:12.154 INFO:teuthology.orchestra.run.smithi136.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-18T07:20:13.047 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-18T07:20:17.627 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-18T07:21:03.934 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-18T07:21:16.816 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-18T07:21:16.818 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-03-18T07:21:16.818 INFO:teuthology.orchestra.run.smithi136.stderr:real 2m8.168s 2024-03-18T07:21:16.818 INFO:teuthology.orchestra.run.smithi136.stderr:user 1m22.941s 2024-03-18T07:21:16.818 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m4.023s 2024-03-18T07:21:46.373 INFO:teuthology.orchestra.run.smithi081.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-18T07:22:43.521 INFO:teuthology.orchestra.run.smithi081.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-18T07:23:26.795 INFO:teuthology.orchestra.run.smithi081.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-18T07:23:26.798 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-03-18T07:23:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:real 4m18.140s 2024-03-18T07:23:26.798 INFO:teuthology.orchestra.run.smithi081.stderr:user 5m42.647s 2024-03-18T07:23:26.799 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m16.169s 2024-03-18T07:23:26.799 INFO:tasks.ceph:Archiving logs... 2024-03-18T07:23:26.800 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi081/log 2024-03-18T07:23:26.801 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T07:29:24.171 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi136/log 2024-03-18T07:29:24.198 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T07:42:21.576 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-18T07:42:21.625 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-18T07:42:21.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T07:42:21.630 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T07:42:21.923 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-18T07:42:21.932 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-18T07:42:21.933 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T07:42:21.936 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T07:42:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-03-18T07:42:21.974 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-03-18T07:42:22.005 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T07:42:22.005 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-03-18T07:42:22.005 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 2 +1125us[+1137us] +/- 95ms 2024-03-18T07:42:22.006 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv02.front.sepia.ceph.com 3 6 377 0 -1937us[-1925us] +/- 76ms 2024-03-18T07:42:22.006 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 0 +1110us[+1122us] +/- 81ms 2024-03-18T07:42:22.006 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T07:42:22.069 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T07:42:22.069 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-03-18T07:42:22.069 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 60 +1158us[+1160us] +/- 95ms 2024-03-18T07:42:22.070 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv02.front.sepia.ceph.com 3 6 377 59 -1883us[-1882us] +/- 76ms 2024-03-18T07:42:22.070 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 +1137us[+1137us] +/- 80ms 2024-03-18T07:42:22.070 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T07:42:22.071 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-18T07:42:22.080 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-18T07:42:22.081 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-18T07:42:22.090 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T07:42:22.498 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T07:42:22.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T07:42:22.709 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:42:22.710 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T07:42:22.742 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:42:22.743 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-18T07:42:22.753 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-18T07:42:22.762 INFO:teuthology.task.internal:Duration was 26644.766712 seconds 2024-03-18T07:42:22.762 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-18T07:42:22.771 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-18T07:42:22.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T07:42:22.775 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T07:42:22.873 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T07:42:22.901 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T07:42:23.284 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-18T07:42:23.284 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-03-18T07:42:23.285 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T07:42:23.326 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-03-18T07:42:23.327 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T07:42:23.353 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-18T07:42:23.354 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T07:42:23.370 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T07:42:23.435 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-18T07:42:23.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T07:42:23.438 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T07:42:24.618 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-18T07:42:24.630 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-18T07:42:24.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T07:42:24.698 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T07:42:24.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-18T07:42:24.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T07:42:24.747 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T07:42:24.813 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-03-18T07:42:24.821 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-03-18T07:42:24.873 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T07:42:24.905 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:42:24.905 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T07:42:24.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T07:42:24.921 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-18T07:42:24.932 INFO:teuthology.task.internal:Transferring archived files... 2024-03-18T07:42:24.933 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi081 2024-03-18T07:42:24.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T07:42:25.029 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517/remote/smithi136 2024-03-18T07:42:25.029 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T07:42:25.070 INFO:teuthology.task.internal:Removing archive directory... 2024-03-18T07:42:25.071 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T07:42:25.074 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T07:42:25.120 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-18T07:42:25.131 INFO:teuthology.task.internal:Not uploading archives. 2024-03-18T07:42:25.131 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-18T07:42:25.141 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-18T07:42:25.141 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T07:42:25.146 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T07:42:25.175 INFO:teuthology.orchestra.run.smithi136.stdout: 266037 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 07:42 /home/ubuntu/cephtest 2024-03-18T07:42:25.177 INFO:teuthology.orchestra.run.smithi081.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 07:42 /home/ubuntu/cephtest 2024-03-18T07:42:25.180 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-18T07:42:25.190 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-18T07:42:25.213 INFO:teuthology.nuke:Checking targets against current locks 2024-03-18T07:42:25.238 DEBUG:teuthology.nuke:shortname: smithi081 2024-03-18T07:42:25.238 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T07:42:25.262 DEBUG:teuthology.nuke:shortname: smithi136 2024-03-18T07:42:25.262 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T07:42:25.265 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 00:06:54.588723', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDu6T/EBrcVyipR51TLfO4ErsbDbbKfbVEKXYbfZlU5Pk+YMFCh0C7ySdXci9ItkftF2ds2Eu5VC8owGn+UZ4Gk='} 2024-03-18T07:42:25.289 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-17_23:17:27-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608517', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 00:06:54.586853', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOZEDarbIirPXjOmWqMJTJsT+MIa9MekmOVoh8NtnrlGavsAX5nMBBZy+Fssv+EyKb0mWkytGFbDcoMeG1J1z4c='} 2024-03-18T07:42:25.322 INFO:teuthology.orchestra.console.smithi081:Power off 2024-03-18T07:42:25.322 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T07:42:25.347 DEBUG:teuthology.orchestra.console.smithi081:power off output: Chassis Power Control: Down/Off 2024-03-18T07:42:25.348 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:25.362 INFO:teuthology.orchestra.console.smithi136:Power off 2024-03-18T07:42:25.363 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T07:42:25.372 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-18T07:42:25.385 DEBUG:teuthology.orchestra.console.smithi136:power off output: Chassis Power Control: Down/Off 2024-03-18T07:42:25.385 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:25.408 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-03-18T07:42:29.373 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:29.409 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:29.484 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-18T07:42:29.522 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-03-18T07:42:33.489 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:33.524 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:33.600 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is on 2024-03-18T07:42:33.634 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is on 2024-03-18T07:42:37.602 DEBUG:teuthology.orchestra.console.smithi081:pexpect command: ipmitool -H smithi081.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:37.635 DEBUG:teuthology.orchestra.console.smithi136:pexpect command: ipmitool -H smithi136.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T07:42:37.712 DEBUG:teuthology.orchestra.console.smithi081:check power output: Chassis Power is off 2024-03-18T07:42:37.748 DEBUG:teuthology.orchestra.console.smithi136:check power output: Chassis Power is off 2024-03-18T07:42:37.814 INFO:teuthology.orchestra.console.smithi081:Power off completed 2024-03-18T07:42:37.848 INFO:teuthology.orchestra.console.smithi136:Power off completed 2024-03-18T07:42:37.954 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 26644.766711950302 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=8bdcef48c45d495eb116e188eff77e0d status: fail success: false 2024-03-18T07:42:37.954 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T07:42:38.042 INFO:teuthology.run:FAIL